tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.2e2cWNOPsc', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 56.50 seconds) gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for unit setup-gitlab.service gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab: waiting for the VM to finish booting gitlab # Filesystem UUID: 79f144ab-9eda-4cc8-8c6f-09a7f0ad5522 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/f1hix3s13pspvnpxfsjvxmalwh0cbkkq-nixos-system-gitlab-test/init regInfo=/nix/store/rcnvb66z5pv1xbhbairnl3w8sx3xsj7b-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 476290907 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000004] tsc: Detected 2400.008 MHz processor gitlab # [ 0.000810] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000878] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002750] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002761] Using GB pages for direct mapping gitlab # [ 0.002896] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002903] ACPI: Early table checksum verification disabled gitlab # [ 0.002906] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002910] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002913] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002921] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002923] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002924] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002926] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002928] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002929] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002930] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002931] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002931] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002932] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002932] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003162] No NUMA configuration found gitlab # [ 0.003163] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003165] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff] gitlab # [ 0.005642] Zone ranges: gitlab # [ 0.005642] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005644] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005645] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005646] Device empty gitlab # [ 0.005647] Movable zone start for each node gitlab # [ 0.005647] Early memory node ranges gitlab # [ 0.005648] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005649] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005650] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005651] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005674] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005957] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.122493] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.122925] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.122941] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.122980] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.122983] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.122984] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.122986] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.122987] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.122987] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.122990] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.122991] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.122996] TSC deadline timer available gitlab # [ 0.123001] CPU topo: Max. logical packages: 1 gitlab # [ 0.123002] CPU topo: Max. logical dies: 1 gitlab # [ 0.123002] CPU topo: Max. dies per package: 1 gitlab # [ 0.123006] CPU topo: Max. threads per core: 1 gitlab # [ 0.123006] CPU topo: Num. cores per package: 4 gitlab # [ 0.123007] CPU topo: Num. threads per package: 4 gitlab # [ 0.123007] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.123034] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.123052] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.123055] kvm-guest: setup PV sched yield gitlab # [ 0.123073] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.123075] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.123075] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.123077] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.123079] Booting paravirtualized kernel on KVM gitlab # [ 0.123083] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.127542] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.129907] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.129961] kvm-guest: PV spinlocks enabled gitlab # [ 0.129962] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.129966] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/f1hix3s13pspvnpxfsjvxmalwh0cbkkq-nixos-system-gitlab-test/init regInfo=/nix/store/rcnvb66z5pv1xbhbairnl3w8sx3xsj7b-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.130065] Unknown kernel command line parameters "regInfo=/nix/store/rcnvb66z5pv1xbhbairnl3w8sx3xsj7b-closure-info/registration", will be passed to user space. gitlab # [ 0.130078] random: crng init done gitlab # [ 0.130079] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.139648] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.144219] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.144300] software IO TLB: area num 4. gitlab # [ 0.225763] Fallback order for Node 0: 0 gitlab # [ 0.225772] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.225774] Policy zone: Normal gitlab # [ 0.228457] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.238885] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.253905] allocated 12582912 bytes of page_ext gitlab # [ 0.264293] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.264296] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.265181] Dynamic Preempt: lazy gitlab # [ 0.265346] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.265347] rcu: RCU event tracing is enabled. gitlab # [ 0.265348] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.265350] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.265350] Rude variant of Tasks RCU enabled. gitlab # [ 0.265350] Tracing variant of Tasks RCU enabled. gitlab # [ 0.265351] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.265352] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.265377] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.265378] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.265379] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.269772] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.270049] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.270060] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.270185] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.273785] Console: colour VGA+ 80x25 gitlab # [ 0.273788] printk: legacy console [tty0] enabled gitlab # [ 0.304488] printk: legacy console [ttyS0] enabled gitlab # [ 0.402034] ACPI: Core revision 20250807 gitlab # [ 0.402894] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.404392] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.405391] x2apic enabled gitlab # [ 0.406176] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.407075] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.408270] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.409722] kvm-guest: setup PV IPIs gitlab # [ 0.411300] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.412312] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.414058] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008) gitlab # [ 0.416143] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.417233] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.419055] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.420059] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.421055] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.423055] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.424055] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.425055] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.426055] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.427063] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.428619] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.430056] active return thunk: srso_alias_return_thunk gitlab # [ 0.431075] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.432055] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.433054] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.434054] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.435055] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.436055] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.437055] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.439055] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.440055] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.441054] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.442055] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.443055] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.444054] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.474393] Freeing SMP alternatives memory: 44K gitlab # [ 0.475058] pid_max: default: 32768 minimum: 301 gitlab # [ 0.476178] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.477152] landlock: Up and running. gitlab # [ 0.477797] Yama: becoming mindful. gitlab # [ 0.478709] LSM support for eBPF active gitlab # [ 0.479299] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.481206] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.483852] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.484680] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.485060] ... version: 2 gitlab # [ 0.485792] ... bit width: 48 gitlab # [ 0.486057] ... generic counters: 6 gitlab # [ 0.486813] ... generic bitmap: 000000000000003f gitlab # [ 0.487106] ... fixed-purpose counters: 0 gitlab # [ 0.487872] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.488785] ... value mask: 0000ffffffffffff gitlab # [ 0.489057] ... max period: 00007fffffffffff gitlab # [ 0.489970] ... global_ctrl mask: 000000000000003f gitlab # [ 0.490880] signal: max sigframe size: 3376 gitlab # [ 0.491662] rcu: Hierarchical SRCU implementation. gitlab # [ 0.492060] rcu: Max phase no-delay instances is 400. gitlab # [ 0.493122] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.498636] smp: Bringing up secondary CPUs ... gitlab # [ 0.499479] smpboot: x86: Booting SMP configuration: gitlab # [ 0.500065] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.503231] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.505058] smpboot: Total of 4 processors activated (19200.06 BogoMIPS) gitlab # [ 0.506423] Memory: 6011600K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved) gitlab # [ 0.509058] devtmpfs: initialized gitlab # [ 0.510254] x86/mm: Memory block size: 128MB gitlab # [ 0.513221] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.515096] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.516158] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.517338] PM: RTC time: 05:53:25, date: 2026-08-20 gitlab # [ 0.521215] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.523949] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.525065] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.527253] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.528070] audit: initializing netlink subsys (disabled) gitlab # [ 0.529271] audit: type=2000 audit(1787205205.579:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.529367] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.531059] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.532057] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.533045] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.533847] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.534886] cpuidle: using governor menu gitlab # [ 0.537306] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.538315] PCI: Using configuration type 1 for base access gitlab # [ 0.539058] PCI: Using configuration type 1 for extended access gitlab # [ 0.540230] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.543337] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.544059] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.545059] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.546057] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.551852] ACPI: Added _OSI(Module Device) gitlab # [ 0.553064] ACPI: Added _OSI(Processor Device) gitlab # [ 0.555063] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.562003] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.569084] ACPI: Interpreter enabled gitlab # [ 0.569752] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.571068] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.573366] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.577065] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.579648] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.593698] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.596071] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.598991] acpiphp: Slot [3] registered gitlab # [ 0.601030] acpiphp: Slot [4] registered gitlab # [ 0.602002] acpiphp: Slot [5] registered gitlab # [ 0.603017] acpiphp: Slot [6] registered gitlab # [ 0.605018] acpiphp: Slot [7] registered gitlab # [ 0.606028] acpiphp: Slot [8] registered gitlab # [ 0.607037] acpiphp: Slot [9] registered gitlab # [ 0.609052] acpiphp: Slot [10] registered gitlab # [ 0.610059] acpiphp: Slot [11] registered gitlab # [ 0.611101] acpiphp: Slot [12] registered gitlab # [ 0.613120] acpiphp: Slot [13] registered gitlab # [ 0.614101] acpiphp: Slot [14] registered gitlab # [ 0.615099] acpiphp: Slot [15] registered gitlab # [ 0.617108] acpiphp: Slot [16] registered gitlab # [ 0.618118] acpiphp: Slot [17] registered gitlab # [ 0.619078] acpiphp: Slot [18] registered gitlab # [ 0.619791] acpiphp: Slot [19] registered gitlab # [ 0.621077] acpiphp: Slot [20] registered gitlab # [ 0.621842] acpiphp: Slot [21] registered gitlab # [ 0.622078] acpiphp: Slot [22] registered gitlab # [ 0.622795] acpiphp: Slot [23] registered gitlab # [ 0.623079] acpiphp: Slot [24] registered gitlab # [ 0.623822] acpiphp: Slot [25] registered gitlab # [ 0.625079] acpiphp: Slot [26] registered gitlab # [ 0.625799] acpiphp: Slot [27] registered gitlab # [ 0.626089] acpiphp: Slot [28] registered gitlab # [ 0.626840] acpiphp: Slot [29] registered gitlab # [ 0.628079] acpiphp: Slot [30] registered gitlab # [ 0.628793] acpiphp: Slot [31] registered gitlab # [ 0.629205] PCI host bridge to bus 0000:00 gitlab # [ 0.629954] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.630939] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.632943] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.634077] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.637067] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.640067] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.642951] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.647268] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.652121] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.658135] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.660131] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.663064] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.665063] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.668064] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.670545] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.677242] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.681603] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.684604] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.687073] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.689516] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.714151] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.715072] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.716079] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.718660] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.721366] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.728104] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.730079] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.733118] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.763079] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.767202] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.775094] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.775975] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.776819] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.780305] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.784113] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.785069] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.786045] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.788763] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.795092] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.796012] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.796839] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.799332] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.805067] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.806743] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.808079] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.810303] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.815086] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.815962] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.818080] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.820326] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.822859] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.823735] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.825080] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.826086] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.829291] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.832102] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.833080] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.835288] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.840098] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.841028] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.841860] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.844312] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.848096] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.849016] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.851118] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.856239] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.857215] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.858191] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.860210] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.861138] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.864366] iommu: Default domain type: Translated gitlab # [ 0.864699] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.866428] ACPI: bus type USB registered gitlab # [ 0.867149] usbcore: registered new interface driver usbfs gitlab # [ 0.868083] usbcore: registered new interface driver hub gitlab # [ 0.868968] usbcore: registered new device driver usb gitlab # [ 0.872253] NetLabel: Initializing gitlab # [ 0.872999] NetLabel: domain hash size = 128 gitlab # [ 0.873599] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.874174] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.875069] PCI: Using ACPI for IRQ routing gitlab # [ 0.877082] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.878054] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.878054] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.880063] vgaarb: loaded gitlab # [ 0.880885] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.881718] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.887176] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.890842] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.891578] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.893241] pnp: PnP ACPI init gitlab # [ 0.894428] pnp: PnP ACPI: found 6 devices gitlab # [ 0.904717] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.906332] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.907403] NET: Registered PF_INET protocol family gitlab # [ 0.909620] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.927848] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.929403] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.930805] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.934554] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.935907] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.937426] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.939050] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.940487] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.941940] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.943014] NET: Registered PF_XDP protocol family gitlab # [ 0.943886] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 0.944952] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 0.946032] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 0.947179] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.948337] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.949669] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 0.950654] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 0.953131] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 0.956322] PCI: CLS 0 bytes, default 64 gitlab # [ 0.957156] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 0.957773] Trying to unpack rootfs image as initramfs... gitlab # [ 0.958298] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 0.958448] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.981840] Initialise system trusted keyrings gitlab # [ 0.983179] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 0.994525] Key type asymmetric registered gitlab # [ 0.995294] Asymmetric key parser 'x509' registered gitlab # [ 0.996210] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 0.997797] io scheduler mq-deadline registered gitlab # [ 0.998645] io scheduler kyber registered gitlab # [ 1.002846] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 1.004278] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 1.006679] Linux agpgart interface v0.103 gitlab # [ 1.007478] ACPI: bus type drm_connector registered gitlab # [ 1.009740] usbcore: registered new interface driver usbserial_generic gitlab # [ 1.010871] usbserial: USB Serial support registered for generic gitlab # [ 1.011897] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 1.011897] Please enable it if your BIOS has the CPPC option. gitlab # [ 1.014221] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 1.015675] drop_monitor: Initializing network drop monitor service gitlab # [ 1.016919] NET: Registered PF_INET6 protocol family gitlab # [ 1.018671] Segment Routing with IPv6 gitlab # [ 1.019369] In-situ OAM (IOAM) with IPv6 gitlab # [ 1.021688] IPI shorthand broadcast: enabled gitlab # [ 1.026135] sched_clock: Marking stable (890012326, 135994350)->(1045848684, -19842008) gitlab # [ 1.027965] registered taskstats version 1 gitlab # [ 1.029050] Loading compiled-in X.509 certificates gitlab # [ 1.039047] Demotion targets for Node 0: null gitlab # [ 1.040205] Key type .fscrypt registered gitlab # [ 1.040915] Key type fscrypt-provisioning registered gitlab # [ 1.041959] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.043014] ima: Allocated hash algorithm: sha1 gitlab # [ 1.043853] ima: No architecture policies found gitlab # [ 1.045102] PM: Magic number: 6:383:871 gitlab # [ 1.045853] PM: hash matches drivers/base/power/main.c:1117 gitlab # [ 1.047861] RAS: Correctable Errors collector initialized. gitlab # [ 1.052401] clk: Disabling unused clocks gitlab # [ 1.053118] PM: genpd: Disabling unused power domains gitlab # [ 1.251904] Freeing initrd memory: 29392K gitlab # [ 1.256043] Freeing unused decrypted memory: 2028K gitlab # [ 1.259144] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.260313] Write protecting the kernel read-only data: 32768k gitlab # [ 1.262537] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.264321] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.329198] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.330399] Run /init as init process gitlab # [ 1.343855] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.367521] fuse: init (API version 7.45) gitlab # [ 1.375874] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.382976] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.386174] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.431423] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.767288] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.807428] systemd[1]: Detected virtualization kvm. gitlab # [ 1.809530] systemd[1]: Detected architecture x86-64. gitlab # [ 1.811711] systemd[1]: Running in initrd. gitlab # [ 1.814243] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.817100] systemd[1]: Hostname set to . gitlab # [ 1.934735] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.984534] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.997739] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.998928] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 2.000378] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 2.001523] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 2.002684] systemd[1]: Reached target Path Units. gitlab # [ 2.003553] systemd[1]: Reached target Slice Units. gitlab # [ 2.004429] systemd[1]: Reached target Swaps. gitlab # [ 2.005228] systemd[1]: Reached target Timer Units. gitlab # [ 2.006236] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 2.007471] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 2.008603] systemd[1]: Listening on Journal Sockets. gitlab # [ 2.009583] systemd[1]: Listening on udev Control Socket. gitlab # [ 2.010592] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 2.011513] systemd[1]: Reached target Socket Units. gitlab # [ 2.013755] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 2.015941] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 2.018213] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 2.021074] systemd[1]: Starting Journal Service... gitlab # [ 2.025094] systemd[1]: Starting Load Kernel Modules... gitlab # [ 2.028095] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 2.031478] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 2.036076] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 2.051111] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 2.053025] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 2.057858] systemd-journald[91]: Collecting audit messages is disabled. gitlab # [ 2.063100] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 2.064806] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 2.082177] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 2.087132] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 2.089550] netfs: FS-Cache loaded gitlab # [ 2.094011] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 2.101826] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 2.101894] 9pnet: Installing 9P2000 support gitlab # [ 2.109747] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 2.111314] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 2.112970] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 2.114593] systemd[1]: Finished Load Kernel Modules. gitlab # [ 2.115768] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 2.117022] systemd[1]: Reached target Local File Systems. gitlab # [ 2.119064] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 2.121022] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.986660] systemd-modules-load[92]: Using 4 probe threads gitlab # [ 1.987844] systemd-modules-load[92]: Inserted module 'virtio_balloon' gitlab # [ 2.124330] systemd[1]: Started Journal Service. gitlab # [ 1.988993] systemd-modules-load[92]: Inserted module 'dm_mod' gitlab # [ 1.990195] systemd-modules-load[92]: Inserted module 'virtio_gpu' gitlab # [ 1.999285] systemd[1]: Starting Create System Files and Directories... gitlab # [ 2.001181] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 2.006947] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.008611] systemd-udevd[104]: Using default interface naming scheme 'v261'. gitlab # [ 2.019415] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 2.062447] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.063340] systemd[1]: Reached target System Initialization. gitlab # [ 2.064162] systemd[1]: Reached target Basic System. gitlab # [ 2.278811] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.294905] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.295843] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.317470] SCSI subsystem initialized gitlab # [ 2.317682] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.320059] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.321187] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.324314] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.328697] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.331495] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.333403] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.334481] usb usb1: Product: UHCI Host Controller gitlab # [ 2.335362] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.336595] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.345420] hub 1-0:1.0: USB hub found gitlab # [ 2.346072] hub 1-0:1.0: 2 ports detected gitlab # [ 2.212699] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.350082] scsi host0: ata_piix gitlab # [ 2.351184] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.353379] scsi host1: ata_piix gitlab # [ 2.353982] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.355117] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.357574] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.360378] virtio_blk virtio5: [vdb] 11789128 512-byte logical blocks (6.04 GB/5.62 GiB) gitlab # [ 2.233813] (udev-worker)[120]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.236277] systemd-vconsole-setup[144]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.238065] (udev-worker)[137]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.240122] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.243186] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.518576] ata2: found unknown device (class 0) gitlab # [ 2.519784] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.523211] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.551965] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.568065] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.448656] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.454219] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.456239] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.458077] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.597154] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.630888] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.507579] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.514583] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.741039] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.743936] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.746530] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.748141] usb 1-1: Manufacturer: QEMU gitlab # [ 2.749626] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.782162] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.796877] usbcore: registered new interface driver usbhid gitlab # [ 2.798898] usbhid: USB HID core driver gitlab # [ 2.808801] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.812174] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.901143] systemd[1]: Mounting /sysroot... gitlab # [ 3.192728] EXT4-fs (vda): mounted filesystem 79f144ab-9eda-4cc8-8c6f-09a7f0ad5522 r/w with ordered data mode. Quota mode: none. gitlab # [ 3.061909] systemd[1]: Mounted /sysroot. gitlab # [ 3.063839] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.067628] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.069791] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.078268] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.080545] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.083308] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.087660] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.091517] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.100218] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.102268] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.245573] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.113076] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.115353] systemd[1]: Reload requested from client PID 177 ('syste[ 3.251638] 9p: Installing v9fs 9p2000 file system support gitlab # md-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.119483] systemd[1]: Reloading... gitlab # [ 3.176650] systemd[1]: Reloading finished in 60 ms. gitlab # [ 3.198616] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.201932] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.203422] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.207534] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace... gitlab # [ 3.210723] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.213610] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.215881] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.218105] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.234635] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.236827] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.901407] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.951609] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.953594] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.955801] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.957649] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.984862] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.987721] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 4.002577] systemd[1]: Finished Find NixOS closure. gitlab # [ 4.004444] systemd[1]: Reached target Initrd Default Target. gitlab # [ 4.006466] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.036986] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.039350] systemd[1]: Stopped target Basic System. gitlab # [ 4.041187] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.043195] systemd[1]: Stopped target Path Units. gitlab # [ 4.044941] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.047503] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.050110] systemd[1]: Stopped target Slice Units. gitlab # [ 4.051898] systemd[1]: Stopped target Socket Units. gitlab # [ 4.054753] systemd[1]: Stopped target System Initialization. gitlab # [ 4.056885] systemd[1]: Stopped target Swaps. gitlab # [ 4.058501] systemd[1]: Stopped target Timer Units. gitlab # [ 4.060347] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.062971] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.065296] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.068182] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.069964] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 4.073530] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.075795] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.077871] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.079350] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.081276] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.082700] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.084732] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.086713] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.088599] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.090286] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.091831] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.093635] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.095454] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.096200] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.097292] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.098304] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.099093] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.099956] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.100851] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.101749] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.102683] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.103632] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.104399] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.105382] systemd[1]: Closed udev Control Socket. gitlab # [ 4.106130] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.107052] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.108069] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.108920] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.110027] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.110926] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.111856] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.132964] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.134363] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.135228] systemd[1]: Reached target Switch Root. gitlab # [ 4.136981] systemd[1]: Starting NixOS Activation... gitlab # [ 4.270508] initrd-nixos-activation-start[226]: booting system configuration /nix/store/f1hix3s13pspvnpxfsjvxmalwh0cbkkq-nixos-system-gitlab-test gitlab # [ 4.322380] initrd-nixos-activation-start[226]: running activation script... gitlab # [ 4.566852] initrd-nixos-activation-start[249]: setting up /etc... gitlab # [ 4.652062] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.653452] systemd[1]: Finished NixOS Activation. gitlab # [ 4.655806] systemd[1]: Starting Switch Root... gitlab # [ 4.675937] systemd[1]: Switching root. gitlab # [ 4.867921] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). gitlab # [ 4.968388] NET: Registered PF_VSOCK protocol family gitlab # [ 5.338193] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.348045] systemd[1]: Detected virtualization kvm. gitlab # [ 5.349876] systemd[1]: Detected architecture x86-64. gitlab # [ 5.351850] systemd[1]: Detected first boot. gitlab # [ 5.354436] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.500029] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.580536] systemd[1]: Applying preset policy. gitlab # [ 5.715867] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.833537] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.834811] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.837412] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.839429] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.840768] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.842184] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.843179] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.844354] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.845392] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.846108] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.846824] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.847644] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.848376] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.849145] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.849955] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.850866] systemd[1]: Reached target Path Units. gitlab # [ 5.851632] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.852405] systemd[1]: Reached target Slice Units. gitlab # [ 5.853091] systemd[1]: Reached target Swaps. gitlab # [ 5.854507] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.856456] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.857784] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.859449] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.860334] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.862730] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.864203] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.866187] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.867409] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.868501] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.869813] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.872610] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.873604] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.874458] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.877585] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.879765] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.881880] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 5.885071] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 5.892494] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 5.893572] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 5.896335] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 5.913507] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 5.915113] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.916823] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.927299] systemd[1]: Mounting FUSE Control File System... gitlab # [ 5.928564] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.934468] systemd[1]: Starting Journal Service... gitlab # [ 5.943227] systemd[1]: Starting Load Kernel Modules... gitlab # [ 5.947681] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 5.953184] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 5.956101] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.961125] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 5.965438] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 5.966782] systemd-journald[321]: Collecting audit messages is enabled. gitlab # [ 5.967255] systemd[1]: Mounted Huge Pages File System. gitlab # [ 5.969501] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 5.971354] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 5.972254] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 5.973554] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 5.974896] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 5.976332] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 5.977479] systemd[1]: Mounted FUSE Control File System. gitlab # [ 5.980203] EXT4-fs (vda): re-mounted 79f144ab-9eda-4cc8-8c6f-09a7f0ad5522. gitlab # [ 5.982023] loop: module loaded gitlab # [ 5.985374] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 5.852733] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 5.989127] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 5.856041] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.993573] systemd[1]: Started Journal Service. gitlab # [ 5.859128] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 5.860452] systemd-modules-load[323]: Using 3 probe threads gitlab # [ 5.863331] systemd-modules-load[323]: Inserted module 'loop' gitlab # [ 5.864538] systemd-modules-load[323]: Inserted module 'tls' gitlab # [ 5.865484] systemd[1]: Finished Load Kernel Modules. gitlab # [ 5.866866] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 5.869245] systemd-oomd[324]: No swap; memory pressure usage will be degraded gitlab # [ 5.871069] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.873061] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.874941] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 5.876200] systemd[1]: Starting Firewall... gitlab # [ 5.878151] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.879227] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 5.888863] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 5.894172] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 5.895426] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.897041] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.036316] systemd-journald[321]: Received client request to flush runtime journal. gitlab # [ 5.940554] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 5.942105] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 5.943264] systemd[1]: Reached target First Boot Complete. gitlab # [ 5.944617] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 5.945571] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 5.946489] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 5.947510] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 5.948325] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 5.960842] systemd-udevd[353]: Using default interface naming scheme 'v261'. gitlab # [ 5.989760] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 5.993087] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 6.061043] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.084355] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.111889] (udev-worker)[423]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.118888] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.143784] (udev-worker)[419]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.145829] (udev-worker)[419]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.301954] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.314029] ACPI: button: Power Button [PWRF] gitlab # [ 6.321171] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.334354] Console: switching to colour dummy device 80x25 gitlab # [ 6.335334] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.335790] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.338697] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.339469] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.203863] systemd[1]: Finished Firewall. gitlab # [ 6.205032] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.349329] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.350125] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.359159] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.360458] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.361509] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.373253] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.375505] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.375841] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 6.376740] rtc_cmos 00:05: setting system clock to 2026-08-20T05:53:30 UTC (1787205210) gitlab # [ 6.378058] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.382554] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.388571] FDC 0 is a S82078B gitlab # [ 6.393098] systemd-journald[321]: Time jumped backwards, rotating. gitlab # [ 6.399537] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.401931] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6 gitlab # [ 6.404240] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.269483] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.271841] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.275895] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.278644] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.279982] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.449083] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 gitlab # [ 6.347362] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.356159] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.358678] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.378426] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.391744] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.394682] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.396453] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.543025] ppdev: user-space parallel port driver gitlab # [ 6.566078] kvm_amd: TSC scaling supported gitlab # [ 6.566601] kvm_amd: Nested Virtualization enabled gitlab # [ 6.567243] kvm_amd: Nested Paging enabled gitlab # [ 6.567741] kvm_amd: LBR virtualization supported gitlab # [ 6.568360] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.568888] kvm_amd: Virtual GIF supported gitlab # [ 6.569449] kvm_amd: Virtual NMI enabled gitlab # [ 6.605129] EDAC MC: Ver: 3.0.0 gitlab # [ 6.474204] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.477350] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.702788] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.732910] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.735713] systemd[1]: Reached target Local File Systems. gitlab # [ 6.738967] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.743701] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.747965] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.749986] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.756910] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.761286] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.805416] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.807870] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.813969] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.819748] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.823993] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.840632] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.853567] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.856299] systemd[1]: Starting Update is Completed... gitlab # [ 6.875531] systemd[1]: Finished Update is Completed. gitlab # [ 6.910046] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 6.911584] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.183783] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.186318] systemd[1]: Reached target System Initialization. gitlab # [ 7.188824] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.191055] systemd[1]: Started logrotate.timer. gitlab # [ 7.192524] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.194457] systemd[1]: Reached target Timer Units. gitlab # [ 7.196270] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.198701] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.213499] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.215595] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.220108] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.222095] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.224069] systemd[1]: Reached target Socket Units. gitlab # [ 7.256476] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.259671] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.262217] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.267161] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.286600] dbus-broker-launch[577]: Ready gitlab # [ 7.289630] systemd[1]: Reached target Basic System. gitlab # [ 7.292803] systemd[1]: Started backdoor.service. gitlab # [ 7.295596] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.299428] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.309272] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.316188] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.323505] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.336268] systemd[1]: Started Reset console on configuration changes. gitlab # connecting to host... gitlab # [ 7.341882] systemd[1]: Starting resolvconf update... gitlab # [ 7.347362] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.347517] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 7.350783] logrotate[582]: note: 'monthly' overrides previously specified 'weekly' gitlab: connected to guest root shell gitlab # [ 7.350897] logrotate[582]: Reading state from file: /var/lib/logrotate.status gitlab: (connecting took 7.97 seconds) gitlab # [ 7.352100] logrotate[582]: state file /var/lib/logrotate.status does not exist gitlab: (finished: waiting for the VM to finish booting, in 7.97 seconds) gitlab # [ 7.352749] logrotate[582]: Allocating hash table for state file, size 64 entries gitlab # [ 7.353746] logrotate[582]: Handling 4 logs gitlab # [ 7.354050] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.354585] logrotate[582]: considering log /var/log/btmp gitlab # [ 7.355712] logrotate[582]: Creating new state gitlab # [ 7.356807] logrotate[582]: Now: 2026-08-20 05:53 gitlab # [ 7.357881] logrotate[582]: Last rotated at 2026-08-20 05:00 gitlab # [ 7.358667] logrotate[582]: log does not need rotating (log has already been rotated) gitlab # [ 7.359476] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.360319] logrotate[582]: considering log /var/log/wtmp gitlab # [ 7.360881] logrotate[582]: Creating new state gitlab # [ 7.361685] logrotate[582]: Now: 2026-08-20 05:53 gitlab # [ 7.362481] logrotate[582]: Last rotated at 2026-08-20 05:00 gitlab # [ 7.362783] logrotate[582]: log does not need rotating (log has already been rotated) gitlab # [ 7.363965] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.364796] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582) gitlab # [ 7.366658] logrotate[582]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.368029] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.368679] logrotate[582]: Creating new state gitlab # [ 7.369786] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582) gitlab # [ 7.370662] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.371543] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582) gitlab # [ 7.372473] logrotate[582]: considering log /var/log/nginx/*.log gitlab # [ 7.373375] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.374244] logrotate[582]: Creating new state gitlab # [ 7.374790] logrotate[582]: not running postrotate script, since no logs were rotated gitlab # [ 7.375344] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582) gitlab # [ 7.376140] nsncd[583]: Aug 20 05:53:31.613 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.390264] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.392625] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.393789] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.401587] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.407092] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.407412] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.412676] systemd[1]: Starting User Login Management... gitlab # [ 7.442278] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.442835] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.443464] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.443897] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.444454] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.447946] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.448514] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.449094] systemd[1]: nscd.service: Consumed 25ms CPU time over 132ms wall clock time, 7.4M memory peak, 5.5M read from disk. gitlab # [ 7.452592] systemd-logind[623]: New seat seat0. gitlab # [ 7.452950] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.457756] systemd-logind[623]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.458180] systemd-logind[623]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 7.458659] systemd-logind[623]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.461363] systemd[1]: Started User Login Management. gitlab # [ 7.466541] systemd[1]: Starting linger-users.service... gitlab # [ 7.474632] systemd[1]: Finished resolvconf update. gitlab # [ 7.476110] nsncd[675]: Aug 20 05:53:31.735 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.478190] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.481467] systemd[1]: Starting DHCP Client... gitlab # [ 7.484306] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.493107] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.493529] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.494035] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.494433] systemd[1]: Finished linger-users.service. gitlab # [ 7.496830] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.497242] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.510329] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done gitlab # [ 7.515206] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done gitlab # [ 7.521701] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.556897] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.558840] systemd[1]: Reached target Network. gitlab # [ 7.562174] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.563236] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.565656] dhcpcd[714]: dhcpcd-10.3.2 starting gitlab # [ 7.568436] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.570564] dhcpcd[768]: dev: loaded udev gitlab # [ 7.571473] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.711197] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.575691] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.712561] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.592636] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.595666] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.601591] systemd[1]: Started Getty on tty1. gitlab # [ 7.602319] systemd[1]: Reached target Login Prompts. gitlab # [ 7.808631] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.813739] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.815136] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.817062] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.818526] cfg80211: failed to load regulatory.db gitlab # [ 7.701343] nginx-pre-start[788]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.702189] nginx-pre-start[788]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.706161] systemd[1]: Started Nginx Web Server. gitlab # [ 7.845806] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.711696] dhcpcd[768]: eth0: waiting for carrier gitlab # [ 7.714943] dhcpcd[768]: eth0: carrier acquired gitlab # [ 7.716843] postgresql-pre-start[790]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.717195] postgresql-pre-start[790]: This user must also own the server process. gitlab # [ 7.719770] dhcpcd[768]: DUID 00:01:00:01:32:19:52:db:52:54:00:12:34:56 gitlab # [ 7.720472] dhcpcd[768]: eth0: IAID 00:12:34:56 gitlab # [ 7.721053] dhcpcd[768]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.722361] postgresql-pre-start[790]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.723727] postgresql-pre-start[790]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.725066] postgresql-pre-start[790]: The default text search configuration will be set to "english". gitlab # [ 7.726452] postgresql-pre-start[790]: Data page checksums are enabled. gitlab # [ 7.727603] postgresql-pre-start[790]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.729056] postgresql-pre-start[790]: creating subdirectories ... ok gitlab # [ 7.730093] postgresql-pre-start[790]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.731427] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.733544] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.733977] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.734698] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started gitlab # [ 7.735194] redis-server[792]: Configuration loaded gitlab # [ 7.735655] redis[792]: monotonic clock: POSIX clock_gettime gitlab # [ 7.736227] redis[792]: Running mode=standalone, port=0. gitlab # [ 7.738053] redis[792]: Server initialized gitlab # [ 7.738918] redis[792]: Ready to accept connections unix gitlab # [ 7.739659] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.764303] postgresql-pre-start[790]: selecting default "max_connections" ... 100 gitlab # [ 7.801753] postgresql-pre-start[790]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.121333] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.152366] postgresql-pre-start[790]: selecting default time zone ... UTC gitlab # [ 8.154821] postgresql-pre-start[790]: creating configuration files ... ok gitlab # [ 8.291323] gitlab-workhorse[825]: time="2026-08-20T05:53:32Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.291525] gitlab-workhorse[825]: time="2026-08-20T05:53:32Z" level=info msg="Using redis/go-redis" gitlab # [ 8.293052] gitlab-workhorse[825]: time="2026-08-20T05:53:32Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.350497] postgresql-pre-start[790]: running bootstrap script ... ok gitlab # [ 8.489630] dhcpcd[768]: eth0: soliciting a DHCP lease gitlab # [ 8.632669] NET: Registered PF_PACKET protocol family gitlab # [ 8.504756] dhcpcd[768]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.520283] dhcpcd[768]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.786299] postgresql-pre-start[790]: performing post-bootstrap initialization ... ok gitlab # [ 9.101843] postgresql-pre-start[790]: syncing data to disk ... ok gitlab # [ 9.102094] postgresql-pre-start[790]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 9.103146] postgresql-pre-start[790]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 9.103855] postgresql-pre-start[790]: Success. You can now start the database server using: gitlab # [ 9.104968] postgresql-pre-start[790]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.245717] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.250083] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.250827] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.259214] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.274541] postgres[860]: [860] LOG: database system was shut down at 2026-08-20 05:53:33 GMT gitlab # [ 9.283078] postgres[851]: [851] LOG: database system is ready to accept connections gitlab # [ 9.291517] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.295739] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.470371] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[869]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.473806] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[869]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.506506] postgresql-setup-start[876]: CREATE DATABASE gitlab # [ 9.527847] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.530656] systemd[1]: Started gitaly.service. gitlab # [ 9.532791] postgresql-setup-start[901]: CREATE ROLE gitlab # [ 9.544334] postgresql-setup-start[905]: ALTER DATABASE gitlab # [ 9.570910] postgresql-setup-start[911]: CREATE ROLE gitlab # [ 9.573488] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.574677] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.576895] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.578883] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.675432] gitlab-postgresql-start[921]: CREATE DATABASE gitlab # [ 9.715170] gitlab-postgresql-start[932]: CREATE EXTENSION gitlab # [ 9.771182] dhcpcd[768]: eth0: soliciting an IPv6 router gitlab # [ 9.773825] dhcpcd[768]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.775533] dhcpcd[768]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.777434] dhcpcd[768]: eth0: adding route to fec0::/64 gitlab # [ 9.778919] dhcpcd[768]: eth0: adding default route via fe80::2 gitlab # [ 9.799794] gitlab-postgresql-start[934]: CREATE EXTENSION gitlab # [ 9.804901] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 10.048632] gitaly[904]: time="2026-08-20T05:53:34.307Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=904 gitlab # [ 10.052456] gitaly[904]: time="2026-08-20T05:53:34.307Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=904 gitlab # [ 10.054037] gitaly[904]: time="2026-08-20T05:53:34.307Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=904 gitlab # [ 10.055958] gitaly[904]: time="2026-08-20T05:53:34.307Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=904 gitlab # [ 10.057707] gitaly[904]: time="2026-08-20T05:53:34.307Z" level=info msg="Starting Gitaly" pid=904 version= gitlab # [ 10.215126] gitaly[904]: time="2026-08-20T05:53:34.473Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=164 pid=904 gitlab # [ 10.217051] gitaly[904]: time="2026-08-20T05:53:34.473Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=904 gitlab # [ 10.218805] gitaly[904]: time="2026-08-20T05:53:34.474Z" level=info msg="finished initializing command factory" duration_ms=0 pid=904 gitlab # [ 10.220469] gitaly[904]: time="2026-08-20T05:53:34.474Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-904/git-exec-2700222913.d/git pid=904 gitlab # [ 10.222564] gitaly[904]: time="2026-08-20T05:53:34.478Z" level=info msg="finished detecting git version" duration_ms=3 pid=904 gitlab # [ 10.224193] gitaly[904]: time="2026-08-20T05:53:34.478Z" level=info msg="using Git version" pid=904 version=2.53.g gitlab # [ 10.225690] gitaly[904]: time="2026-08-20T05:53:34.478Z" level=info msg="clearing disk cache object folder" pid=904 storage=default gitlab # [ 10.227398] gitaly[904]: time="2026-08-20T05:53:34.478Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4225961393 pid=904 storage=default gitlab # [ 10.229992] gitaly[904]: time="2026-08-20T05:53:34.478Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4225961393 pid=904 storage=default gitlab # [ 10.233056] gitaly[904]: time="2026-08-20T05:53:34.479Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=904 gitlab # [ 10.235707] gitaly[904]: time="2026-08-20T05:53:34.479Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=904 gitlab # [ 10.238327] gitaly[904]: time="2026-08-20T05:53:34.479Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4225961393 clear_duration_ms=0 pid=904 storage=default gitlab # [ 10.270067] gitaly[904]: time="2026-08-20T05:53:34.528Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=904 gitlab # [ 10.272089] gitaly[904]: time="2026-08-20T05:53:34.529Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=904 schema=unix gitlab # [ 10.273793] gitaly[904]: time="2026-08-20T05:53:34.529Z" level=info msg="counting repositories" pid=904 gitlab # [ 10.274906] gitaly[904]: time="2026-08-20T05:53:34.529Z" level=info msg="starting to count repositories" pid=904 storage_path=/var/gitlab/state/repositories gitlab # [ 10.276444] gitaly[904]: time="2026-08-20T05:53:34.530Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=904 storage_path=/var/gitlab/state/repositories gitlab # [ 10.278278] gitaly[904]: time="2026-08-20T05:53:34.530Z" level=info msg="completed counting all repositories" counting_duration=0 pid=904 gitlab # [ 10.279981] gitaly[904]: time="2026-08-20T05:53:34.530Z" level=info msg="finished tempdir cleaner walk" pid=904 storage=default time_ms=0 gitlab # [ 10.282022] gitaly[904]: time="2026-08-20T05:53:34.529Z" level=info msg="listening at address" address=/run/gitaly/gitaly-904/sock.d/intern pid=904 schema=unix gitlab # [ 10.282337] gitaly[904]: time="2026-08-20T05:53:34.538Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=904 gitlab # [ 10.282818] gitaly[904]: time="2026-08-20T05:53:34.538Z" level=info msg="Started Gitaly" duration_ms=230 pid=904 gitlab # [ 10.283377] gitaly[904]: time="2026-08-20T05:53:34.538Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=904 gitlab # [ 10.283839] gitaly[904]: time="2026-08-20T05:53:34.538Z" level=info msg="maintenance: daily scheduled" pid=904 scheduled="2026-08-20 12:00:00 +0000 UTC" gitlab # [ 11.033516] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[918]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.036378] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[918]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.061521] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[918]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.217384] gitaly[904]: time="2026-08-20T05:53:36.475Z" level=info msg="License database preloaded" duration_ms=2167 pid=904 gitlab # [ 13.532486] dhcpcd[768]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.534731] dhcpcd[768]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.536525] dhcpcd[768]: eth0: adding default route via 10.0.2.2 gitlab # [ 13.648764] systemd[1]: Started DHCP Client. gitlab # [ 13.652176] systemd[1]: Reached target Network is Online. gitlab # [ 42.397480] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[918]: W, [2026-08-20T05:54:06.655675 #918] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 44.561157] postgres[1326]: [1326] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 44.561590] postgres[1326]: [1326] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 44.562298] postgres[1326]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 44.563764] postgres[1326]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 44.564828] postgres[1326]: attidentity AS identity, gitlab # [ 44.567134] postgres[1326]: attgenerated as attgenerated gitlab # [ 44.568705] postgres[1326]: FROM pg_attribute a gitlab # [ 44.570916] postgres[1326]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 44.572765] postgres[1326]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 44.574477] postgres[1326]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 44.576283] postgres[1326]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 44.577691] postgres[1326]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 44.579468] postgres[1326]: ORDER BY a.attnum gitlab # [ 44.581254] postgres[1326]: gitlab # [ 48.197523] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1359]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 48.197935] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1359]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 48.349322] gitlab-workhorse[825]: time="2026-08-20T05:54:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 58.359060] gitlab-workhorse[825]: time="2026-08-20T05:54:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 63.993988] postgres[1434]: [1434] ERROR: relation "table_without_models" does not exist gitlab # [ 63.996910] postgres[1434]: [1434] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.367348] gitlab-workhorse[825]: time="2026-08-20T05:54:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 76.515964] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 76.520460] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 76.523290] systemd[1]: Starting gitlab.service... gitlab # [ 76.868630] bundle[1610]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 76.873159] bundle[1610]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 76.877373] bundle[1610]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 78.377199] gitlab-workhorse[825]: time="2026-08-20T05:54:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 79.817350] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-08-20T05:54:44.058Z","message":"Starting cluster with 1 processes"} gitlab # [ 79.833625] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.072Z","pid":1610,"message":"* Enabling systemd notification integration"} gitlab # [ 79.834433] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"Puma starting in cluster mode..."} gitlab # [ 79.835405] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 79.836501] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 79.837473] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"* Min threads: 0"} gitlab # [ 79.838894] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"* Max threads: 4"} gitlab # [ 79.840342] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"* Environment: production"} gitlab # [ 79.841385] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"* Master PID: 1610"} gitlab # [ 79.842462] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"* Workers: 2"} gitlab # [ 79.843857] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 79.845257] bundle[1610]: {"timestamp":"2026-08-20T05:54:44.092Z","pid":1610,"message":"* Preloading application"} gitlab # [ 88.386518] gitlab-workhorse[825]: time="2026-08-20T05:54:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.388229] gitlab-workhorse[825]: time="2026-08-20T05:55:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 103.780772] bundle[1610]: W, [2026-08-20T05:55:08.039169 #1610] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 106.593645] sidekiq-cluster[1640]: 2026-08-20T05:55:10.852Z pid=1640 tid=wjk INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1640, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433598464} gitlab # [ 106.779573] sidekiq-cluster[1640]: W, [2026-08-20T05:55:11.038375 #1640] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 106.824375] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:11.083Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 108.398476] gitlab-workhorse[825]: time="2026-08-20T05:55:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 108.953824] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.212Z","message":"GitLab reliable fetch activated!"} gitlab # [ 108.954133] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.212Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 108.979570] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.238Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 108.986658] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.245Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 108.997127] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.255Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 109.002043] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.260Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 109.005404] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.264Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 109.016673] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.275Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 109.024947] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.284Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 109.031386] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.290Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 109.037647] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.296Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 109.044104] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.303Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 109.050957] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.310Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 109.058119] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.317Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 109.064420] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.323Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 109.071879] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.330Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 109.076223] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.335Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 109.079789] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.338Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 109.084633] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.343Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 109.092831] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.351Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 109.101104] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.360Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 109.108870] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.367Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 109.117472] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.376Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 109.125578] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.384Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 109.133247] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.392Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 109.140727] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.399Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 109.148206] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.407Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 109.156197] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.415Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 109.163897] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.422Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 109.171669] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.430Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 109.179603] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.438Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 109.187992] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.447Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 109.195598] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.454Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 109.204129] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.463Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 109.212447] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.471Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 109.220805] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.479Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 109.228874] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.487Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 109.235912] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.494Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 109.243726] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.502Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 109.252058] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.511Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 109.259059] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.518Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 109.267100] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.525Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 109.275664] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.534Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 109.282835] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.541Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 109.290989] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.549Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 109.299569] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.558Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 109.308297] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.567Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 109.315664] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.574Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 109.322575] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.581Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 109.331239] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.590Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 109.342981] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.601Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 109.348121] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.607Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 109.353360] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.612Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 109.358466] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.617Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 109.370260] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.629Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 109.372982] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.632Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 109.375381] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.634Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 109.377943] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.636Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 109.380116] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.639Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 109.382766] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.641Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 109.384772] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.643Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 109.387552] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.646Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 109.389649] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.648Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 109.391661] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.650Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 109.394379] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.653Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 109.397103] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.656Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 109.399859] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.658Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 109.402578] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.661Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 109.404681] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.663Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 109.406867] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.665Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 109.449971] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.709Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 109.452425] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.711Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 109.454900] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.713Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 109.458780] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.717Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 109.463606] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.722Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 109.469087] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.728Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 109.473609] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.732Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 109.477436] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.736Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 109.482141] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.741Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 109.485906] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.745Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 109.489371] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.748Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 109.493422] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.752Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 109.497186] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.756Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 109.501467] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.760Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 109.505380] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.764Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 109.509758] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.768Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 109.513484] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.772Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 109.517664] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.776Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 109.521533] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.780Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 109.525544] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.784Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 109.529058] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.788Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 109.533107] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.792Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 109.536620] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.795Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 109.541146] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.800Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 109.544991] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.804Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 109.549083] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.808Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 109.553813] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.812Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 109.558707] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.817Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 109.563083] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.822Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 109.566975] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.826Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 109.577455] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.836Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 109.581937] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.841Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 109.585989] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.845Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 109.590622] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.849Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 109.595933] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.855Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 109.601570] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.860Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 109.605818] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.864Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 109.609318] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.868Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 109.612937] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.872Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 109.617413] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.876Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 109.621751] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:13.880Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 118.408190] gitlab-workhorse[825]: time="2026-08-20T05:55:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 128.410586] gitlab-workhorse[825]: time="2026-08-20T05:55:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 131.287622] postgres[2116]: [2116] ERROR: relation "table_without_models" does not exist gitlab # [ 131.288219] postgres[2116]: [2116] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 133.177387] postgres[2136]: [2136] ERROR: relation "table_without_models" does not exist gitlab # [ 133.178181] postgres[2136]: [2136] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 133.891866] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:38.150Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 133.895105] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:38.153Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 133.895365] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:38.153Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 133.897135] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:38.153Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 133.905476] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:38.164Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 135.595566] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:39.854Z","message":"Cleaning working queues"} gitlab # [ 135.598891] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:39.857Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d0df2374fb76ad1f845fdb53","created_at":"2026-08-20T05:54:40.456Z","trace_propagation_headers":{"sentry-trace":"8906a049c57c462b8feefa64f8861c33-79e1b786a3034ce2","baggage":"sentry-trace_id=8906a049c57c462b8feefa64f8861c33,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8e6e77a9206a1aaeafb38fe4c77ff9fa","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:40.465Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d0df2374fb76ad1f845fdb53: start","job_status":"start","queue_duration_s":59.391897,"scheduling_latency_s":59.391971} gitlab # [ 135.794093] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:55:40.052Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d0df2374fb76ad1f845fdb53","created_at":"2026-08-20T05:54:40.456Z","trace_propagation_headers":{"sentry-trace":"8906a049c57c462b8feefa64f8861c33-79e1b786a3034ce2","baggage":"sentry-trace_id=8906a049c57c462b8feefa64f8861c33,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8e6e77a9206a1aaeafb38fe4c77ff9fa","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:40.465Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d0df2374fb76ad1f845fdb53: done: 0.195406 sec","job_status":"done","queue_duration_s":59.391897,"scheduling_latency_s":59.391971,"redis_calls":29,"redis_duration_s":0.012334,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.008719,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002166,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001449,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09534396099999999,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.195406,"completed_at":"2026-08-20T05:55:40.052Z","load_balancing_strategy":"primary","db_duration_s":0.058761,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 137.086150] bundle[1610]: {"timestamp":"2026-08-20T05:55:41.344Z","pid":1610,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 137.086937] bundle[1610]: {"timestamp":"2026-08-20T05:55:41.344Z","pid":1610,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 137.088335] bundle[1610]: {"timestamp":"2026-08-20T05:55:41.344Z","pid":1610,"message":"! #\u003cThread:0x00007f6ce755c778 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 137.089320] bundle[1610]: {"timestamp":"2026-08-20T05:55:41.344Z","pid":1610,"message":"! #\u003cThread:0x00007f6ce77223f0 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 137.090384] bundle[1610]: {"timestamp":"2026-08-20T05:55:41.344Z","pid":1610,"message":"Use Ctrl-C to stop"} gitlab # [ 137.115903] bundle[1610]: {"timestamp":"2026-08-20T05:55:41.345Z","pid":1610,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 137.937577] bundle[1610]: {"timestamp":"2026-08-20T05:55:42.195Z","pid":1610,"message":"- Worker 1 (PID: 2212) booted in 0.77s, phase: 0"} gitlab # [ 137.939054] bundle[1610]: {"timestamp":"2026-08-20T05:55:42.198Z","pid":1610,"message":"- Worker 0 (PID: 2208) booted in 0.79s, phase: 0"} gitlab # [ 137.946343] systemd[1]: Started gitlab.service. gitlab # [ 137.948879] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 137.954299] systemd[1]: Starting setup-gitlab.service... gitlab # [ 137.982424] setup-gitlab-start[2245]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 140.071863] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:55:44 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2061 gitlab # [ 140.074392] setup-gitlab-start[2245]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 140.074611] setup-gitlab-start[2245]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 140.087900] runuser[2267]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 140.483105] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 140.483611] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 140.484956] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 141.060721] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 141.061256] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 141.062829] setup-gitlab-start[2268]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 160.782165] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:05.039Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e068260048facbbb119f680e","created_at":"2026-08-20T05:56:05.007Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d94609e6876c41be5b9f61077d620ac7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.036Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e068260048facbbb119f680e: start","job_status":"start","queue_duration_s":0.003171,"scheduling_latency_s":0.003227} gitlab # [ 160.884574] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:05.142Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e068260048facbbb119f680e","created_at":"2026-08-20T05:56:05.007Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d94609e6876c41be5b9f61077d620ac7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.036Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e068260048facbbb119f680e: done: 0.103182 sec","job_status":"done","queue_duration_s":0.003171,"scheduling_latency_s":0.003227,"redis_calls":12,"redis_duration_s":0.015673,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005908,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004588,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005177,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000941461,"duration_s":0.103182,"completed_at":"2026-08-20T05:56:05.142Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 160.959067] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:05.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e7c4fd0dcdcaa38bd9bd9ff0","created_at":"2026-08-20T05:56:05.076Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b703085dc2c65af03910b5540a3bd17b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.094Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e7c4fd0dcdcaa38bd9bd9ff0: start","job_status":"start","queue_duration_s":0.123462,"scheduling_latency_s":0.123513} gitlab # [ 161.110774] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:05.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e7c4fd0dcdcaa38bd9bd9ff0","created_at":"2026-08-20T05:56:05.076Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b703085dc2c65af03910b5540a3bd17b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.094Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e7c4fd0dcdcaa38bd9bd9ff0: done: 0.151799 sec","job_status":"done","queue_duration_s":0.123462,"scheduling_latency_s":0.123513,"redis_calls":12,"redis_duration_s":0.038674,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002369,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008448,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.027857,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002184356,"exclusive_lock_hold_duration_s":0.015206681,"duration_s":0.151799,"completed_at":"2026-08-20T05:56:05.369Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 161.190634] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:05.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c4028e3ea4383289be672426","created_at":"2026-08-20T05:56:05.109Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"885822330365451501e0c10948f3e154","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.125Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c4028e3ea4383289be672426: start","job_status":"start","queue_duration_s":0.323338,"scheduling_latency_s":0.323392} gitlab # [ 161.466900] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:05.725Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c4028e3ea4383289be672426","created_at":"2026-08-20T05:56:05.109Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"885822330365451501e0c10948f3e154","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.125Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c4028e3ea4383289be672426: done: 0.276379 sec","job_status":"done","queue_duration_s":0.323338,"scheduling_latency_s":0.323392,"redis_calls":14,"redis_duration_s":0.02525,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004583,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008291,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.012376,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002200838,"exclusive_lock_hold_duration_s":0.19380061,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.276379,"completed_at":"2026-08-20T05:56:05.725Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 161.536768] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:05.795Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"24964193517b144c00e2e1bc","created_at":"2026-08-20T05:56:05.144Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.231Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-24964193517b144c00e2e1bc: start","job_status":"start","queue_duration_s":0.56351,"scheduling_latency_s":0.563547} gitlab # [ 161.844676] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.102Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"24964193517b144c00e2e1bc","created_at":"2026-08-20T05:56:05.144Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.231Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-24964193517b144c00e2e1bc: done: 0.307031 sec","job_status":"done","queue_duration_s":0.56351,"scheduling_latency_s":0.563547,"redis_calls":71,"redis_duration_s":0.122067,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.017642,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001266,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.102019,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.133752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01013816,"duration_s":0.307031,"completed_at":"2026-08-20T05:56:06.102Z","load_balancing_strategy":"primary","db_duration_s":0.012435,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 161.846198] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"cabe8b0187d67c35c4cc06e7","created_at":"2026-08-20T05:56:05.253Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c04b0b3e0a00e021520f5c7edb97fa7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.268Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-cabe8b0187d67c35c4cc06e7: start","job_status":"start","queue_duration_s":0.836163,"scheduling_latency_s":0.836197} gitlab # [ 162.044714] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.303Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"cabe8b0187d67c35c4cc06e7","created_at":"2026-08-20T05:56:05.253Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c04b0b3e0a00e021520f5c7edb97fa7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.268Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-cabe8b0187d67c35c4cc06e7: done: 0.198511 sec","job_status":"done","queue_duration_s":0.836163,"scheduling_latency_s":0.836197,"redis_calls":14,"redis_duration_s":0.004437,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001282,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001501,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.136607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000754006,"exclusive_lock_hold_duration_s":0.166696885,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.198511,"completed_at":"2026-08-20T05:56:06.303Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.06183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.046764] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"d262d8e662f146aac4397f63","created_at":"2026-08-20T05:56:05.286Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f54134d2066bd979e83e4a61622cb9a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.296Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-d262d8e662f146aac4397f63: start","job_status":"start","queue_duration_s":1.008611,"scheduling_latency_s":1.008626} gitlab # [ 162.258194] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"d262d8e662f146aac4397f63","created_at":"2026-08-20T05:56:05.286Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f54134d2066bd979e83e4a61622cb9a8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.296Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-d262d8e662f146aac4397f63: done: 0.212001 sec","job_status":"done","queue_duration_s":1.008611,"scheduling_latency_s":1.008626,"redis_calls":12,"redis_duration_s":0.00335,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000514,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001428,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001408,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000433016,"exclusive_lock_hold_duration_s":0.194025218,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.212001,"completed_at":"2026-08-20T05:56:06.516Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087715,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null} gitlab # [ 162.260241] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b0ff404a5e9ae1854bd5952e","created_at":"2026-08-20T05:56:05.322Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fecc9ab4a8c1f62e6cf1555cc7eb3f75","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:56:05.335Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b0ff404a5e9ae1854bd5952e: start","job_status":"start","queue_duration_s":1.182999,"scheduling_latency_s":1.183015} gitlab # [ 162.283845] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.528Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 162.292287] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b0ff404a5e9ae1854bd5952e","created_at":"2026-08-20T05:56:05.322Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fecc9ab4a8c1f62e6cf1555cc7eb3f75","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:56:05.335Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b0ff404a5e9ae1854bd5952e: done: 0.016227 sec","job_status":"done","queue_duration_s":1.182999,"scheduling_latency_s":1.183015,"redis_calls":10,"redis_duration_s":0.001444,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229918,"duration_s":0.016227,"completed_at":"2026-08-20T05:56:06.534Z","load_balancing_strategy":"primary","db_duration_s":0.001672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.355331] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.535Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c610b06e2dd0e7e6b49b50b8","created_at":"2026-08-20T05:56:05.356Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20c444cb2e521deaa35a8a0c64796da7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.447Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c610b06e2dd0e7e6b49b50b8: start","job_status":"start","queue_duration_s":1.088173,"scheduling_latency_s":1.088187} gitlab # [ 162.356415] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c610b06e2dd0e7e6b49b50b8","created_at":"2026-08-20T05:56:05.356Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20c444cb2e521deaa35a8a0c64796da7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.447Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c610b06e2dd0e7e6b49b50b8: done: 0.042753 sec","job_status":"done","queue_duration_s":1.088173,"scheduling_latency_s":1.088187,"redis_calls":16,"redis_duration_s":0.002281,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001179,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000267632,"duration_s":0.042753,"completed_at":"2026-08-20T05:56:06.578Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.399762] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0b0ed0a753b81dc0d97e5481","created_at":"2026-08-20T05:56:05.470Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0238225e5ceef863308b66a278c5ac5f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.484Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0b0ed0a753b81dc0d97e5481: start","job_status":"start","queue_duration_s":1.095271,"scheduling_latency_s":1.095288} gitlab # [ 162.400633] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.594Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"0b0ed0a753b81dc0d97e5481","created_at":"2026-08-20T05:56:05.470Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0238225e5ceef863308b66a278c5ac5f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.484Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-0b0ed0a753b81dc0d97e5481: done: 0.014325 sec","job_status":"done","queue_duration_s":1.095271,"scheduling_latency_s":1.095288,"redis_calls":10,"redis_duration_s":0.002223,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033021,"duration_s":0.014325,"completed_at":"2026-08-20T05:56:06.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.435612] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"31aa199ea2831344bbf56cb1","created_at":"2026-08-20T05:56:05.518Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.553Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-31aa199ea2831344bbf56cb1: start","job_status":"start","queue_duration_s":1.041895,"scheduling_latency_s":1.041909} gitlab # [ 162.480132] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"31aa199ea2831344bbf56cb1","created_at":"2026-08-20T05:56:05.518Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.553Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-31aa199ea2831344bbf56cb1: done: 0.026458 sec","job_status":"done","queue_duration_s":1.041895,"scheduling_latency_s":1.041909,"redis_calls":19,"redis_duration_s":0.003484,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000955,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000263,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001645,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000621,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203099,"duration_s":0.026458,"completed_at":"2026-08-20T05:56:06.622Z","load_balancing_strategy":"primary","db_duration_s":0.002351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.481117] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"3f23cbd6ba85434db66418a1","created_at":"2026-08-20T05:56:05.566Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a21ff6b29d49740cbf32f398c185119","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.575Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-3f23cbd6ba85434db66418a1: start","job_status":"start","queue_duration_s":1.047869,"scheduling_latency_s":1.047882} gitlab # [ 162.493139] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.653Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"3f23cbd6ba85434db66418a1","created_at":"2026-08-20T05:56:05.566Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a21ff6b29d49740cbf32f398c185119","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.575Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-3f23cbd6ba85434db66418a1: done: 0.030206 sec","job_status":"done","queue_duration_s":1.047869,"scheduling_latency_s":1.047882,"redis_calls":12,"redis_duration_s":0.002971,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000466,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001369,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000468216,"exclusive_lock_hold_duration_s":0.012125842,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.030206,"completed_at":"2026-08-20T05:56:06.653Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.544727] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1ec9ba037f6ed4b954e68cae","created_at":"2026-08-20T05:56:05.580Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f232fcc7faf7356e2d984dcbffeb9d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.587Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1ec9ba037f6ed4b954e68cae: start","job_status":"start","queue_duration_s":1.067607,"scheduling_latency_s":1.067621} gitlab # [ 162.628581] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1ec9ba037f6ed4b954e68cae","created_at":"2026-08-20T05:56:05.580Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9f232fcc7faf7356e2d984dcbffeb9d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.587Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1ec9ba037f6ed4b954e68cae: done: 0.23256 sec","job_status":"done","queue_duration_s":1.067607,"scheduling_latency_s":1.067621,"redis_calls":565,"redis_duration_s":0.072416,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.071236,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.177131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277689,"duration_s":0.23256,"completed_at":"2026-08-20T05:56:06.887Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000512,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.663646] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"091477e9fd1ae006bd164b8e","created_at":"2026-08-20T05:56:05.656Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"355c799ba9d95d2741c4c92cfe1d0d99","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.671Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-091477e9fd1ae006bd164b8e: start","job_status":"start","queue_duration_s":1.251417,"scheduling_latency_s":1.251453} gitlab # [ 162.689727] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"091477e9fd1ae006bd164b8e","created_at":"2026-08-20T05:56:05.656Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"355c799ba9d95d2741c4c92cfe1d0d99","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.671Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-091477e9fd1ae006bd164b8e: done: 0.026225 sec","job_status":"done","queue_duration_s":1.251417,"scheduling_latency_s":1.251453,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000435,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001428,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007363785,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.026225,"completed_at":"2026-08-20T05:56:06.948Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002983,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 162.690919] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.949Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"1de321886395cbea2f87654f","created_at":"2026-08-20T05:56:05.677Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"a3322272fc8c7f8bee64f4d6e1acba1a","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.685Z","job_size_bytes":3,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-1de321886395cbea2f87654f: start","job_status":"start","queue_duration_s":1.263886,"scheduling_latency_s":1.263901} gitlab # [ 162.726079] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.974Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"1de321886395cbea2f87654f","created_at":"2026-08-20T05:56:05.677Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"a3322272fc8c7f8bee64f4d6e1acba1a","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.685Z","job_size_bytes":3,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-1de321886395cbea2f87654f: done: 0.025029 sec","job_status":"done","queue_duration_s":1.263886,"scheduling_latency_s":1.263901,"redis_calls":10,"redis_duration_s":0.002144,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00039,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000388317,"duration_s":0.025029,"completed_at":"2026-08-20T05:56:06.974Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000725,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.733656] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.976Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c5c15b5488bafca6e9fb9f3b","created_at":"2026-08-20T05:56:05.690Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec591803c70d36295b2cad14366ac607","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.701Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c5c15b5488bafca6e9fb9f3b: start","job_status":"start","queue_duration_s":1.274698,"scheduling_latency_s":1.274712} gitlab # [ 162.745732] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c5c15b5488bafca6e9fb9f3b","created_at":"2026-08-20T05:56:05.690Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec591803c70d36295b2cad14366ac607","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.701Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c5c15b5488bafca6e9fb9f3b: done: 0.022705 sec","job_status":"done","queue_duration_s":1.274698,"scheduling_latency_s":1.274712,"redis_calls":10,"redis_duration_s":0.001645,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000334,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224609,"duration_s":0.022705,"completed_at":"2026-08-20T05:56:06.998Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.788731] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:06.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d4b8a167cd4b86b86504c58a","created_at":"2026-08-20T05:56:05.714Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4fd8d5df7bae351db331b31561c7b07d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.788Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d4b8a167cd4b86b86504c58a: start","job_status":"start","queue_duration_s":1.21134,"scheduling_latency_s":1.211355} gitlab # [ 162.790840] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d4b8a167cd4b86b86504c58a","created_at":"2026-08-20T05:56:05.714Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4fd8d5df7bae351db331b31561c7b07d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.788Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d4b8a167cd4b86b86504c58a: done: 0.018994 sec","job_status":"done","queue_duration_s":1.21134,"scheduling_latency_s":1.211355,"redis_calls":12,"redis_duration_s":0.0017749999999999999,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000677,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000354235,"exclusive_lock_hold_duration_s":0.005448458000000001,"duration_s":0.018994,"completed_at":"2026-08-20T05:56:07.018Z","load_balancing_strategy":"primary","db_duration_s":0.003669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.827700] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"67abaa9db13f57e31c1886cd","created_at":"2026-08-20T05:56:05.793Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c4fc3250a5c7f60641cc2a708e4cb75","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.810Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-67abaa9db13f57e31c1886cd: start","job_status":"start","queue_duration_s":1.209851,"scheduling_latency_s":1.209864} gitlab # [ 162.836437] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.027Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 162.839096] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"67abaa9db13f57e31c1886cd","created_at":"2026-08-20T05:56:05.793Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c4fc3250a5c7f60641cc2a708e4cb75","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.810Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-67abaa9db13f57e31c1886cd: done: 0.012722 sec","job_status":"done","queue_duration_s":1.209851,"scheduling_latency_s":1.209864,"redis_calls":10,"redis_duration_s":0.001444,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000332,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00082,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248076,"duration_s":0.012722,"completed_at":"2026-08-20T05:56:07.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.884989] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"356a2bc22b664e4852f82bee","created_at":"2026-08-20T05:56:05.829Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a9717210c71e90bb5ba6e9d30bf9a48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.836Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-356a2bc22b664e4852f82bee: start","job_status":"start","queue_duration_s":1.197557,"scheduling_latency_s":1.19757} gitlab # [ 162.885599] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.041Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 162.887855] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.046Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"356a2bc22b664e4852f82bee","created_at":"2026-08-20T05:56:05.829Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a9717210c71e90bb5ba6e9d30bf9a48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.836Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-356a2bc22b664e4852f82bee: done: 0.012215 sec","job_status":"done","queue_duration_s":1.197557,"scheduling_latency_s":1.19757,"redis_calls":10,"redis_duration_s":0.001526,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215112,"duration_s":0.012215,"completed_at":"2026-08-20T05:56:07.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.925709] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"9211afbbc76349be3810c7de","created_at":"2026-08-20T05:56:05.851Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b25c6d68cecdc159856d1b6eac840a9","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.874Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-9211afbbc76349be3810c7de: start","job_status":"start","queue_duration_s":1.1729,"scheduling_latency_s":1.172913} gitlab # [ 162.932544] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.060Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"9211afbbc76349be3810c7de","created_at":"2026-08-20T05:56:05.851Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b25c6d68cecdc159856d1b6eac840a9","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.874Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-9211afbbc76349be3810c7de: done: 0.013254 sec","job_status":"done","queue_duration_s":1.1729,"scheduling_latency_s":1.172913,"redis_calls":12,"redis_duration_s":0.001851,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00034,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002112,"duration_s":0.013254,"completed_at":"2026-08-20T05:56:07.060Z","load_balancing_strategy":"primary","db_duration_s":0.000292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 162.978712] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9c7ae7f523c5aca16a52f3eb","created_at":"2026-08-20T05:56:05.887Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef9240c48dfc0d77dfe95ff534107588","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.902Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9c7ae7f523c5aca16a52f3eb: start","job_status":"start","queue_duration_s":1.158485,"scheduling_latency_s":1.1585} gitlab # [ 162.979533] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.076Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9c7ae7f523c5aca16a52f3eb","created_at":"2026-08-20T05:56:05.887Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef9240c48dfc0d77dfe95ff534107588","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.902Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9c7ae7f523c5aca16a52f3eb: done: 0.015226 sec","job_status":"done","queue_duration_s":1.158485,"scheduling_latency_s":1.1585,"redis_calls":12,"redis_duration_s":0.0017100000000000001,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000612,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000343898,"exclusive_lock_hold_duration_s":0.00225727,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.015226,"completed_at":"2026-08-20T05:56:07.076Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.018742] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d7fb0aa49db455eec123e7c0","created_at":"2026-08-20T05:56:05.922Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3ab110f62dad15cb99614aadcdb86e9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:56:05.935Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d7fb0aa49db455eec123e7c0: start","job_status":"start","queue_duration_s":1.141818,"scheduling_latency_s":1.141833} gitlab # [ 163.023991] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.099Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d7fb0aa49db455eec123e7c0","created_at":"2026-08-20T05:56:05.922Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c3ab110f62dad15cb99614aadcdb86e9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:56:05.935Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d7fb0aa49db455eec123e7c0: done: 0.021785 sec","job_status":"done","queue_duration_s":1.141818,"scheduling_latency_s":1.141833,"redis_calls":10,"redis_duration_s":0.0014,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214832,"duration_s":0.021785,"completed_at":"2026-08-20T05:56:07.099Z","load_balancing_strategy":"primary","db_duration_s":0.003188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.088658] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9170e39523e86fc705705409","created_at":"2026-08-20T05:56:05.949Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"514442d12044d14f24a3b71ae5936e86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:56:05.961Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9170e39523e86fc705705409: start","job_status":"start","queue_duration_s":1.138646,"scheduling_latency_s":1.13866} gitlab # [ 163.089388] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.109Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 163.090023] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.114Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"9170e39523e86fc705705409","created_at":"2026-08-20T05:56:05.949Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"514442d12044d14f24a3b71ae5936e86","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:56:05.961Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-9170e39523e86fc705705409: done: 0.013743 sec","job_status":"done","queue_duration_s":1.138646,"scheduling_latency_s":1.13866,"redis_calls":10,"redis_duration_s":0.001483,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000211759,"duration_s":0.013743,"completed_at":"2026-08-20T05:56:07.113Z","load_balancing_strategy":"primary","db_duration_s":0.001446,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.126628] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6db7e785b0768b4d7bcb8978","created_at":"2026-08-20T05:56:05.977Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"166e492e23736b6c30ce0b572959470d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.992Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6db7e785b0768b4d7bcb8978: start","job_status":"start","queue_duration_s":1.122833,"scheduling_latency_s":1.122846} gitlab # [ 163.127396] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.122Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 163.128048] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6db7e785b0768b4d7bcb8978","created_at":"2026-08-20T05:56:05.977Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"166e492e23736b6c30ce0b572959470d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:05.992Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6db7e785b0768b4d7bcb8978: done: 0.01247 sec","job_status":"done","queue_duration_s":1.122833,"scheduling_latency_s":1.122846,"redis_calls":10,"redis_duration_s":0.0014,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000832,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234666,"duration_s":0.01247,"completed_at":"2026-08-20T05:56:07.127Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.165024] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b7f64b50d1923e16de50e301","created_at":"2026-08-20T05:56:06.002Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9f92a600d9f620618ccdc5cbfb77125","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.015Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b7f64b50d1923e16de50e301: start","job_status":"start","queue_duration_s":1.113343,"scheduling_latency_s":1.113356} gitlab # [ 163.166821] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.136Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 163.169817] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b7f64b50d1923e16de50e301","created_at":"2026-08-20T05:56:06.002Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9f92a600d9f620618ccdc5cbfb77125","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.015Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b7f64b50d1923e16de50e301: done: 0.012066 sec","job_status":"done","queue_duration_s":1.113343,"scheduling_latency_s":1.113356,"redis_calls":10,"redis_duration_s":0.001328,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000221815,"duration_s":0.012066,"completed_at":"2026-08-20T05:56:07.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.210626] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.141Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7c4109dac92fcaeb809bca08","created_at":"2026-08-20T05:56:06.030Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c7e8255e975af6b1be1a51d4b7d2a3f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.042Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7c4109dac92fcaeb809bca08: start","job_status":"start","queue_duration_s":1.098793,"scheduling_latency_s":1.098806} gitlab # [ 163.248828] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7c4109dac92fcaeb809bca08","created_at":"2026-08-20T05:56:06.030Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c7e8255e975af6b1be1a51d4b7d2a3f","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.042Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7c4109dac92fcaeb809bca08: done: 0.03087 sec","job_status":"done","queue_duration_s":1.098793,"scheduling_latency_s":1.098806,"redis_calls":10,"redis_duration_s":0.001925,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000347,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027266,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.03087,"completed_at":"2026-08-20T05:56:07.172Z","load_balancing_strategy":"primary","db_duration_s":0.008473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.249942] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"dfe050396e90ca07c8187da3","created_at":"2026-08-20T05:56:06.058Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfda686fd46c885ea6f370f3822b03f1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.074Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-dfe050396e90ca07c8187da3: start","job_status":"start","queue_duration_s":1.099471,"scheduling_latency_s":1.099487} gitlab # [ 163.284731] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"dfe050396e90ca07c8187da3","created_at":"2026-08-20T05:56:06.058Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-9d33c25648be43a6","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfda686fd46c885ea6f370f3822b03f1","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.074Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-dfe050396e90ca07c8187da3: done: 0.018609 sec","job_status":"done","queue_duration_s":1.099471,"scheduling_latency_s":1.099487,"redis_calls":10,"redis_duration_s":0.00147,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000237461,"duration_s":0.018609,"completed_at":"2026-08-20T05:56:07.192Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.322918] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0426c6e777b41933c0481974","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0426c6e777b41933c0481974: start","job_status":"start","queue_duration_s":1.116385,"scheduling_latency_s":1.116399} gitlab # [ 163.323607] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0426c6e777b41933c0481974","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0426c6e777b41933c0481974: done: 0.017877 sec","job_status":"done","queue_duration_s":1.116385,"scheduling_latency_s":1.116399,"redis_calls":16,"redis_duration_s":0.002672,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000252546,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017877,"completed_at":"2026-08-20T05:56:07.211Z","load_balancing_strategy":"primary","db_duration_s":0.000658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.359789] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc4231fad51fe02f4785d257","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc4231fad51fe02f4785d257: start","job_status":"start","queue_duration_s":1.135471,"scheduling_latency_s":1.135487} gitlab # [ 163.360562] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc4231fad51fe02f4785d257","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc4231fad51fe02f4785d257: done: 0.012679 sec","job_status":"done","queue_duration_s":1.135471,"scheduling_latency_s":1.135487,"redis_calls":13,"redis_duration_s":0.001994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001382,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012679,"completed_at":"2026-08-20T05:56:07.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.377184] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd8040ad32e54cfe030cd14e","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd8040ad32e54cfe030cd14e: start","job_status":"start","queue_duration_s":1.149102,"scheduling_latency_s":1.149118} gitlab # [ 163.387500] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd8040ad32e54cfe030cd14e","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd8040ad32e54cfe030cd14e: done: 0.010212 sec","job_status":"done","queue_duration_s":1.149102,"scheduling_latency_s":1.149118,"redis_calls":13,"redis_duration_s":0.001728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010212,"completed_at":"2026-08-20T05:56:07.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.436768] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb4bf3f728715f5b735dee84","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb4bf3f728715f5b735dee84: start","job_status":"start","queue_duration_s":1.160221,"scheduling_latency_s":1.160235} gitlab # [ 163.437574] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb4bf3f728715f5b735dee84","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb4bf3f728715f5b735dee84: done: 0.009852 sec","job_status":"done","queue_duration_s":1.160221,"scheduling_latency_s":1.160235,"redis_calls":13,"redis_duration_s":0.001709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009852,"completed_at":"2026-08-20T05:56:07.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.484656] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a960ca2e07c9df1b04df07bc","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a960ca2e07c9df1b04df07bc: start","job_status":"start","queue_duration_s":1.170931,"scheduling_latency_s":1.170945} gitlab # [ 163.485470] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a960ca2e07c9df1b04df07bc","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a960ca2e07c9df1b04df07bc: done: 0.009835 sec","job_status":"done","queue_duration_s":1.170931,"scheduling_latency_s":1.170945,"redis_calls":13,"redis_duration_s":0.002042,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001342,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009835,"completed_at":"2026-08-20T05:56:07.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.521672] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d5df1a927602aa00dc2c4be","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d5df1a927602aa00dc2c4be: start","job_status":"start","queue_duration_s":1.181806,"scheduling_latency_s":1.181818} gitlab # [ 163.522446] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d5df1a927602aa00dc2c4be","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d5df1a927602aa00dc2c4be: done: 0.009703 sec","job_status":"done","queue_duration_s":1.181806,"scheduling_latency_s":1.181818,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009703,"completed_at":"2026-08-20T05:56:07.268Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.560971] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d6b512d7fa8763c6ff118dc","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d6b512d7fa8763c6ff118dc: start","job_status":"start","queue_duration_s":1.192523,"scheduling_latency_s":1.192536} gitlab # [ 163.561616] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d6b512d7fa8763c6ff118dc","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d6b512d7fa8763c6ff118dc: done: 0.009715 sec","job_status":"done","queue_duration_s":1.192523,"scheduling_latency_s":1.192536,"redis_calls":13,"redis_duration_s":0.001722,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009715,"completed_at":"2026-08-20T05:56:07.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.598679] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81636cb3ac6a630ff842b088","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81636cb3ac6a630ff842b088: start","job_status":"start","queue_duration_s":1.203673,"scheduling_latency_s":1.203686} gitlab # [ 163.599461] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81636cb3ac6a630ff842b088","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81636cb3ac6a630ff842b088: done: 0.009823 sec","job_status":"done","queue_duration_s":1.203673,"scheduling_latency_s":1.203686,"redis_calls":13,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009823,"completed_at":"2026-08-20T05:56:07.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.646838] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8f6ca33b42745b622dc30bc","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8f6ca33b42745b622dc30bc: start","job_status":"start","queue_duration_s":1.214483,"scheduling_latency_s":1.214497} gitlab # [ 163.647547] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8f6ca33b42745b622dc30bc","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8f6ca33b42745b622dc30bc: done: 0.009605 sec","job_status":"done","queue_duration_s":1.214483,"scheduling_latency_s":1.214497,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009605,"completed_at":"2026-08-20T05:56:07.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.664419] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13bb4208ca1f7c6db7e1eb85","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13bb4208ca1f7c6db7e1eb85: start","job_status":"start","queue_duration_s":1.225085,"scheduling_latency_s":1.225099} gitlab # [ 163.674479] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13bb4208ca1f7c6db7e1eb85","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13bb4208ca1f7c6db7e1eb85: done: 0.009573 sec","job_status":"done","queue_duration_s":1.225085,"scheduling_latency_s":1.225099,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009573,"completed_at":"2026-08-20T05:56:07.311Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.719635] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6aaba2b749f9755c3ee7b415","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6aaba2b749f9755c3ee7b415: start","job_status":"start","queue_duration_s":1.235521,"scheduling_latency_s":1.235535} gitlab # [ 163.720515] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6aaba2b749f9755c3ee7b415","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6aaba2b749f9755c3ee7b415: done: 0.009988 sec","job_status":"done","queue_duration_s":1.235521,"scheduling_latency_s":1.235535,"redis_calls":13,"redis_duration_s":0.0019130000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009988,"completed_at":"2026-08-20T05:56:07.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.763695] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d11c367a0a790825215d3f","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d11c367a0a790825215d3f: start","job_status":"start","queue_duration_s":1.246405,"scheduling_latency_s":1.246419} gitlab # [ 163.764473] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d11c367a0a790825215d3f","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d11c367a0a790825215d3f: done: 0.009783 sec","job_status":"done","queue_duration_s":1.246405,"scheduling_latency_s":1.246419,"redis_calls":13,"redis_duration_s":0.0016610000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009783,"completed_at":"2026-08-20T05:56:07.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.805586] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b11ecb7c8e54e3113d51783","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b11ecb7c8e54e3113d51783: start","job_status":"start","queue_duration_s":1.257073,"scheduling_latency_s":1.257087} gitlab # [ 163.806208] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b11ecb7c8e54e3113d51783","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b11ecb7c8e54e3113d51783: done: 0.009862 sec","job_status":"done","queue_duration_s":1.257073,"scheduling_latency_s":1.257087,"redis_calls":13,"redis_duration_s":0.0017950000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009862,"completed_at":"2026-08-20T05:56:07.344Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.827773] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d4c25240a131e32a6afe906","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d4c25240a131e32a6afe906: start","job_status":"start","queue_duration_s":1.267757,"scheduling_latency_s":1.26777} gitlab # [ 163.837837] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d4c25240a131e32a6afe906","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d4c25240a131e32a6afe906: done: 0.009932 sec","job_status":"done","queue_duration_s":1.267757,"scheduling_latency_s":1.26777,"redis_calls":13,"redis_duration_s":0.001735,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001148,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009932,"completed_at":"2026-08-20T05:56:07.354Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.875620] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc2da7402eb59bc84e061508","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc2da7402eb59bc84e061508: start","job_status":"start","queue_duration_s":1.278556,"scheduling_latency_s":1.27857} gitlab # [ 163.878188] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc2da7402eb59bc84e061508","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc2da7402eb59bc84e061508: done: 0.010076 sec","job_status":"done","queue_duration_s":1.278556,"scheduling_latency_s":1.27857,"redis_calls":13,"redis_duration_s":0.0017299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010076,"completed_at":"2026-08-20T05:56:07.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.912834] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29d15421dd6fd99206ff5826","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29d15421dd6fd99206ff5826: start","job_status":"start","queue_duration_s":1.289562,"scheduling_latency_s":1.289577} gitlab # [ 163.956191] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29d15421dd6fd99206ff5826","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29d15421dd6fd99206ff5826: done: 0.009684 sec","job_status":"done","queue_duration_s":1.289562,"scheduling_latency_s":1.289577,"redis_calls":13,"redis_duration_s":0.001647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009684,"completed_at":"2026-08-20T05:56:07.376Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 163.958073] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d1813257c0403944d63cb95","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d1813257c0403944d63cb95: start","job_status":"start","queue_duration_s":1.300258,"scheduling_latency_s":1.300271} gitlab # [ 164.001195] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d1813257c0403944d63cb95","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d1813257c0403944d63cb95: done: 0.009711 sec","job_status":"done","queue_duration_s":1.300258,"scheduling_latency_s":1.300271,"redis_calls":13,"redis_duration_s":0.0017230000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009711,"completed_at":"2026-08-20T05:56:07.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.003125] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2dc12b382e84bad358691e4","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2dc12b382e84bad358691e4: start","job_status":"start","queue_duration_s":1.311036,"scheduling_latency_s":1.311051} gitlab # [ 164.014299] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2dc12b382e84bad358691e4","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2dc12b382e84bad358691e4: done: 0.012878 sec","job_status":"done","queue_duration_s":1.311036,"scheduling_latency_s":1.311051,"redis_calls":13,"redis_duration_s":0.002145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001427,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012878,"completed_at":"2026-08-20T05:56:07.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.049762] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f684690e59dcb0b821aceffc","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f684690e59dcb0b821aceffc: start","job_status":"start","queue_duration_s":1.32498,"scheduling_latency_s":1.324994} gitlab # [ 164.095040] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f684690e59dcb0b821aceffc","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f684690e59dcb0b821aceffc: done: 0.009722 sec","job_status":"done","queue_duration_s":1.32498,"scheduling_latency_s":1.324994,"redis_calls":13,"redis_duration_s":0.0017100000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009722,"completed_at":"2026-08-20T05:56:07.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.096061] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a52b1dc84c810b93c20aa9de","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a52b1dc84c810b93c20aa9de: start","job_status":"start","queue_duration_s":1.335744,"scheduling_latency_s":1.335759} gitlab # [ 164.106227] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a52b1dc84c810b93c20aa9de","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a52b1dc84c810b93c20aa9de: done: 0.009657 sec","job_status":"done","queue_duration_s":1.335744,"scheduling_latency_s":1.335759,"redis_calls":13,"redis_duration_s":0.001694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009657,"completed_at":"2026-08-20T05:56:07.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.156383] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.423Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab30cba3994b878f67cf56d6","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab30cba3994b878f67cf56d6: start","job_status":"start","queue_duration_s":1.346523,"scheduling_latency_s":1.346538} gitlab # [ 164.157347] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab30cba3994b878f67cf56d6","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab30cba3994b878f67cf56d6: done: 0.009757 sec","job_status":"done","queue_duration_s":1.346523,"scheduling_latency_s":1.346538,"redis_calls":13,"redis_duration_s":0.001609,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009757,"completed_at":"2026-08-20T05:56:07.433Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.198475] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6af1d124bf066fd573f5013d","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6af1d124bf066fd573f5013d: start","job_status":"start","queue_duration_s":1.357157,"scheduling_latency_s":1.357171} gitlab # [ 164.199234] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6af1d124bf066fd573f5013d","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6af1d124bf066fd573f5013d: done: 0.012839 sec","job_status":"done","queue_duration_s":1.357157,"scheduling_latency_s":1.357171,"redis_calls":13,"redis_duration_s":0.00192,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001247,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012839,"completed_at":"2026-08-20T05:56:07.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.253529] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98251c826556dc08365423b7","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98251c826556dc08365423b7: start","job_status":"start","queue_duration_s":1.370935,"scheduling_latency_s":1.370949} gitlab # [ 164.254337] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98251c826556dc08365423b7","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98251c826556dc08365423b7: done: 0.0103 sec","job_status":"done","queue_duration_s":1.370935,"scheduling_latency_s":1.370949,"redis_calls":13,"redis_duration_s":0.001912,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001375,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0103,"completed_at":"2026-08-20T05:56:07.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.301719] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba02ab4717de2540b85af3b6","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba02ab4717de2540b85af3b6: start","job_status":"start","queue_duration_s":1.382165,"scheduling_latency_s":1.382179} gitlab # [ 164.302602] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba02ab4717de2540b85af3b6","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba02ab4717de2540b85af3b6: done: 0.009719 sec","job_status":"done","queue_duration_s":1.382165,"scheduling_latency_s":1.382179,"redis_calls":13,"redis_duration_s":0.001703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009719,"completed_at":"2026-08-20T05:56:07.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.321167] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8813bce7a59700d36d6fc726","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8813bce7a59700d36d6fc726: start","job_status":"start","queue_duration_s":1.392822,"scheduling_latency_s":1.392836} gitlab # [ 164.364287] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8813bce7a59700d36d6fc726","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8813bce7a59700d36d6fc726: done: 0.009877 sec","job_status":"done","queue_duration_s":1.392822,"scheduling_latency_s":1.392836,"redis_calls":13,"redis_duration_s":0.0016870000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009877,"completed_at":"2026-08-20T05:56:07.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.366258] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fca4da691386940668dac0cf","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fca4da691386940668dac0cf: start","job_status":"start","queue_duration_s":1.403622,"scheduling_latency_s":1.403635} gitlab # [ 164.411093] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fca4da691386940668dac0cf","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fca4da691386940668dac0cf: done: 0.009623 sec","job_status":"done","queue_duration_s":1.403622,"scheduling_latency_s":1.403635,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009623,"completed_at":"2026-08-20T05:56:07.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.412133] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2865399e9c8153b23204f387","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2865399e9c8153b23204f387: start","job_status":"start","queue_duration_s":1.414261,"scheduling_latency_s":1.414277} gitlab # [ 164.451550] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2865399e9c8153b23204f387","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2865399e9c8153b23204f387: done: 0.009623 sec","job_status":"done","queue_duration_s":1.414261,"scheduling_latency_s":1.414277,"redis_calls":13,"redis_duration_s":0.001671,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009623,"completed_at":"2026-08-20T05:56:07.501Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.456095] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dad71841ab6f41f3d6a9e506","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dad71841ab6f41f3d6a9e506: start","job_status":"start","queue_duration_s":1.424892,"scheduling_latency_s":1.424907} gitlab # [ 164.495352] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dad71841ab6f41f3d6a9e506","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dad71841ab6f41f3d6a9e506: done: 0.013375 sec","job_status":"done","queue_duration_s":1.424892,"scheduling_latency_s":1.424907,"redis_calls":13,"redis_duration_s":0.001993,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001307,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013375,"completed_at":"2026-08-20T05:56:07.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.501120] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86352d07042d357657333f78","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86352d07042d357657333f78: start","job_status":"start","queue_duration_s":1.439701,"scheduling_latency_s":1.439726} gitlab # [ 164.512601] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86352d07042d357657333f78","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86352d07042d357657333f78: done: 0.012182 sec","job_status":"done","queue_duration_s":1.439701,"scheduling_latency_s":1.439726,"redis_calls":13,"redis_duration_s":0.0017200000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012182,"completed_at":"2026-08-20T05:56:07.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.551456] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"558e8d961dc6a905a9b09f1e","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-558e8d961dc6a905a9b09f1e: start","job_status":"start","queue_duration_s":1.452983,"scheduling_latency_s":1.452997} gitlab # [ 164.557684] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"558e8d961dc6a905a9b09f1e","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-558e8d961dc6a905a9b09f1e: done: 0.011201 sec","job_status":"done","queue_duration_s":1.452983,"scheduling_latency_s":1.452997,"redis_calls":13,"redis_duration_s":0.001805,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011201,"completed_at":"2026-08-20T05:56:07.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.611799] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e97a2c49466a9bdf82b5584","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e97a2c49466a9bdf82b5584: start","job_status":"start","queue_duration_s":1.465334,"scheduling_latency_s":1.46535} gitlab # [ 164.612643] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e97a2c49466a9bdf82b5584","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e97a2c49466a9bdf82b5584: done: 0.010644 sec","job_status":"done","queue_duration_s":1.465334,"scheduling_latency_s":1.46535,"redis_calls":13,"redis_duration_s":0.001689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010644,"completed_at":"2026-08-20T05:56:07.553Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.662674] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26e6313bf1709af3f3776e37","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26e6313bf1709af3f3776e37: start","job_status":"start","queue_duration_s":1.476844,"scheduling_latency_s":1.476858} gitlab # [ 164.663500] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26e6313bf1709af3f3776e37","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26e6313bf1709af3f3776e37: done: 0.010523 sec","job_status":"done","queue_duration_s":1.476844,"scheduling_latency_s":1.476858,"redis_calls":13,"redis_duration_s":0.001951,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010523,"completed_at":"2026-08-20T05:56:07.564Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.702331] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f287fc24c8ec451de2f1c09","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f287fc24c8ec451de2f1c09: start","job_status":"start","queue_duration_s":1.488259,"scheduling_latency_s":1.488272} gitlab # [ 164.703025] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f287fc24c8ec451de2f1c09","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f287fc24c8ec451de2f1c09: done: 0.012457 sec","job_status":"done","queue_duration_s":1.488259,"scheduling_latency_s":1.488272,"redis_calls":13,"redis_duration_s":0.0017670000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012457,"completed_at":"2026-08-20T05:56:07.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.762403] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb93aced66f5babc0f0144c6","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb93aced66f5babc0f0144c6: start","job_status":"start","queue_duration_s":1.502177,"scheduling_latency_s":1.502201} gitlab # [ 164.763140] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb93aced66f5babc0f0144c6","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb93aced66f5babc0f0144c6: done: 0.011511 sec","job_status":"done","queue_duration_s":1.502177,"scheduling_latency_s":1.502201,"redis_calls":13,"redis_duration_s":0.002011,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001389,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011511,"completed_at":"2026-08-20T05:56:07.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.771674] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cd959f5ba51625ab6c6028c","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cd959f5ba51625ab6c6028c: start","job_status":"start","queue_duration_s":1.514568,"scheduling_latency_s":1.514582} gitlab # [ 164.782686] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cd959f5ba51625ab6c6028c","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cd959f5ba51625ab6c6028c: done: 0.009812 sec","job_status":"done","queue_duration_s":1.514568,"scheduling_latency_s":1.514582,"redis_calls":13,"redis_duration_s":0.00179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009812,"completed_at":"2026-08-20T05:56:07.601Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.846334] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5947c499a357cbd98b9d9234","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5947c499a357cbd98b9d9234: start","job_status":"start","queue_duration_s":1.525233,"scheduling_latency_s":1.525247} gitlab # [ 164.847028] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5947c499a357cbd98b9d9234","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5947c499a357cbd98b9d9234: done: 0.00966 sec","job_status":"done","queue_duration_s":1.525233,"scheduling_latency_s":1.525247,"redis_calls":13,"redis_duration_s":0.001665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00966,"completed_at":"2026-08-20T05:56:07.612Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.900348] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34b54bf47f87aa059fa87063","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34b54bf47f87aa059fa87063: start","job_status":"start","queue_duration_s":1.535764,"scheduling_latency_s":1.535778} gitlab # [ 164.901071] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34b54bf47f87aa059fa87063","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34b54bf47f87aa059fa87063: done: 0.009832 sec","job_status":"done","queue_duration_s":1.535764,"scheduling_latency_s":1.535778,"redis_calls":13,"redis_duration_s":0.0017620000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009832,"completed_at":"2026-08-20T05:56:07.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.908524] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92e0ab0c6c28a32c55549125","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92e0ab0c6c28a32c55549125: start","job_status":"start","queue_duration_s":1.546629,"scheduling_latency_s":1.546643} gitlab # [ 164.920235] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92e0ab0c6c28a32c55549125","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92e0ab0c6c28a32c55549125: done: 0.00973 sec","job_status":"done","queue_duration_s":1.546629,"scheduling_latency_s":1.546643,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00973,"completed_at":"2026-08-20T05:56:07.633Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 164.959493] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9231ec6738128c79b8f28b8b","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9231ec6738128c79b8f28b8b: start","job_status":"start","queue_duration_s":1.557431,"scheduling_latency_s":1.557446} gitlab # [ 164.964789] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9231ec6738128c79b8f28b8b","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9231ec6738128c79b8f28b8b: done: 0.009658 sec","job_status":"done","queue_duration_s":1.557431,"scheduling_latency_s":1.557446,"redis_calls":13,"redis_duration_s":0.0016229999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009658,"completed_at":"2026-08-20T05:56:07.644Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.010247] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8db55d3b79670f13a2c4a0c9","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8db55d3b79670f13a2c4a0c9: start","job_status":"start","queue_duration_s":1.568089,"scheduling_latency_s":1.568102} gitlab # [ 165.011043] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8db55d3b79670f13a2c4a0c9","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8db55d3b79670f13a2c4a0c9: done: 0.009546 sec","job_status":"done","queue_duration_s":1.568089,"scheduling_latency_s":1.568102,"redis_calls":13,"redis_duration_s":0.0015480000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009546,"completed_at":"2026-08-20T05:56:07.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.078302] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b244567479fda71b6782fe3a","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b244567479fda71b6782fe3a: start","job_status":"start","queue_duration_s":1.578625,"scheduling_latency_s":1.578639} gitlab # [ 165.079187] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b244567479fda71b6782fe3a","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b244567479fda71b6782fe3a: done: 0.00997 sec","job_status":"done","queue_duration_s":1.578625,"scheduling_latency_s":1.578639,"redis_calls":13,"redis_duration_s":0.0018119999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00997,"completed_at":"2026-08-20T05:56:07.665Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.090562] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1f10bd33018b1931273905f","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1f10bd33018b1931273905f: start","job_status":"start","queue_duration_s":1.589615,"scheduling_latency_s":1.58963} gitlab # [ 165.133368] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1f10bd33018b1931273905f","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1f10bd33018b1931273905f: done: 0.009697 sec","job_status":"done","queue_duration_s":1.589615,"scheduling_latency_s":1.58963,"redis_calls":13,"redis_duration_s":0.001678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009697,"completed_at":"2026-08-20T05:56:07.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.135579] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9592ed84011a65be77f363f8","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9592ed84011a65be77f363f8: start","job_status":"start","queue_duration_s":1.600145,"scheduling_latency_s":1.600158} gitlab # [ 165.176304] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9592ed84011a65be77f363f8","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9592ed84011a65be77f363f8: done: 0.009658 sec","job_status":"done","queue_duration_s":1.600145,"scheduling_latency_s":1.600158,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009658,"completed_at":"2026-08-20T05:56:07.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.180607] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0635759df1e1988e315a860","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0635759df1e1988e315a860: start","job_status":"start","queue_duration_s":1.61067,"scheduling_latency_s":1.610684} gitlab # [ 165.225153] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0635759df1e1988e315a860","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0635759df1e1988e315a860: done: 0.00985 sec","job_status":"done","queue_duration_s":1.61067,"scheduling_latency_s":1.610684,"redis_calls":13,"redis_duration_s":0.001646,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00985,"completed_at":"2026-08-20T05:56:07.697Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.226106] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12d2f6415ce877795523d442","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12d2f6415ce877795523d442: start","job_status":"start","queue_duration_s":1.621384,"scheduling_latency_s":1.621398} gitlab # [ 165.266657] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12d2f6415ce877795523d442","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12d2f6415ce877795523d442: done: 0.010175 sec","job_status":"done","queue_duration_s":1.621384,"scheduling_latency_s":1.621398,"redis_calls":13,"redis_duration_s":0.001641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010175,"completed_at":"2026-08-20T05:56:07.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.270580] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66d2c37cf3d673ea33ca3f51","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66d2c37cf3d673ea33ca3f51: start","job_status":"start","queue_duration_s":1.632406,"scheduling_latency_s":1.632419} gitlab # [ 165.281814] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66d2c37cf3d673ea33ca3f51","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66d2c37cf3d673ea33ca3f51: done: 0.009826 sec","job_status":"done","queue_duration_s":1.632406,"scheduling_latency_s":1.632419,"redis_calls":13,"redis_duration_s":0.001647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009826,"completed_at":"2026-08-20T05:56:07.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.340845] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea8828b52425921bbbe43f40","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea8828b52425921bbbe43f40: start","job_status":"start","queue_duration_s":1.643094,"scheduling_latency_s":1.643108} gitlab # [ 165.341628] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea8828b52425921bbbe43f40","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea8828b52425921bbbe43f40: done: 0.009734 sec","job_status":"done","queue_duration_s":1.643094,"scheduling_latency_s":1.643108,"redis_calls":13,"redis_duration_s":0.001745,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009734,"completed_at":"2026-08-20T05:56:07.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.385148] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e098681d805e07e9fbaccfc8","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e098681d805e07e9fbaccfc8: start","job_status":"start","queue_duration_s":1.653675,"scheduling_latency_s":1.653688} gitlab # [ 165.385849] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e098681d805e07e9fbaccfc8","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e098681d805e07e9fbaccfc8: done: 0.009859 sec","job_status":"done","queue_duration_s":1.653675,"scheduling_latency_s":1.653688,"redis_calls":13,"redis_duration_s":0.001807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001271,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009859,"completed_at":"2026-08-20T05:56:07.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.406974] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e04c491be9306fa17725786","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e04c491be9306fa17725786: start","job_status":"start","queue_duration_s":1.66457,"scheduling_latency_s":1.664583} gitlab # [ 165.450179] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e04c491be9306fa17725786","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e04c491be9306fa17725786: done: 0.009917 sec","job_status":"done","queue_duration_s":1.66457,"scheduling_latency_s":1.664583,"redis_calls":13,"redis_duration_s":0.0017209999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001196,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009917,"completed_at":"2026-08-20T05:56:07.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.488985] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f5b79f7a6f825ea2d752230","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f5b79f7a6f825ea2d752230: start","job_status":"start","queue_duration_s":1.675515,"scheduling_latency_s":1.675529} gitlab # [ 165.489745] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f5b79f7a6f825ea2d752230","created_at":"2026-08-20T05:56:05.838Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-b0889e0e4e0a4687","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2b7186246970ecbb051c46114216bde","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.077Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f5b79f7a6f825ea2d752230: done: 0.009656 sec","job_status":"done","queue_duration_s":1.675515,"scheduling_latency_s":1.675529,"redis_calls":13,"redis_duration_s":0.0016669999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009656,"completed_at":"2026-08-20T05:56:07.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.531126] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.763Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2ef5c1ef46e0fc9122b157d8","created_at":"2026-08-20T05:56:06.607Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-39dd1ee5393e43f5","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.616Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2ef5c1ef46e0fc9122b157d8: start","job_status":"start","queue_duration_s":1.147047,"scheduling_latency_s":1.147061} gitlab # [ 165.531827] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.775Z","message":"No existing merge request to be cleaned up."} gitlab # [ 165.532487] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.783Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2ef5c1ef46e0fc9122b157d8","created_at":"2026-08-20T05:56:06.607Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-39dd1ee5393e43f5","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.616Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2ef5c1ef46e0fc9122b157d8: done: 0.020155 sec","job_status":"done","queue_duration_s":1.147047,"scheduling_latency_s":1.147061,"redis_calls":13,"redis_duration_s":0.001885,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000829,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000258971,"duration_s":0.020155,"completed_at":"2026-08-20T05:56:07.783Z","load_balancing_strategy":"primary","db_duration_s":0.002694,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.573127] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.784Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1f55066795521f49c96c0a7d","created_at":"2026-08-20T05:56:06.607Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-39dd1ee5393e43f5","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.616Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1f55066795521f49c96c0a7d: start","job_status":"start","queue_duration_s":1.168098,"scheduling_latency_s":1.168111} gitlab # [ 165.573871] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.791Z","message":"No existing merge request to be cleaned up."} gitlab # [ 165.574666] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.796Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1f55066795521f49c96c0a7d","created_at":"2026-08-20T05:56:06.607Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-39dd1ee5393e43f5","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.616Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1f55066795521f49c96c0a7d: done: 0.011855 sec","job_status":"done","queue_duration_s":1.168098,"scheduling_latency_s":1.168111,"redis_calls":10,"redis_duration_s":0.001418,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011855,"completed_at":"2026-08-20T05:56:07.796Z","load_balancing_strategy":"primary","db_duration_s":0.001072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.589839] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.797Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"959a7cc50413387802c9a4fd","created_at":"2026-08-20T05:56:06.607Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-39dd1ee5393e43f5","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.616Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-959a7cc50413387802c9a4fd: start","job_status":"start","queue_duration_s":1.181057,"scheduling_latency_s":1.181071} gitlab # [ 165.634190] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.803Z","message":"No existing merge request to be cleaned up."} gitlab # [ 165.634907] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.808Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"959a7cc50413387802c9a4fd","created_at":"2026-08-20T05:56:06.607Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-39dd1ee5393e43f5","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.616Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-959a7cc50413387802c9a4fd: done: 0.011209 sec","job_status":"done","queue_duration_s":1.181057,"scheduling_latency_s":1.181071,"redis_calls":10,"redis_duration_s":0.001386,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000809,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011209,"completed_at":"2026-08-20T05:56:07.808Z","load_balancing_strategy":"primary","db_duration_s":0.001039,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.635955] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.809Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f1287317300b2d8f82b91199","created_at":"2026-08-20T05:56:06.607Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-39dd1ee5393e43f5","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.616Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f1287317300b2d8f82b91199: start","job_status":"start","queue_duration_s":1.193305,"scheduling_latency_s":1.193318} gitlab # [ 165.646553] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.816Z","message":"No existing merge request to be cleaned up."} gitlab # [ 165.648180] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:07.825Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f1287317300b2d8f82b91199","created_at":"2026-08-20T05:56:06.607Z","trace_propagation_headers":{"sentry-trace":"8e418af7cb1348d0b653e20b8b30624d-39dd1ee5393e43f5","baggage":"sentry-trace_id=8e418af7cb1348d0b653e20b8b30624d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559b2f2c18c7bdf39d620a7aee884f8f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:06.616Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"madc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f1287317300b2d8f82b91199: done: 0.015323 sec","job_status":"done","queue_duration_s":1.193305,"scheduling_latency_s":1.193318,"redis_calls":10,"redis_duration_s":0.0053690000000000005,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000838,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015323,"completed_at":"2026-08-20T05:56:07.824Z","load_balancing_strategy":"primary","db_duration_s":0.000992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 165.855530] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 3433884834 wd_nsec: 3433884722 gitlab # [ 167.630890] setup-gitlab-start[2268]: W, [2026-08-20T05:56:11.889255 #2268] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 190.940447] postgres[2480]: [2480] ERROR: relation "table_without_models" does not exist gitlab # [ 190.941413] postgres[2480]: [2480] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 193.894495] runuser[2267]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 193.896232] setup-gitlab-start[2245]: + systemctl restart gitlab-sidekiq.service gitlab # [ 193.919971] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 193.921628] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:38.179Z","message":"Shutting down"} gitlab # [ 193.922464] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:38.180Z","message":"Scheduler exiting..."} gitlab # [ 193.923161] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:38.180Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 193.925856] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:38.184Z","message":"Scheduler exiting..."} gitlab # [ 194.427216] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:38.685Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 198.933675] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:43.191Z","message":"Bye!"} gitlab # [ 198.964702] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-20T05:56:43.223Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1640,"worker_id":"sidekiq_0","memwd_rss_bytes":943652864,"retry":0} gitlab # [ 199.857772] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 199.858523] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 199.860198] systemd[1]: gitlab-sidekiq.service: Consumed 1min 687ms CPU time over 2min 3.337s wall clock time, 957M memory peak, 4.4M read from disk. gitlab # [ 199.869243] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 199.872604] setup-gitlab-start[2245]: + mkdir -p /var/lib/secrets gitlab # [ 199.875711] setup-gitlab-start[2245]: + echo nixbot-test-token-of-20-chars gitlab # [ 199.877131] setup-gitlab-start[2245]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 199.879735] setup-gitlab-start[2245]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 200.597550] gitaly[904]: time="2026-08-20T05:56:44.856Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:54.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:44.855" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.598131] gitaly[904]: time="2026-08-20T05:56:44.856Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:54.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:44.855" grpc.time_ms=0.528 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.690571] gitaly[904]: time="2026-08-20T05:56:44.949Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:54.098" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:44.948" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.691672] gitaly[904]: time="2026-08-20T05:56:44.950Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:54.098" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:44.948" grpc.time_ms=0.561 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.792728] gitaly[904]: time="2026-08-20T05:56:45.051Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F diskcache=e9bf6012-835a-4ef4-af23-6042fd04f2d7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:55.001" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.002" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.793665] gitaly[904]: time="2026-08-20T05:56:45.052Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1586 command.oublock=32 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:55.001" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.002" grpc.time_ms=49.054 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.813902] gitaly[904]: time="2026-08-20T05:56:45.073Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:55.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.072" pid=904 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 200.814603] gitaly[904]: time="2026-08-20T05:56:45.073Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:55.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.072" grpc.time_ms=0.412 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.835716] gitaly[904]: time="2026-08-20T05:56:45.094Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:55.077" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.078" grpc.time_ms=16.628 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.897875] gitaly[904]: time="2026-08-20T05:56:45.156Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:55.155" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.156" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.898961] gitaly[904]: time="2026-08-20T05:56:45.157Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:55.155" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.156" grpc.time_ms=0.429 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.968100] gitaly[904]: time="2026-08-20T05:56:45.227Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F diskcache=971cc677-dbd5-4751-8527-737b6ef11c30 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:55.185" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.186" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.968947] gitaly[904]: time="2026-08-20T05:56:45.227Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1579 command.oublock=32 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:56:55.185" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.186" grpc.time_ms=40.869 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.994364] gitaly[904]: time="2026-08-20T05:56:45.253Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:55.251" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.252" pid=904 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 200.994706] gitaly[904]: time="2026-08-20T05:56:45.253Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:55.251" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.252" grpc.time_ms=0.984 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.003833] gitaly[904]: time="2026-08-20T05:56:45.262Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:55.256" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.256" grpc.time_ms=5.815 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.029449] gitaly[904]: time="2026-08-20T05:56:45.288Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:56:55.287" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.288" grpc.time_ms=0.271 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.042999] gitaly[904]: time="2026-08-20T05:56:45.302Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:56:55.001" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.301" grpc.time_ms=0.288 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.611138] gitaly[904]: time="2026-08-20T05:56:45.869Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWHFXYXTJ1209FHA4001F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:55.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:45.858" grpc.time_ms=10.89 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.911929] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:46 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 2012 gitlab # [ 201.918957] setup-gitlab-start[2245]: + mkdir -p /tmp/test-flake gitlab # [ 201.923698] setup-gitlab-start[2245]: + cd /tmp/test-flake gitlab # [ 201.923919] setup-gitlab-start[2245]: + git init -b master gitlab # [ 201.951701] setup-gitlab-start[2578]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 201.952176] setup-gitlab-start[2245]: + git config user.name test gitlab # [ 201.960127] setup-gitlab-start[2245]: + git config user.email test@example.com gitlab # [ 201.966080] setup-gitlab-start[2245]: + cat gitlab # [ 201.969731] setup-gitlab-start[2245]: + git add flake.nix gitlab # [ 201.974454] setup-gitlab-start[2245]: + git commit -m 'initial commit' gitlab # [ 201.990649] setup-gitlab-start[2583]: [master (root-commit) 950df99] initial commit gitlab # [ 201.992989] setup-gitlab-start[2583]: 1 file changed, 10 insertions(+) gitlab # [ 201.993541] setup-gitlab-start[2583]: create mode 100644 flake.nix gitlab # [ 201.995054] setup-gitlab-start[2245]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 202.000489] setup-gitlab-start[2245]: + git push -u origin master gitlab # [ 202.082916] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:46 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 46 gitlab # [ 202.191666] gitaly[904]: time="2026-08-20T05:56:46.450Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKMBSNYSJCJCTN4WZB2N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:46.437" grpc.time_ms=13.067 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 202.218565] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:46 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 104 gitlab # [ 203.159707] sidekiq-cluster[2531]: {"severity":"INFO","time":"2026-08-20T05:56:47.400Z","message":"Starting cluster with 1 processes"} gitlab # [ 203.851669] gitaly[904]: time="2026-08-20T05:56:48.110Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:58.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:48.101" grpc.time_ms=8.203 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 203.930328] gitaly[904]: time="2026-08-20T05:56:48.189Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:57:18.076" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:56:48.176" grpc.time_ms=12.177 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 203.970437] gitaly[904]: time="2026-08-20T05:56:48.229Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 duration_ms="1.598µs" method=POST pid=904 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 203.999404] gitaly[904]: time="2026-08-20T05:56:48.258Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 duration_ms=28ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 204.000272] gitaly[904]: time="2026-08-20T05:56:48.259Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:46.630" grpc.time_ms=1628.769 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 204.052162] gitaly[904]: time="2026-08-20T05:56:48.311Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:48.310" grpc.time_ms=0.607 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 204.093507] gitaly[904]: time="2026-08-20T05:56:48.352Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:48.352" grpc.time_ms=0.441 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 204.129433] gitaly[904]: time="2026-08-20T05:56:48.388Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:48.386" grpc.time_ms=1.386 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 204.248904] gitaly[904]: time="2026-08-20T05:56:48.507Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:56:58.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:48.498" grpc.time_ms=9.139 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.285854] gitaly[904]: time="2026-08-20T05:56:48.544Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1563 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:56:58.034" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:48.525" grpc.time_ms=19.612 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.306446] gitaly[904]: time="2026-08-20T05:56:48.565Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 duration_ms=150ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 204.309354] gitaly[904]: time="2026-08-20T05:56:48.568Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:48.414" grpc.time_ms=154.349 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 204.331570] gitaly[904]: time="2026-08-20T05:56:48.590Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 diskcache=54c71bb0-6148-49b7-b09d-59d7c9966b0a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:46.556" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 204.331873] gitaly[904]: time="2026-08-20T05:56:48.591Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=242 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13556 command.oublock=32 command.real_time_ms=2025 command.spawn_token_fork_ms=0 command.system_time_ms=158 command.user_time_ms=84 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:46.556" grpc.time_ms=2033.85 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 204.333170] gitlab-workhorse[825]: time="2026-08-20T05:56:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 204.333847] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:48 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 2105 gitlab # [ 204.335932] setup-gitlab-start[2587]: To http://gitlab/root/test-flake.git gitlab # [ 204.336588] setup-gitlab-start[2587]: * [new branch] master -> master gitlab # [ 204.355762] setup-gitlab-start[2587]: branch 'master' set up to track 'origin/master'. gitlab # [ 204.359242] systemd[1]: Finished setup-gitlab.service. gitlab # [ 204.363042] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 205.56 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 205.443614] nixbot[2684]: {"ts": "2026-08-20T05:56:49.701Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 205.474128] nixbot[2684]: {"ts": "2026-08-20T05:56:49.733Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 205.502964] nixbot[2684]: {"ts": "2026-08-20T05:56:49.761Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 205.508215] nixbot[2684]: {"ts": "2026-08-20T05:56:49.767Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 205.514506] nixbot[2684]: {"ts": "2026-08-20T05:56:49.773Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 205.521839] nixbot[2684]: {"ts": "2026-08-20T05:56:49.780Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 205.525675] nixbot[2684]: {"ts": "2026-08-20T05:56:49.784Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 205.530339] nixbot[2684]: {"ts": "2026-08-20T05:56:49.789Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 205.539243] nixbot[2684]: {"ts": "2026-08-20T05:56:49.798Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 205.543654] nixbot[2684]: {"ts": "2026-08-20T05:56:49.802Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 205.550386] nixbot[2684]: {"ts": "2026-08-20T05:56:49.809Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 205.558857] nixbot[2684]: {"ts": "2026-08-20T05:56:49.817Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 205.566378] nixbot[2684]: {"ts": "2026-08-20T05:56:49.825Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 205.570683] nixbot[2684]: {"ts": "2026-08-20T05:56:49.829Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 205.575938] nixbot[2684]: {"ts": "2026-08-20T05:56:49.834Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 205.579833] nixbot[2684]: {"ts": "2026-08-20T05:56:49.838Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 205.583723] nixbot[2684]: {"ts": "2026-08-20T05:56:49.842Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 205.587239] nixbot[2684]: {"ts": "2026-08-20T05:56:49.846Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 205.593269] nixbot[2684]: {"ts": "2026-08-20T05:56:49.852Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 205.596944] nixbot[2684]: {"ts": "2026-08-20T05:56:49.855Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 205.600689] nixbot[2684]: {"ts": "2026-08-20T05:56:49.859Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 205.607883] nixbot[2684]: {"ts": "2026-08-20T05:56:49.866Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 205.612456] nixbot[2684]: {"ts": "2026-08-20T05:56:49.871Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 205.616567] nixbot[2684]: {"ts": "2026-08-20T05:56:49.875Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 205.619967] nixbot[2684]: {"ts": "2026-08-20T05:56:49.878Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 205.924722] nixbot[2684]: INFO: Started server process [2684] gitlab # [ 205.927287] nixbot[2684]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 205.941496] nixbot[2684]: INFO: ::ffff:127.0.0.1:54832 - "GET /health HTTP/1.1" 200 OK gitlab # [ 205.948245] systemd[1]: Started nixbot CI service. gitlab # [ 205.951394] systemd[1]: Reached target Multi-User System. gitlab # [ 205.953458] systemd[1]: Startup finished in 1.199s (kernel) + 3.599s (initrd) + 3min 21.154s (userspace) = 3min 25.953s. gitlab: (finished: waiting for unit nixbot.service, in 1.06 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 206.029777] nixbot[2684]: INFO: ::ffff:127.0.0.1:54844 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 206.109160] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 50 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds) gitlab # [ 206.646875] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:50 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 703 gitlab # [ 206.647480] nixbot[2684]: {"ts": "2026-08-20T05:56:50.904Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 206.662756] nixbot[2684]: {"ts": "2026-08-20T05:56:50.921Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 206.747393] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 76 gitlab # [ 206.752296] nixbot[2684]: {"ts": "2026-08-20T05:56:51.007Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 206.757292] nixbot[2684]: {"ts": "2026-08-20T05:56:51.008Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 206.885210] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 133 gitlab # [ 206.890159] nixbot[2684]: {"ts": "2026-08-20T05:56:51.145Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 206.999123] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 107 gitlab # [ 206.999947] nixbot[2684]: {"ts": "2026-08-20T05:56:51.258Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 207.044413] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 36 gitlab # [ 207.050184] nixbot[2684]: {"ts": "2026-08-20T05:56:51.309Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 207.173527] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 112 gitlab # [ 207.178754] nixbot[2684]: {"ts": "2026-08-20T05:56:51.437Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 207.183974] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 39 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds) (finished: subtest: project discovered and webhook registered, in 1.16 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 207.239876] gitaly[904]: time="2026-08-20T05:56:51.498Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRKWT0WN5P6SZ0MF6TE5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T05:57:21.090" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:51.490" grpc.time_ms=7.771 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.249249] gitaly[904]: time="2026-08-20T05:56:51.508Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRKWT0WN5P6SZ0MF6TE5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:21.107" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:51.507" grpc.time_ms=0.423 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.258163] gitaly[904]: time="2026-08-20T05:56:51.517Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRKWT0WN5P6SZ0MF6TE5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T05:57:01.211" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:51.511" grpc.time_ms=5.28 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.280883] nixbot[2684]: {"ts": "2026-08-20T05:56:51.539Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 207.286068] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 92 gitlab # [ 207.294158] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 70 gitlab # [ 207.341095] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 54 gitlab # [ 207.345238] nixbot[2684]: {"ts": "2026-08-20T05:56:51.604Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 207.353700] nixbot[2684]: {"ts": "2026-08-20T05:56:51.612Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 207.380781] gitaly[904]: time="2026-08-20T05:56:51.639Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRQ35TPZDJ3EPFKGWY88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:51.631" grpc.time_ms=8.273 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.393352] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 96 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 207.452272] gitaly[904]: time="2026-08-20T05:56:51.711Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF5GRRC2Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:51.701" grpc.time_ms=10.041 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 207.454382] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 44 gitlab # [ 207.530690] gitaly[904]: time="2026-08-20T05:56:51.789Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRW3SPXKFFR5W44A6A4P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:51.781" pid=904 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 207.531662] gitaly[904]: time="2026-08-20T05:56:51.789Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRW3SPXKFFR5W44A6A4P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:51.781" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 207.532554] gitaly[904]: time="2026-08-20T05:56:51.791Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRW3SPXKFFR5W44A6A4P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:51.781" grpc.time_ms=8.99 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 207.533547] gitlab-workhorse[825]: time="2026-08-20T05:56:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 207.534468] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 76 gitlab # [ 207.571607] gitaly[904]: time="2026-08-20T05:56:51.830Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:57:21.724" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:56:51.824" grpc.time_ms=6.062 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 207.581093] gitaly[904]: time="2026-08-20T05:56:51.840Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK duration_ms=64ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 207.601077] gitaly[904]: time="2026-08-20T05:56:51.859Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK duration_ms=18ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 207.601406] gitaly[904]: time="2026-08-20T05:56:51.860Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:51.775" grpc.time_ms=84.394 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.636122] gitaly[904]: time="2026-08-20T05:56:51.895Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:51.892" grpc.time_ms=0.656 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.668660] gitaly[904]: time="2026-08-20T05:56:51.927Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:51.927" grpc.time_ms=0.418 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.698894] gitaly[904]: time="2026-08-20T05:56:51.958Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:51.957" grpc.time_ms=0.592 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.756937] gitaly[904]: time="2026-08-20T05:56:52.015Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRYKGGH4CBPJVCH5FHTE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.001" pid=904 remote_ip="2001:db8:1::1" request_sha=e6350898f182674e4b41aee4d086f2dbb8346d47 response_bytes=223 span.kind=server system=grpc gitlab # [ 207.757509] gitaly[904]: time="2026-08-20T05:56:52.015Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRYKGGH4CBPJVCH5FHTE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.001" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 207.758192] gitaly[904]: time="2026-08-20T05:56:52.016Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRYKGGH4CBPJVCH5FHTE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.001" grpc.time_ms=13.994 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 207.770349] gitaly[904]: time="2026-08-20T05:56:52.029Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK duration_ms=38ns method=POST pid=904 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 207.771021] gitaly[904]: time="2026-08-20T05:56:52.029Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:51.990" grpc.time_ms=38.897 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.798639] gitlab-workhorse[825]: time="2026-08-20T05:56:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 207.803160] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 261 gitlab # [ 207.810530] gitaly[904]: time="2026-08-20T05:56:52.069Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK diskcache=f10a060d-a26c-496b-9524-394922c9a9c0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:51.727" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.819389] gitaly[904]: time="2026-08-20T05:56:52.078Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=152 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=901120 command.minflt=13524 command.oublock=32 command.real_time_ms=332 command.spawn_token_fork_ms=1 command.system_time_ms=94 command.user_time_ms=58 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:51.727" grpc.time_ms=342.308 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 207.820233] gitlab-workhorse[825]: time="2026-08-20T05:56:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 207.821230] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:52 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 411 gitlab # To http://gitlab/root/test-flake.git gitlab # 950df99..4eefe3a master -> master gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.66 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 207.896694] gitaly[904]: time="2026-08-20T05:56:52.155Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWS8EECRJMWPEPEVX80SD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.149" grpc.time_ms=6.571 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 207.908538] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 56 gitlab # [ 207.918051] nixbot[2684]: INFO: ::ffff:127.0.0.1:54858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.07 seconds) gitlab # [ 207.972294] gitaly[904]: time="2026-08-20T05:56:52.231Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSAAMD64FS44Y3RGF5RC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.222" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 207.990759] gitaly[904]: time="2026-08-20T05:56:52.231Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSAAMD64FS44Y3RGF5RC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.222" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 208.007632] gitaly[904]: time="2026-08-20T05:56:52.266Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSAAMD64FS44Y3RGF5RC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.222" grpc.time_ms=44.264 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 208.008423] gitlab-workhorse[825]: time="2026-08-20T05:56:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 208.009688] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 97 gitlab # [ 208.066869] gitaly[904]: time="2026-08-20T05:56:52.325Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSDE43B5FSGH744ZQ0SZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.310" pid=904 remote_ip="2001:db8:1::1" request_sha=28d5165bcca1451be83154207f6a923c9920a24a response_bytes=337 span.kind=server system=grpc gitlab # [ 208.067951] gitaly[904]: time="2026-08-20T05:56:52.325Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSDE43B5FSGH744ZQ0SZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.310" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 208.086276] gitaly[904]: time="2026-08-20T05:56:52.345Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSDE43B5FSGH744ZQ0SZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.310" grpc.time_ms=15.701 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 208.086607] gitlab-workhorse[825]: time="2026-08-20T05:56:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=337 gitlab # [ 208.087241] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 75 gitlab # [ 208.184698] gitaly[904]: time="2026-08-20T05:56:52.443Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSH78Z847M527GB4PTMG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.430" grpc.time_ms=12.965 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 208.207402] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 74 gitlab # [ 208.273076] gitaly[904]: time="2026-08-20T05:56:52.531Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSKNFKJZBW43WFDVPJ3K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.510" pid=904 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 208.273350] gitaly[904]: time="2026-08-20T05:56:52.532Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSKNFKJZBW43WFDVPJ3K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.510" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 208.314166] gitaly[904]: time="2026-08-20T05:56:52.573Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1165 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSKNFKJZBW43WFDVPJ3K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:56:52.510" grpc.time_ms=62.473 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 208.316140] gitlab-workhorse[825]: time="2026-08-20T05:56:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 208.316834] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 105 gitlab # [ 208.406955] gitaly[904]: time="2026-08-20T05:56:52.665Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:22.264" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:52.664" grpc.time_ms=0.857 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.474624] gitaly[904]: time="2026-08-20T05:56:52.733Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:57:22.320" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:52.720" grpc.time_ms=12.753 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.493878] gitaly[904]: time="2026-08-20T05:56:52.752Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:02.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:52.745" grpc.time_ms=7.273 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.509487] gitaly[904]: time="2026-08-20T05:56:52.768Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:02.022" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:52.763" grpc.time_ms=5.385 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.566607] gitaly[904]: time="2026-08-20T05:56:52.825Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:57:02.084" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:52.825" grpc.time_ms=0.422 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.599405] gitaly[904]: time="2026-08-20T05:56:52.858Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:02.001" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:52.851" grpc.time_ms=6.231 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.663054] gitaly[904]: time="2026-08-20T05:56:52.921Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:52.920" grpc.time_ms=1.233 pid=904 span.kind=server system=grpc gitlab # [ 208.703267] gitaly[904]: time="2026-08-20T05:56:52.962Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:56:52.961" grpc.time_ms=0.743 pid=904 span.kind=server system=grpc gitlab # [ 208.727101] gitaly[904]: time="2026-08-20T05:56:52.986Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY diskcache=0a8bd55d-45ed-489f-8086-23b396f1e3f3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:02.025" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:52.876" pid=904 ref=refs/keep-around/950df999c2932efef32784867bbefaeb4719dc34 remote_ip="2001:db8:1::1" revision=950df999c2932efef32784867bbefaeb4719dc34 span.kind=server system=grpc username=root gitlab # [ 208.727440] gitaly[904]: time="2026-08-20T05:56:52.986Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=108 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5151 command.oublock=8 command.real_time_ms=102 command.spawn_token_fork_ms=0 command.system_time_ms=80 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:02.025" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:56:52.876" grpc.time_ms=109.86 pid=904 ref=refs/keep-around/950df999c2932efef32784867bbefaeb4719dc34 remote_ip="2001:db8:1::1" revision=950df999c2932efef32784867bbefaeb4719dc34 span.kind=server system=grpc username=root gitlab # [ 208.731191] gitaly[904]: time="2026-08-20T05:56:52.990Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:22.589" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:52.989" grpc.time_ms=0.396 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 208.850876] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 491 gitlab # [ 208.857698] nixbot[2684]: {"ts": "2026-08-20T05:56:53.116Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 \"HTTP/1.1 201 Created\""} gitlab # [ 208.872394] nixbot[2684]: {"ts": "2026-08-20T05:56:53.131Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-950df999c293-0"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 208.947449] systemd[1]: Started Nix Daemon. gitlab # [ 208.951916] nixbot[2684]: INFO: ::ffff:127.0.0.1:54864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.03 seconds) gitlab # [ 208.998857] nix-daemon[2895]: accepted connection from pid 2886, user nixbot gitlab # [ 209.075725] nix-daemon[2895]: accepted connection from pid 2902, user nixbot gitlab # [ 209.091052] nixbot[2684]: {"ts": "2026-08-20T05:56:53.350Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-950df999c293-0", "argv0": "bwrap"} gitlab # [ 209.204672] nix-daemon[2895]: accepted connection from pid 2912, user nixbot gitlab # [ 209.293881] nix-daemon[2895]: accepted connection from pid 2922, user nixbot gitlab # [ 209.315520] nix-daemon[2895]: accepted connection from pid 2912, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 209.991974] nixbot[2684]: INFO: ::ffff:127.0.0.1:54874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 211.028780] nixbot[2684]: INFO: ::ffff:127.0.0.1:54882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 212.068547] nixbot[2684]: INFO: ::ffff:127.0.0.1:54898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 213.106670] nixbot[2684]: INFO: ::ffff:127.0.0.1:45690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab # [ 213.532283] nix-daemon[2895]: accepted connection from pid 2951, user nixbot gitlab # [ 213.565630] gitaly[904]: time="2026-08-20T05:56:57.824Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWYS9TZHBK6G5150N1G8A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:27.422" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:57.823" grpc.time_ms=0.817 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.595308] gitaly[904]: time="2026-08-20T05:56:57.854Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWYS9TZHBK6G5150N1G8A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:07.103" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:57.843" grpc.time_ms=10.123 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.633059] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 121 gitlab # [ 213.634986] nixbot[2684]: {"ts": "2026-08-20T05:56:57.893Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 \"HTTP/1.1 201 Created\""} gitlab # [ 213.680050] gitaly[904]: time="2026-08-20T05:56:57.939Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWYXDF8H232A0BTZKJP90 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:27.537" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:56:57.938" grpc.time_ms=0.617 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.708331] gitaly[904]: time="2026-08-20T05:56:57.967Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWYXDF8H232A0BTZKJP90 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:07.109" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:56:57.959" grpc.time_ms=7.443 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 213.745935] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:56:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 103 gitlab # [ 213.746859] nixbot[2684]: {"ts": "2026-08-20T05:56:58.005Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 214.147951] nixbot[2684]: INFO: ::ffff:127.0.0.1:45704 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 215.186583] nixbot[2684]: INFO: ::ffff:127.0.0.1:45708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 216.225713] nixbot[2684]: INFO: ::ffff:127.0.0.1:45722 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 217.264607] nixbot[2684]: INFO: ::ffff:127.0.0.1:45730 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 218.302951] nixbot[2684]: INFO: ::ffff:127.0.0.1:45732 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab # [ 218.512992] nix-daemon[2895]: accepted connection from pid 2995, user nixbot gitlab # [ 218.599495] gitaly[904]: time="2026-08-20T05:57:02.857Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX3PD4S55PYWKP16BQY9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:57:32.756" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:02.856" grpc.time_ms=0.696 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 218.724324] gitaly[904]: time="2026-08-20T05:57:02.983Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVX3PD4S55PYWKP16BQY9D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:12.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:02.972" grpc.time_ms=10.438 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 218.842074] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 302 gitlab # [ 218.843188] nixbot[2684]: {"ts": "2026-08-20T05:57:03.102Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 \"HTTP/1.1 201 Created\""} gitlab # [ 218.930587] nix-daemon[2895]: accepted connection from pid 3010, user nixbot gitlab # [ 219.053426] gitaly[904]: time="2026-08-20T05:57:03.312Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVX44C27JJS4S6E0PSHB8W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:03.300" grpc.time_ms=11.507 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 219.083794] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:03 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 98 gitlab # [ 219.149041] gitaly[904]: time="2026-08-20T05:57:03.408Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX47GX5HZ28F7CDPJKCTW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:03.394" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 219.149334] gitaly[904]: time="2026-08-20T05:57:03.408Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX47GX5HZ28F7CDPJKCTW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:03.394" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 219.149988] gitaly[904]: time="2026-08-20T05:57:03.408Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVX47GX5HZ28F7CDPJKCTW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:03.394" grpc.time_ms=14.35 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 219.151059] gitlab-workhorse[825]: time="2026-08-20T05:57:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 219.151685] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 65 gitlab # [ 219.283454] nix-daemon[2895]: accepted connection from pid 3035, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 219.334276] nixbot[2684]: INFO: ::ffff:127.0.0.1:45742 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 220.372651] nixbot[2684]: INFO: ::ffff:127.0.0.1:45750 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 221.411767] nixbot[2684]: INFO: ::ffff:127.0.0.1:45766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 222.449654] nixbot[2684]: INFO: ::ffff:127.0.0.1:45780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 223.486853] nixbot[2684]: INFO: ::ffff:127.0.0.1:51588 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 224.523832] nixbot[2684]: INFO: ::ffff:127.0.0.1:51594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 225.561816] nixbot[2684]: INFO: ::ffff:127.0.0.1:51608 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 226.599323] nixbot[2684]: INFO: ::ffff:127.0.0.1:51614 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.02 seconds) gitlab # [ 227.627808] nixbot[2684]: INFO: ::ffff:127.0.0.1:51618 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 228.662410] nixbot[2684]: INFO: ::ffff:127.0.0.1:51634 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.03 seconds) gitlab # [ 229.699130] nixbot[2684]: INFO: ::ffff:127.0.0.1:51640 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab # [ 229.783226] sidekiq-cluster[2621]: 2026-08-20T05:57:14.041Z pid=2621 tid=xat INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2621, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432603136} gitlab # [ 229.960460] sidekiq-cluster[2621]: W, [2026-08-20T05:57:14.219195 #2621] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 230.000239] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:14.259Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.03 seconds) gitlab # [ 230.734307] nixbot[2684]: INFO: ::ffff:127.0.0.1:51642 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.03 seconds) gitlab # [ 231.768408] nixbot[2684]: INFO: ::ffff:127.0.0.1:51646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab # [ 231.885665] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:16.143Z","message":"GitLab reliable fetch activated!"} gitlab # [ 231.886415] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:16.144Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 232.802919] nixbot[2684]: INFO: ::ffff:127.0.0.1:51660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 233.841392] nixbot[2684]: INFO: ::ffff:127.0.0.1:46948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 234.879610] nixbot[2684]: INFO: ::ffff:127.0.0.1:46964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 235.918211] nixbot[2684]: INFO: ::ffff:127.0.0.1:46978 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.03 seconds) gitlab # [ 236.953873] nixbot[2684]: INFO: ::ffff:127.0.0.1:46984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 237.988787] nixbot[2684]: INFO: ::ffff:127.0.0.1:46994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 239.026451] nixbot[2684]: INFO: ::ffff:127.0.0.1:47006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 240.062727] nixbot[2684]: INFO: ::ffff:127.0.0.1:47016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 241.100931] nixbot[2684]: INFO: ::ffff:127.0.0.1:47032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 242.137719] nixbot[2684]: INFO: ::ffff:127.0.0.1:47044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 243.174693] nixbot[2684]: INFO: ::ffff:127.0.0.1:43358 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 244.211864] nixbot[2684]: INFO: ::ffff:127.0.0.1:43366 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 245.248789] nixbot[2684]: INFO: ::ffff:127.0.0.1:43380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 246.289721] nixbot[2684]: INFO: ::ffff:127.0.0.1:43382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 247.329828] nixbot[2684]: INFO: ::ffff:127.0.0.1:43398 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 248.370597] nixbot[2684]: INFO: ::ffff:127.0.0.1:43414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 249.409230] nixbot[2684]: INFO: ::ffff:127.0.0.1:43430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 250.446481] nixbot[2684]: INFO: ::ffff:127.0.0.1:43438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 251.486719] nixbot[2684]: INFO: ::ffff:127.0.0.1:43440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab # [ 252.527236] nixbot[2684]: INFO: ::ffff:127.0.0.1:43452 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab # [ 253.174527] postgres[3157]: [3157] ERROR: relation "table_without_models" does not exist gitlab # [ 253.174972] postgres[3157]: [3157] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 253.563686] nixbot[2684]: INFO: ::ffff:127.0.0.1:49802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 254.598982] nixbot[2684]: INFO: ::ffff:127.0.0.1:49814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 255.634177] nixbot[2684]: INFO: ::ffff:127.0.0.1:49820 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.03 seconds) gitlab # [ 255.780052] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:40.038Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 255.782413] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:40.040Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 255.784142] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:40.041Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 255.785741] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:40.041Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 255.787492] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:40.043Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 256.670641] nixbot[2684]: INFO: ::ffff:127.0.0.1:49832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab # [ 257.365707] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:41.623Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2434e5a125adffe73a1f6e9b","created_at":"2026-08-20T05:56:45.114Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.140Z","job_size_bytes":2,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2434e5a125adffe73a1f6e9b: start","job_status":"start","queue_duration_s":56.483368,"scheduling_latency_s":56.48344} gitlab # [ 257.595822] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:41.854Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2434e5a125adffe73a1f6e9b","created_at":"2026-08-20T05:56:45.114Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.140Z","job_size_bytes":2,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2434e5a125adffe73a1f6e9b: done: 0.231376 sec","job_status":"done","queue_duration_s":56.483368,"scheduling_latency_s":56.48344,"redis_calls":24,"redis_duration_s":0.008050999999999999,"redis_read_bytes":1038,"redis_write_bytes":2604,"redis_feature_flag_calls":14,"redis_feature_flag_duration_s":0.004827,"redis_feature_flag_read_bytes":1030,"redis_feature_flag_write_bytes":1439,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001762,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001462,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.094016977,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.231376,"completed_at":"2026-08-20T05:57:41.854Z","load_balancing_strategy":"primary","db_duration_s":0.06131,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.597609] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:41.856Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"96ea0c6e486c1303b3761278","created_at":"2026-08-20T05:56:45.148Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.152Z","job_size_bytes":2,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-96ea0c6e486c1303b3761278: start","job_status":"start","queue_duration_s":56.703817,"scheduling_latency_s":56.703833} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 257.678856] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:41.937Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"96ea0c6e486c1303b3761278","created_at":"2026-08-20T05:56:45.148Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.152Z","job_size_bytes":2,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-96ea0c6e486c1303b3761278: done: 0.081417 sec","job_status":"done","queue_duration_s":56.703817,"scheduling_latency_s":56.703833,"redis_calls":14,"redis_duration_s":0.003338,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000701,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001551,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06386062999999999,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.081417,"completed_at":"2026-08-20T05:57:41.937Z","load_balancing_strategy":"primary","db_duration_s":0.024355,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.680076] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:41.939Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"00652ea78ddd3b81ffd86db6","created_at":"2026-08-20T05:56:45.715Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.720Z","job_size_bytes":5,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-00652ea78ddd3b81ffd86db6: start","job_status":"start","queue_duration_s":56.218389,"scheduling_latency_s":56.218405} gitlab # [ 257.756694] nixbot[2684]: INFO: ::ffff:127.0.0.1:49836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.08 seconds) gitlab # [ 257.809077] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:42.067Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"00652ea78ddd3b81ffd86db6","created_at":"2026-08-20T05:56:45.715Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.720Z","job_size_bytes":5,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-00652ea78ddd3b81ffd86db6: done: 0.1288 sec","job_status":"done","queue_duration_s":56.218389,"scheduling_latency_s":56.218405,"redis_calls":12,"redis_duration_s":0.002978,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000683,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001842,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000375187,"duration_s":0.1288,"completed_at":"2026-08-20T05:57:42.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028826,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.810738] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:42.069Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"4d77b39d2ce4c8382ef799f3","created_at":"2026-08-20T05:56:45.742Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.746Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-4d77b39d2ce4c8382ef799f3: start","job_status":"start","queue_duration_s":56.323147,"scheduling_latency_s":56.323188} gitlab # [ 258.012129] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:42.270Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"4d77b39d2ce4c8382ef799f3","created_at":"2026-08-20T05:56:45.742Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.746Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-4d77b39d2ce4c8382ef799f3: done: 0.201462 sec","job_status":"done","queue_duration_s":56.323147,"scheduling_latency_s":56.323188,"redis_calls":11,"redis_duration_s":0.0029370000000000004,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000688,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.172,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.172,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.124508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000433016,"duration_s":0.201462,"completed_at":"2026-08-20T05:57:42.270Z","load_balancing_strategy":"primary","db_duration_s":0.077626,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.013526] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:42.272Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"4b8dbc920ce03747dbf87e98","created_at":"2026-08-20T05:56:45.748Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.755Z","job_size_bytes":89,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-4b8dbc920ce03747dbf87e98: start","job_status":"start","queue_duration_s":56.516324,"scheduling_latency_s":56.51634} gitlab # [ 258.095942] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:42.300Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"4b8dbc920ce03747dbf87e98","created_at":"2026-08-20T05:56:45.748Z","trace_propagation_headers":{"sentry-trace":"83c16090eebd40eda2000b5a9ab60fa3-cea173a1ea784be6","baggage":"sentry-trace_id=83c16090eebd40eda2000b5a9ab60fa3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWHFXYXTJ1209FHA4001F","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:45.755Z","job_size_bytes":89,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-4b8dbc920ce03747dbf87e98: done: 0.028436 sec","job_status":"done","queue_duration_s":56.516324,"scheduling_latency_s":56.51634,"redis_calls":11,"redis_duration_s":0.002378,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000654,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000360381,"duration_s":0.028436,"completed_at":"2026-08-20T05:57:42.300Z","load_balancing_strategy":"primary","db_duration_s":0.006054,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.100190] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:42.301Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 950df999c2932efef32784867bbefaeb4719dc34 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9fcfe4f3c1c7c0dda2feb207","created_at":"2026-08-20T05:56:48.445Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-10616d70ac3d4047","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:48.467Z","job_size_bytes":185,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9fcfe4f3c1c7c0dda2feb207: start","job_status":"start","queue_duration_s":53.834686,"scheduling_latency_s":53.8347} gitlab # [ 258.115155] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:42.313Z","message":"changes: \"0000000000000000000000000000000000000000 950df999c2932efef32784867bbefaeb4719dc34 refs/heads/master\\n\""} gitlab # [ 258.117956] gitaly[904]: time="2026-08-20T05:57:42.345Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:52.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:42.335" grpc.time_ms=9.28 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.161838] gitaly[904]: time="2026-08-20T05:57:42.358Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:57:52.018" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:42.349" grpc.time_ms=8.629 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.181470] gitaly[904]: time="2026-08-20T05:57:42.440Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=41 command.spawn_token_fork_ms=38 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:57:52.065" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:42.395" grpc.time_ms=44.912 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.214120] gitaly[904]: time="2026-08-20T05:57:42.473Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:42.472" grpc.time_ms=0.345 pid=904 span.kind=server system=grpc gitlab # [ 258.243213] gitaly[904]: time="2026-08-20T05:57:42.502Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:42.500" grpc.time_ms=1.475 pid=904 span.kind=server system=grpc gitlab # [ 258.262827] gitaly[904]: time="2026-08-20T05:57:42.521Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 diskcache=4a1f8f74-b710-45b1-9dd1-a7665fc966fc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:52.121" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:42.451" pid=904 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 258.263763] gitaly[904]: time="2026-08-20T05:57:42.522Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=57 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5173 command.oublock=8 command.real_time_ms=62 command.spawn_token_fork_ms=0 command.system_time_ms=41 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:52.121" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:42.451" grpc.time_ms=69.925 pid=904 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 258.274275] gitaly[904]: time="2026-08-20T05:57:42.533Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:57:52.202" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:42.533" grpc.time_ms=0.16 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.306889] gitaly[904]: time="2026-08-20T05:57:42.566Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=937 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:57:52.222" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:42.553" grpc.time_ms=12.724 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.386229] gitaly[904]: time="2026-08-20T05:57:42.645Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T05:58:12.038" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:42.638" grpc.time_ms=6.161 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.457279] gitaly[904]: time="2026-08-20T05:57:42.716Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:57:52.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:42.715" grpc.time_ms=0.381 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.478772] gitaly[904]: time="2026-08-20T05:57:42.727Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:57:52.008" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:57:42.718" grpc.time_ms=7.988 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.495466] gitaly[904]: time="2026-08-20T05:57:42.754Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:52.033" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:42.743" grpc.time_ms=10.942 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.535201] gitaly[904]: time="2026-08-20T05:57:42.794Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:52.074" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:42.784" grpc.time_ms=9.754 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.566589] gitaly[904]: time="2026-08-20T05:57:42.825Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:58:12.211" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:42.811" grpc.time_ms=13.851 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 258.787925] nixbot[2684]: INFO: ::ffff:127.0.0.1:49850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.03 seconds) gitlab # [ 259.055519] gitaly[904]: time="2026-08-20T05:57:43.314Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:57:53.001" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:43.312" grpc.time_ms=1.777 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.084071] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:43.341Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 950df999c2932efef32784867bbefaeb4719dc34 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9fcfe4f3c1c7c0dda2feb207","created_at":"2026-08-20T05:56:48.445Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-10616d70ac3d4047","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:48.467Z","job_size_bytes":185,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9fcfe4f3c1c7c0dda2feb207: done: 1.039917 sec","job_status":"done","queue_duration_s":53.834686,"scheduling_latency_s":53.8347,"gitaly_calls":13,"gitaly_duration_s":0.306203,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.043211,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.003626,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006936,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.00164,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004505,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.014242,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.012262,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.197,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.228,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.61191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000441397,"exclusive_lock_hold_duration_s":0.024982226,"duration_s":1.039917,"completed_at":"2026-08-20T05:57:43.341Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.101387,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.125388] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:43.344Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","950df999c2932efef32784867bbefaeb4719dc34 4eefe3a5d973311e706734a427b5e7ae88bcd95f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2dc1377139d00f84366b0d29","created_at":"2026-08-20T05:56:52.014Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-2b0afc2a950d4509","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:52.017Z","job_size_bytes":185,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2dc1377139d00f84366b0d29: start","job_status":"start","queue_duration_s":51.327453,"scheduling_latency_s":51.327486} gitlab # [ 259.126233] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:43.361Z","message":"changes: \"950df999c2932efef32784867bbefaeb4719dc34 4eefe3a5d973311e706734a427b5e7ae88bcd95f refs/heads/master\\n\""} gitlab # [ 259.174813] gitaly[904]: time="2026-08-20T05:57:43.433Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:53.092" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:43.423" grpc.time_ms=9.767 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.201558] gitaly[904]: time="2026-08-20T05:57:43.460Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:57:53.119" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:43.449" grpc.time_ms=10.668 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.218235] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:43.476Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b619a1bc1937d6520e5ddd95","created_at":"2026-08-20T05:57:43.474Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-847d90d3a1894e65","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"589e5fbf370fe80cb528bcdb","job_size_bytes":46,"pid":2621,"job_status":"deduplicated","message":"ProjectCacheWorker JID-b619a1bc1937d6520e5ddd95: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 259.243178] gitaly[904]: time="2026-08-20T05:57:43.502Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:57:53.162" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:43.492" grpc.time_ms=9.303 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.273896] gitaly[904]: time="2026-08-20T05:57:43.532Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T05:58:13.018" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:43.519" grpc.time_ms=13.695 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.294068] gitaly[904]: time="2026-08-20T05:57:43.553Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:57:53.215" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:57:43.546" grpc.time_ms=6.932 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.319412] gitaly[904]: time="2026-08-20T05:57:43.578Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:53.236" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:43.566" grpc.time_ms=11.142 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.431850] gitaly[904]: time="2026-08-20T05:57:43.690Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:57:53.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:43.688" grpc.time_ms=1.789 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.465485] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:43.723Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","950df999c2932efef32784867bbefaeb4719dc34 4eefe3a5d973311e706734a427b5e7ae88bcd95f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"2dc1377139d00f84366b0d29","created_at":"2026-08-20T05:56:52.014Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-2b0afc2a950d4509","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:56:52.017Z","job_size_bytes":185,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-2dc1377139d00f84366b0d29: done: 0.379087 sec","job_status":"done","queue_duration_s":51.327453,"scheduling_latency_s":51.327486,"gitaly_calls":7,"gitaly_duration_s":0.156949,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.026983,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003095,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001268,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003465,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.009414,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009741,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.03,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.03,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.190826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000820775,"exclusive_lock_hold_duration_s":0.071920873,"duration_s":0.379087,"completed_at":"2026-08-20T05:57:43.723Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030759,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.525191] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:43.783Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"aab29e89344db9f1a8100102","created_at":"2026-08-20T05:56:52.993Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-d0c3d96b8b2749d1","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:52.998Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-aab29e89344db9f1a8100102: start","job_status":"start","queue_duration_s":50.784187,"scheduling_latency_s":50.784226} gitlab # [ 259.636576] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:43.895Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"aab29e89344db9f1a8100102","created_at":"2026-08-20T05:56:52.993Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-d0c3d96b8b2749d1","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:52.998Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-aab29e89344db9f1a8100102: done: 0.1122 sec","job_status":"done","queue_duration_s":50.784187,"scheduling_latency_s":50.784226,"redis_calls":16,"redis_duration_s":0.005860000000000001,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003026,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002128,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000706,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000538895,"duration_s":0.1122,"completed_at":"2026-08-20T05:57:43.895Z","load_balancing_strategy":"primary","db_duration_s":0.026387,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.707689] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:43.966Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a09b742b1ebb61e444d383b9","created_at":"2026-08-20T05:56:52.999Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-d0c3d96b8b2749d1","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:53.002Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a09b742b1ebb61e444d383b9: start","job_status":"start","queue_duration_s":50.964069,"scheduling_latency_s":50.96411} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 259.833299] nixbot[2684]: INFO: ::ffff:127.0.0.1:49856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.05 seconds) gitlab # [ 259.859271] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.117Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a09b742b1ebb61e444d383b9","created_at":"2026-08-20T05:56:52.999Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-d0c3d96b8b2749d1","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:53.002Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a09b742b1ebb61e444d383b9: done: 0.151525 sec","job_status":"done","queue_duration_s":50.964069,"scheduling_latency_s":50.96411,"redis_calls":21,"redis_duration_s":0.006558,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002947,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.087773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000584432,"duration_s":0.151525,"completed_at":"2026-08-20T05:57:44.117Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037155,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.861948] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.120Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0344c947e0804a6abf153383","created_at":"2026-08-20T05:56:53.091Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-d0c3d96b8b2749d1","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:53.096Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0344c947e0804a6abf153383: start","job_status":"start","queue_duration_s":51.024009,"scheduling_latency_s":51.024044} gitlab # [ 260.011870] gitaly[904]: time="2026-08-20T05:57:44.270Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:44.270" grpc.time_ms=0.564 pid=904 span.kind=server system=grpc gitlab # [ 260.058630] gitaly[904]: time="2026-08-20T05:57:44.317Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:44.317" grpc.time_ms=0.402 pid=904 span.kind=server system=grpc gitlab # [ 260.105946] gitaly[904]: time="2026-08-20T05:57:44.364Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:44.364" grpc.time_ms=0.287 pid=904 span.kind=server system=grpc gitlab # [ 260.129964] gitaly[904]: time="2026-08-20T05:57:44.389Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY diskcache=2d658d4f-b468-445c-af14-d792e83b6cce grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:14.039" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:44.240" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.130676] gitaly[904]: time="2026-08-20T05:57:44.389Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=148 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7597 command.oublock=0 command.real_time_ms=141 command.spawn_token_fork_ms=0 command.system_time_ms=88 command.user_time_ms=60 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:14.039" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:44.240" grpc.time_ms=149.075 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.258377] gitaly[904]: time="2026-08-20T05:57:44.516Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:58:14.315" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:44.515" grpc.time_ms=0.982 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.307268] gitaly[904]: time="2026-08-20T05:57:44.566Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:14.363" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:44.564" grpc.time_ms=1.131 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.324109] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.582Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0344c947e0804a6abf153383","created_at":"2026-08-20T05:56:53.091Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-d0c3d96b8b2749d1","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:53.096Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2621,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0344c947e0804a6abf153383: rescheduled"} gitlab # [ 260.336344] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.594Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"0344c947e0804a6abf153383","created_at":"2026-08-20T05:56:53.091Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-d0c3d96b8b2749d1","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:56:53.096Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0344c947e0804a6abf153383: done: 0.474841 sec","job_status":"done","queue_duration_s":51.024009,"scheduling_latency_s":51.024044,"gitaly_calls":3,"gitaly_duration_s":0.18418,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.028796000000000002,"redis_read_bytes":462,"redis_write_bytes":29289,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001132,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001871,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010413,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.004287,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15576,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.006236,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000566,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000561,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002598,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.021,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.196796,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.40031903500000005,"duration_s":0.474841,"completed_at":"2026-08-20T05:57:44.594Z","load_balancing_strategy":"primary","db_duration_s":0.07331,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.386674] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.596Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"589e5fbf370fe80cb528bcdb","created_at":"2026-08-20T05:57:42.361Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:42.376Z","job_size_bytes":46,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-589e5fbf370fe80cb528bcdb: start","job_status":"start","queue_duration_s":2.220784,"scheduling_latency_s":2.220812} gitlab # [ 260.387545] gitaly[904]: time="2026-08-20T05:57:44.639Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T11:57:44.633" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:44.634" grpc.time_ms=4.851 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.392354] gitaly[904]: time="2026-08-20T05:57:44.651Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:58:14.444" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:44.645" grpc.time_ms=6.098 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.430872] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.682Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"589e5fbf370fe80cb528bcdb","created_at":"2026-08-20T05:57:42.361Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:42.376Z","job_size_bytes":46,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-589e5fbf370fe80cb528bcdb: done: 0.086058 sec","job_status":"done","queue_duration_s":2.220784,"scheduling_latency_s":2.220812,"gitaly_calls":2,"gitaly_duration_s":0.015888,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006856,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001443,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000505,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001628,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002441,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000839,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000429943,"duration_s":0.086058,"completed_at":"2026-08-20T05:57:44.682Z","load_balancing_strategy":"primary","db_duration_s":0.012097,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.436120] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.684Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"da0913a4d71947e591daea31","created_at":"2026-08-20T05:57:42.388Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:42.392Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-da0913a4d71947e591daea31: start","job_status":"start","queue_duration_s":2.292335,"scheduling_latency_s":2.292364} gitlab # [ 260.465453] gitaly[904]: time="2026-08-20T05:57:44.724Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 diskcache=8c25f921-61d1-40b3-9406-1fb206e5a5cc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:44.702" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:44.702" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.466177] gitaly[904]: time="2026-08-20T05:57:44.724Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1278 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:44.702" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:44.702" grpc.time_ms=21.757 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.502051] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.760Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"da0913a4d71947e591daea31","created_at":"2026-08-20T05:57:42.388Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:42.392Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-da0913a4d71947e591daea31: done: 0.075991 sec","job_status":"done","queue_duration_s":2.292335,"scheduling_latency_s":2.292364,"gitaly_calls":1,"gitaly_duration_s":0.023569,"redis_calls":15,"redis_duration_s":0.002814,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000338,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.050714546,"duration_s":0.075991,"completed_at":"2026-08-20T05:57:44.760Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011349,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.510687] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.762Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"7534fba742f1a7366588aaca","created_at":"2026-08-20T05:57:42.529Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:42.531Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7534fba742f1a7366588aaca: start","job_status":"start","queue_duration_s":2.231474,"scheduling_latency_s":2.231502} gitlab # [ 260.532781] gitaly[904]: time="2026-08-20T05:57:44.791Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:58:14.585" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:44.786" grpc.time_ms=5.766 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.539275] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.798Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"7534fba742f1a7366588aaca","created_at":"2026-08-20T05:57:42.529Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:42.531Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-7534fba742f1a7366588aaca: done: 0.03569 sec","job_status":"done","queue_duration_s":2.231474,"scheduling_latency_s":2.231502,"gitaly_calls":1,"gitaly_duration_s":0.007649,"redis_calls":16,"redis_duration_s":0.002692,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000201,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001029,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03569,"completed_at":"2026-08-20T05:57:44.798Z","load_balancing_strategy":"primary","db_duration_s":0.001909,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.574412] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:44.799Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"874de6eb59c65cf67af49fd6","created_at":"2026-08-20T05:57:43.093Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:88c7bc7cddc85e5844ac02c1492f2fd3de033c0772b88f64aa55c54be8d890e9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.099Z","job_size_bytes":467,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-874de6eb59c65cf67af49fd6: start","job_status":"start","queue_duration_s":1.70014,"scheduling_latency_s":1.700155} gitlab # [ 260.610082] gitaly[904]: time="2026-08-20T05:57:44.816Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:14.615" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:44.816" grpc.time_ms=0.498 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.610703] gitaly[904]: time="2026-08-20T05:57:44.823Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:54.138" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:44.818" grpc.time_ms=4.907 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.642249] gitaly[904]: time="2026-08-20T05:57:44.901Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:58:14.700" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:44.900" grpc.time_ms=0.681 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.646976] gitaly[904]: time="2026-08-20T05:57:44.906Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=43 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:58:14.704" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:44.904" grpc.time_ms=1.768 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.733199] gitaly[904]: time="2026-08-20T05:57:44.992Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:54.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:44.983" grpc.time_ms=8.883 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 260.882621] nixbot[2684]: INFO: ::ffff:127.0.0.1:49872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.05 seconds) gitlab # [ 261.258958] gitaly[904]: time="2026-08-20T05:57:45.517Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=968 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:58:15.301" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:45.502" grpc.time_ms=14.925 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.279932] gitaly[904]: time="2026-08-20T05:57:45.539Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWKRP5CBBTHQMEXT929T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:58:15.321" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:45.521" grpc.time_ms=16.94 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.309467] sidekiq-cluster[2621]: {"severity":"WARN","time":"2026-08-20T05:57:45.568Z","class":"CreatePipelineWorker","correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"950df999c2932efef32784867bbefaeb4719dc34","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"950df999c2932efef32784867bbefaeb4719dc34","ref":"refs/heads/master"},"retry":0} gitlab # [ 261.314846] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:45.573Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"874de6eb59c65cf67af49fd6","created_at":"2026-08-20T05:57:43.093Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:88c7bc7cddc85e5844ac02c1492f2fd3de033c0772b88f64aa55c54be8d890e9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.099Z","job_size_bytes":467,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-874de6eb59c65cf67af49fd6: done: 0.774431 sec","job_status":"done","queue_duration_s":1.70014,"scheduling_latency_s":1.700155,"gitaly_calls":7,"gitaly_duration_s":0.093943,"redis_calls":51,"redis_duration_s":0.00975,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001053,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004041,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002737,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.6294,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000265956,"duration_s":0.774431,"completed_at":"2026-08-20T05:57:45.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040884,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.319766] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:45.575Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"1f0d1b38-8fac-459c-9e19-bf0f160f1904\"}"],"class":"WebHookWorker","jid":"e7af48b29cd19d83e7353d13","created_at":"2026-08-20T05:57:43.284Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2f62980e212dd70c4fc2b51238131b3383d46ea062e0c8b8d1515213bd575e7c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.292Z","job_size_bytes":1751,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e7af48b29cd19d83e7353d13: start","job_status":"start","queue_duration_s":2.282951,"scheduling_latency_s":2.282966} gitlab # [ 261.447511] nixbot[2684]: INFO: ::ffff:127.0.0.1:49880 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 261.478559] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:45.736Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"1f0d1b38-8fac-459c-9e19-bf0f160f1904\"}"],"class":"WebHookWorker","jid":"e7af48b29cd19d83e7353d13","created_at":"2026-08-20T05:57:43.284Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6d203fdf377342cb","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2f62980e212dd70c4fc2b51238131b3383d46ea062e0c8b8d1515213bd575e7c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.292Z","job_size_bytes":1751,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e7af48b29cd19d83e7353d13: done: 0.160936 sec","job_status":"done","queue_duration_s":2.282951,"scheduling_latency_s":2.282966,"redis_calls":19,"redis_duration_s":0.0048720000000000005,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00098,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000884,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002102,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05096569500000214,"cpu_s":0.092674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000527162,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.160936,"completed_at":"2026-08-20T05:57:45.736Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.548769] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:45.807Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"51394519aa026d87ca036ef5","created_at":"2026-08-20T05:57:43.484Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-847d90d3a1894e65","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"da0913a4d71947e591daea31","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.487Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-51394519aa026d87ca036ef5: start","job_status":"start","queue_duration_s":2.319726,"scheduling_latency_s":2.319777} gitlab # [ 261.592459] gitaly[904]: time="2026-08-20T05:57:45.851Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK diskcache=f95e2658-6347-4ab9-a008-c25ea820f4f8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:45.837" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:45.838" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.601412] gitaly[904]: time="2026-08-20T05:57:45.851Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:57:45.837" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:45.838" grpc.time_ms=13.556 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.621225] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:45.879Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"51394519aa026d87ca036ef5","created_at":"2026-08-20T05:57:43.484Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-847d90d3a1894e65","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"da0913a4d71947e591daea31","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.487Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-51394519aa026d87ca036ef5: done: 0.072645 sec","job_status":"done","queue_duration_s":2.319726,"scheduling_latency_s":2.319777,"gitaly_calls":1,"gitaly_duration_s":0.020419,"redis_calls":12,"redis_duration_s":0.0034419999999999997,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001571,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000569,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.041733237,"duration_s":0.072645,"completed_at":"2026-08-20T05:57:45.879Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.661439] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:45.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"36d2134a09bdf0d1471c8506","created_at":"2026-08-20T05:57:43.648Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-847d90d3a1894e65","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ad79ddd3b7633dd03c4d6e5cdfb36db2572ac9d357699fb67f439a3c30e51919","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.651Z","job_size_bytes":467,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-36d2134a09bdf0d1471c8506: start","job_status":"start","queue_duration_s":2.268166,"scheduling_latency_s":2.268219} gitlab # [ 261.701162] gitaly[904]: time="2026-08-20T05:57:45.959Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:15.757" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:45.958" grpc.time_ms=0.914 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.716687] gitaly[904]: time="2026-08-20T05:57:45.975Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:55.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:45.964" grpc.time_ms=11.169 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.728463] gitaly[904]: time="2026-08-20T05:57:45.987Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYDMG5142YHWXYA9NJQZG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:45.967" grpc.time_ms=20.227 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.740382] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 254 gitlab # [ 261.755130] gitaly[904]: time="2026-08-20T05:57:46.014Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:58:16.012" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:46.013" grpc.time_ms=0.947 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.772043] gitaly[904]: time="2026-08-20T05:57:46.031Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=61 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:58:16.028" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:46.028" grpc.time_ms=2.575 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.796035] gitaly[904]: time="2026-08-20T05:57:46.055Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:56.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:46.049" grpc.time_ms=5.499 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.807291] gitaly[904]: time="2026-08-20T05:57:46.061Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYDWHRGRDP7543AGP3B0H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:46.054" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 261.808218] gitlab-workhorse[825]: time="2026-08-20T05:57:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 261.808989] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 59 gitlab # [ 261.809765] gitaly[904]: time="2026-08-20T05:57:46.061Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYDWHRGRDP7543AGP3B0H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:46.054" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.810713] gitaly[904]: time="2026-08-20T05:57:46.061Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYDWHRGRDP7543AGP3B0H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:46.054" grpc.time_ms=6.748 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 261.863980] nixbot[2684]: {"ts": "2026-08-20T05:57:46.122Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 261.918367] nixbot[2684]: INFO: ::ffff:127.0.0.1:49886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab # [ 261.925439] gitaly[904]: time="2026-08-20T05:57:46.184Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYE0QB945T6S095KJRTWZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:16.083" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:46.183" grpc.time_ms=0.461 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.987047] gitaly[904]: time="2026-08-20T05:57:46.246Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYE0QB945T6S095KJRTWZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:56.234" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:46.235" grpc.time_ms=10.907 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.051157] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 173 gitlab # [ 262.057767] nixbot[2684]: {"ts": "2026-08-20T05:57:46.316Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 \"HTTP/1.1 201 Created\""} gitlab # [ 262.103456] gitaly[904]: time="2026-08-20T05:57:46.362Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYE6RCTPTAKRXX56YVJ46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:16.261" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:46.361" grpc.time_ms=0.571 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.114326] gitaly[904]: time="2026-08-20T05:57:46.373Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:58:16.360" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:46.361" grpc.time_ms=12.206 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.135403] gitaly[904]: time="2026-08-20T05:57:46.394Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWRTKK8G0CZ5NF4Y655FK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:58:16.386" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:46.386" grpc.time_ms=7.823 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.144545] gitaly[904]: time="2026-08-20T05:57:46.403Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYE6RCTPTAKRXX56YVJ46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:56.096" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:46.396" grpc.time_ms=6.847 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.151761] sidekiq-cluster[2621]: {"severity":"WARN","time":"2026-08-20T05:57:46.410Z","class":"CreatePipelineWorker","correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"950df999c2932efef32784867bbefaeb4719dc34","after":"4eefe3a5d973311e706734a427b5e7ae88bcd95f","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4eefe3a5d973311e706734a427b5e7ae88bcd95f","ref":"refs/heads/master"},"retry":0} gitlab # [ 262.157987] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.416Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"36d2134a09bdf0d1471c8506","created_at":"2026-08-20T05:57:43.648Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-847d90d3a1894e65","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ad79ddd3b7633dd03c4d6e5cdfb36db2572ac9d357699fb67f439a3c30e51919","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.651Z","job_size_bytes":467,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-36d2134a09bdf0d1471c8506: done: 0.496878 sec","job_status":"done","queue_duration_s":2.268166,"scheduling_latency_s":2.268219,"gitaly_calls":7,"gitaly_duration_s":0.082617,"redis_calls":33,"redis_duration_s":0.007638,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.00134,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001836,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003521,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.385023,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.496878,"completed_at":"2026-08-20T05:57:46.416Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021044,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 262.180995] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.423Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"def8ad6c-e304-49b7-b500-04ad2eafc20b\"}"],"class":"WebHookWorker","jid":"04f4942052229b5f4e47c2ad","created_at":"2026-08-20T05:57:43.671Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-847d90d3a1894e65","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bb29032fed778b53c1b1f7daf166582000108fc1de24263081239b9e8d694d4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.674Z","job_size_bytes":1749,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-04f4942052229b5f4e47c2ad: start","job_status":"start","queue_duration_s":2.749556,"scheduling_latency_s":2.74958} gitlab # [ 262.194649] nixbot[2684]: {"ts": "2026-08-20T05:57:46.451Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 \"HTTP/1.1 201 Created\""} gitlab # [ 262.196648] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 124 gitlab # [ 262.241659] gitaly[904]: time="2026-08-20T05:57:46.500Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYEAS4WC8ZMSWPAWYYFDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:16.399" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:46.499" grpc.time_ms=0.75 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.281295] nixbot[2684]: INFO: ::ffff:127.0.0.1:49888 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 262.283569] gitaly[904]: time="2026-08-20T05:57:46.542Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYEAS4WC8ZMSWPAWYYFDE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:56.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:46.533" grpc.time_ms=8.063 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.294764] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.550Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"def8ad6c-e304-49b7-b500-04ad2eafc20b\"}"],"class":"WebHookWorker","jid":"04f4942052229b5f4e47c2ad","created_at":"2026-08-20T05:57:43.671Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-847d90d3a1894e65","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bb29032fed778b53c1b1f7daf166582000108fc1de24263081239b9e8d694d4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:43.674Z","job_size_bytes":1749,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-04f4942052229b5f4e47c2ad: done: 0.127052 sec","job_status":"done","queue_duration_s":2.749556,"scheduling_latency_s":2.74958,"redis_calls":14,"redis_duration_s":0.004364,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000308,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002185,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.006113067999990562,"cpu_s":0.106674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.127052,"completed_at":"2026-08-20T05:57:46.550Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003191,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.333569] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.552Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"594874d10c41cb38df062440","created_at":"2026-08-20T05:57:44.228Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.231Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-594874d10c41cb38df062440: start","job_status":"start","queue_duration_s":2.320854,"scheduling_latency_s":2.320889} gitlab # [ 262.347406] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 128 gitlab # [ 262.348319] nixbot[2684]: {"ts": "2026-08-20T05:57:46.586Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/950df999c2932efef32784867bbefaeb4719dc34 \"HTTP/1.1 201 Created\""} gitlab # [ 262.351580] gitaly[904]: time="2026-08-20T05:57:46.610Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYEE0046QZ8B820MMAXS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:46.602" grpc.time_ms=7.653 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 262.352417] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 50 gitlab # [ 262.370703] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.629Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"594874d10c41cb38df062440","created_at":"2026-08-20T05:57:44.228Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.231Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-594874d10c41cb38df062440: done: 0.076436 sec","job_status":"done","queue_duration_s":2.320854,"scheduling_latency_s":2.320889,"redis_calls":10,"redis_duration_s":0.0016250000000000001,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000378,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256458,"duration_s":0.076436,"completed_at":"2026-08-20T05:57:46.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018495,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 262.372740] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.631Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c1262e485b42f584d1d80faf","created_at":"2026-08-20T05:57:44.419Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.423Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c1262e485b42f584d1d80faf: start","job_status":"start","queue_duration_s":2.207612,"scheduling_latency_s":2.207646} gitlab # [ 262.400862] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.659Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"c1262e485b42f584d1d80faf","created_at":"2026-08-20T05:57:44.419Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.423Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-c1262e485b42f584d1d80faf: done: 0.028343 sec","job_status":"done","queue_duration_s":2.207612,"scheduling_latency_s":2.207646,"redis_calls":10,"redis_duration_s":0.001573,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000339,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002464,"duration_s":0.028343,"completed_at":"2026-08-20T05:57:46.659Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.437124] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.660Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"23c9c1084aedf5ca66f8a904","created_at":"2026-08-20T05:57:44.433Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.438Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-23c9c1084aedf5ca66f8a904: start","job_status":"start","queue_duration_s":2.22203,"scheduling_latency_s":2.222043} gitlab # [ 262.437777] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.683Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"23c9c1084aedf5ca66f8a904","created_at":"2026-08-20T05:57:44.433Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.438Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-23c9c1084aedf5ca66f8a904: done: 0.022464 sec","job_status":"done","queue_duration_s":2.22203,"scheduling_latency_s":2.222043,"redis_calls":10,"redis_duration_s":0.001497,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213994,"duration_s":0.022464,"completed_at":"2026-08-20T05:57:46.683Z","load_balancing_strategy":"primary","db_duration_s":0.003237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.479505] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"6f9d5ee8a4fba2e2134f90f6","created_at":"2026-08-20T05:57:44.450Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.453Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6f9d5ee8a4fba2e2134f90f6: start","job_status":"start","queue_duration_s":2.230545,"scheduling_latency_s":2.230558} gitlab # [ 262.480187] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.708Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"6f9d5ee8a4fba2e2134f90f6","created_at":"2026-08-20T05:57:44.450Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.453Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6f9d5ee8a4fba2e2134f90f6: done: 0.023945 sec","job_status":"done","queue_duration_s":2.230545,"scheduling_latency_s":2.230558,"redis_calls":13,"redis_duration_s":0.001803,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000413,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223771,"duration_s":0.023945,"completed_at":"2026-08-20T05:57:46.708Z","load_balancing_strategy":"primary","db_duration_s":0.003729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.531386] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.709Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b3196ebfb7e6b72bf3497380","created_at":"2026-08-20T05:57:44.454Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.456Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b3196ebfb7e6b72bf3497380: start","job_status":"start","queue_duration_s":2.252332,"scheduling_latency_s":2.252346} gitlab # [ 262.531959] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.730Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b3196ebfb7e6b72bf3497380","created_at":"2026-08-20T05:57:44.454Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.456Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b3196ebfb7e6b72bf3497380: done: 0.020933 sec","job_status":"done","queue_duration_s":2.252332,"scheduling_latency_s":2.252346,"redis_calls":10,"redis_duration_s":0.00139,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207009,"duration_s":0.020933,"completed_at":"2026-08-20T05:57:46.730Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.566939] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.731Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"234915508ca4a18edf2440e0","created_at":"2026-08-20T05:57:44.457Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.460Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-234915508ca4a18edf2440e0: start","job_status":"start","queue_duration_s":2.270505,"scheduling_latency_s":2.270518} gitlab # [ 262.602602] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"234915508ca4a18edf2440e0","created_at":"2026-08-20T05:57:44.457Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.460Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-234915508ca4a18edf2440e0: done: 0.019114 sec","job_status":"done","queue_duration_s":2.270505,"scheduling_latency_s":2.270518,"redis_calls":11,"redis_duration_s":0.001505,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238578,"duration_s":0.019114,"completed_at":"2026-08-20T05:57:46.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.640305] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.751Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"08cf67b8908d66cf08cef16f","created_at":"2026-08-20T05:57:44.462Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.465Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-08cf67b8908d66cf08cef16f: start","job_status":"start","queue_duration_s":2.285641,"scheduling_latency_s":2.285653} gitlab # [ 262.640953] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.793Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"08cf67b8908d66cf08cef16f","created_at":"2026-08-20T05:57:44.462Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.465Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-08cf67b8908d66cf08cef16f: done: 0.042598 sec","job_status":"done","queue_duration_s":2.285641,"scheduling_latency_s":2.285653,"redis_calls":10,"redis_duration_s":0.00152,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000334,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000261486,"duration_s":0.042598,"completed_at":"2026-08-20T05:57:46.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.693405] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.794Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5307d64f97a576e534116f5c","created_at":"2026-08-20T05:57:44.466Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.469Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5307d64f97a576e534116f5c: start","job_status":"start","queue_duration_s":2.325667,"scheduling_latency_s":2.325681} gitlab # [ 262.693657] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.821Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"5307d64f97a576e534116f5c","created_at":"2026-08-20T05:57:44.466Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.469Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5307d64f97a576e534116f5c: done: 0.026332 sec","job_status":"done","queue_duration_s":2.325667,"scheduling_latency_s":2.325681,"redis_calls":10,"redis_duration_s":0.00149,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000849,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214832,"duration_s":0.026332,"completed_at":"2026-08-20T05:57:46.821Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003163,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.731734] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.822Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6378ee0567d98096be94b4c9","created_at":"2026-08-20T05:57:44.473Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.477Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6378ee0567d98096be94b4c9: start","job_status":"start","queue_duration_s":2.344368,"scheduling_latency_s":2.34438} gitlab # [ 262.732366] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.846Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6378ee0567d98096be94b4c9","created_at":"2026-08-20T05:57:44.473Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.477Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6378ee0567d98096be94b4c9: done: 0.024292 sec","job_status":"done","queue_duration_s":2.344368,"scheduling_latency_s":2.34438,"redis_calls":10,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023299,"duration_s":0.024292,"completed_at":"2026-08-20T05:57:46.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.774206] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b4f1a5a62326412348a7bed5","created_at":"2026-08-20T05:57:44.478Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.483Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b4f1a5a62326412348a7bed5: start","job_status":"start","queue_duration_s":2.363748,"scheduling_latency_s":2.363761} gitlab # [ 262.777097] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.863Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b4f1a5a62326412348a7bed5","created_at":"2026-08-20T05:57:44.478Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.483Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b4f1a5a62326412348a7bed5: done: 0.015763 sec","job_status":"done","queue_duration_s":2.363748,"scheduling_latency_s":2.363761,"redis_calls":10,"redis_duration_s":0.001426,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000296,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000226845,"duration_s":0.015763,"completed_at":"2026-08-20T05:57:46.863Z","load_balancing_strategy":"primary","db_duration_s":0.001497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.828912] gitaly[904]: time="2026-08-20T05:57:46.999Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:46.998" grpc.time_ms=0.391 pid=904 span.kind=server system=grpc gitlab # [ 262.829516] gitaly[904]: time="2026-08-20T05:57:47.021Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:47.021" grpc.time_ms=0.256 pid=904 span.kind=server system=grpc gitlab # [ 262.830207] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.864Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"8f42e95ea17fb58e6a769909","created_at":"2026-08-20T05:57:44.484Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.489Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-8f42e95ea17fb58e6a769909: start","job_status":"start","queue_duration_s":2.374859,"scheduling_latency_s":2.374873} gitlab # [ 262.840815] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.887Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"8f42e95ea17fb58e6a769909","created_at":"2026-08-20T05:57:44.484Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.489Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-8f42e95ea17fb58e6a769909: done: 0.022959 sec","job_status":"done","queue_duration_s":2.374859,"scheduling_latency_s":2.374873,"redis_calls":10,"redis_duration_s":0.001549,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000366,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203378,"duration_s":0.022959,"completed_at":"2026-08-20T05:57:46.887Z","load_balancing_strategy":"primary","db_duration_s":0.004334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.876874] gitaly[904]: time="2026-08-20T05:57:47.044Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:47.044" grpc.time_ms=0.258 pid=904 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 262.918762] gitaly[904]: time="2026-08-20T05:57:47.058Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY diskcache=cf18e1c9-ebdf-4642-965f-93e4a972ff31 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:16.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:46.975" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.919564] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.887Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"7bbbbf9a374e771f4f915544","created_at":"2026-08-20T05:57:44.496Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.501Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-7bbbbf9a374e771f4f915544: start","job_status":"start","queue_duration_s":2.386095,"scheduling_latency_s":2.386108} gitlab # [ 262.920229] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.929Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"7bbbbf9a374e771f4f915544","created_at":"2026-08-20T05:57:44.496Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.501Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-7bbbbf9a374e771f4f915544: done: 0.041808 sec","job_status":"done","queue_duration_s":2.386095,"scheduling_latency_s":2.386108,"redis_calls":14,"redis_duration_s":0.002074,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000842,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023327,"duration_s":0.041808,"completed_at":"2026-08-20T05:57:46.929Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.05 seconds) gitlab # [ 262.954735] gitaly[904]: time="2026-08-20T05:57:47.058Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=79 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7599 command.oublock=0 command.real_time_ms=75 command.spawn_token_fork_ms=0 command.system_time_ms=50 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:16.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:46.975" grpc.time_ms=82.905 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.955475] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:46.930Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4514f9d3ba9668dc303d9cd2","created_at":"2026-08-20T05:57:44.582Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.585Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4514f9d3ba9668dc303d9cd2: start","job_status":"start","queue_duration_s":2.345431,"scheduling_latency_s":2.345444} gitlab # [ 262.995224] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.119Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4514f9d3ba9668dc303d9cd2","created_at":"2026-08-20T05:57:44.582Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.585Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2621,"job_status":"rescheduled","message":"PipelineProcessWorker JID-4514f9d3ba9668dc303d9cd2: rescheduled"} gitlab # [ 262.995881] gitaly[904]: time="2026-08-20T05:57:47.094Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:58:17.093" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:47.093" grpc.time_ms=0.724 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.996738] nixbot[2684]: INFO: ::ffff:127.0.0.1:49902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab # [ 262.997170] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.124Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4514f9d3ba9668dc303d9cd2","created_at":"2026-08-20T05:57:44.582Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-7fd0c507431640af","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.585Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4514f9d3ba9668dc303d9cd2: done: 0.193724 sec","job_status":"done","queue_duration_s":2.345431,"scheduling_latency_s":2.345444,"gitaly_calls":3,"gitaly_duration_s":0.089742,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008134,"redis_read_bytes":149,"redis_write_bytes":18013,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000396,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000693,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.001919,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000177,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000363,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081613,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.170458536,"duration_s":0.193724,"completed_at":"2026-08-20T05:57:47.124Z","load_balancing_strategy":"primary","db_duration_s":0.020339,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 263.041692] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"e63e42529a1e96106e6bf602","created_at":"2026-08-20T05:57:44.662Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-7c531b3089af4ccc","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.668Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-e63e42529a1e96106e6bf602: start","job_status":"start","queue_duration_s":2.457383,"scheduling_latency_s":2.457398} gitlab # [ 263.042531] gitaly[904]: time="2026-08-20T05:57:47.114Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVWSRANKHK6RSS1WF8BNGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:17.113" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:47.113" grpc.time_ms=0.486 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 263.050863] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.160Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"e63e42529a1e96106e6bf602","created_at":"2026-08-20T05:57:44.662Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-7c531b3089af4ccc","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:44.668Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-e63e42529a1e96106e6bf602: done: 0.035329 sec","job_status":"done","queue_duration_s":2.457383,"scheduling_latency_s":2.457398,"redis_calls":19,"redis_duration_s":0.0029259999999999998,"redis_read_bytes":22,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000576,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00037,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001503,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008365029,"duration_s":0.035329,"completed_at":"2026-08-20T05:57:47.160Z","load_balancing_strategy":"primary","db_duration_s":0.004805,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.086747] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.162Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e7af48b29cd19d83e7353d13"],"class":"WebHooks::LogExecutionWorker","jid":"95f69c76b40c5fd01479b34e","created_at":"2026-08-20T05:57:45.712Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6674b0aef9b9411c","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4856ab0c2771eba247288859044a13bac6e715286fd3177d6175643197da2f7c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:45.721Z","job_size_bytes":2593,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-95f69c76b40c5fd01479b34e: start","job_status":"start","queue_duration_s":1.440521,"scheduling_latency_s":1.440537} gitlab # [ 263.125813] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.193Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e7af48b29cd19d83e7353d13"],"class":"WebHooks::LogExecutionWorker","jid":"95f69c76b40c5fd01479b34e","created_at":"2026-08-20T05:57:45.712Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-6674b0aef9b9411c","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4856ab0c2771eba247288859044a13bac6e715286fd3177d6175643197da2f7c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:45.721Z","job_size_bytes":2593,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-95f69c76b40c5fd01479b34e: done: 0.03178 sec","job_status":"done","queue_duration_s":1.440521,"scheduling_latency_s":1.440537,"redis_calls":10,"redis_duration_s":0.00142,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215111,"duration_s":0.03178,"completed_at":"2026-08-20T05:57:47.193Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.136804] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.195Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","04f4942052229b5f4e47c2ad"],"class":"WebHooks::LogExecutionWorker","jid":"b18103cb4dc702843bc37dac","created_at":"2026-08-20T05:57:46.541Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-1e216863ad5c4909","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b22a5164d95b9ae38a148358cf5a1fcee8a1eceb5ed8bf75fd4603a8c2672fc","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:46.544Z","job_size_bytes":2592,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b18103cb4dc702843bc37dac: start","job_status":"start","queue_duration_s":0.650499,"scheduling_latency_s":0.650513} gitlab # [ 263.177107] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.211Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","04f4942052229b5f4e47c2ad"],"class":"WebHooks::LogExecutionWorker","jid":"b18103cb4dc702843bc37dac","created_at":"2026-08-20T05:57:46.541Z","trace_propagation_headers":{"sentry-trace":"b5dfedc1bcd24d8cae344a08c77ff74f-1e216863ad5c4909","baggage":"sentry-trace_id=b5dfedc1bcd24d8cae344a08c77ff74f,sentry-release=Unknown"},"correlation_id":"01M0EVWRTKK8G0CZ5NF4Y655FK","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5b22a5164d95b9ae38a148358cf5a1fcee8a1eceb5ed8bf75fd4603a8c2672fc","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:46.544Z","job_size_bytes":2592,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b18103cb4dc702843bc37dac: done: 0.016603 sec","job_status":"done","queue_duration_s":0.650499,"scheduling_latency_s":0.650513,"redis_calls":7,"redis_duration_s":0.001069,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016603,"completed_at":"2026-08-20T05:57:47.211Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.215031] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.212Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f5bfc645408fe3c46c85e8f2","created_at":"2026-08-20T05:57:46.969Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:46.971Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f5bfc645408fe3c46c85e8f2: start","job_status":"start","queue_duration_s":0.241233,"scheduling_latency_s":0.241248} gitlab # [ 263.215643] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.251Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f5bfc645408fe3c46c85e8f2","created_at":"2026-08-20T05:57:46.969Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:46.971Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f5bfc645408fe3c46c85e8f2: done: 0.038586 sec","job_status":"done","queue_duration_s":0.241233,"scheduling_latency_s":0.241248,"redis_calls":7,"redis_duration_s":0.002127,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001615,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038586,"completed_at":"2026-08-20T05:57:47.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006865,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 263.251282] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.252Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7bea6ec905daaa52011a13ce","created_at":"2026-08-20T05:57:47.064Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.066Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7bea6ec905daaa52011a13ce: start","job_status":"start","queue_duration_s":0.186094,"scheduling_latency_s":0.186114} gitlab # [ 263.251933] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.270Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7bea6ec905daaa52011a13ce","created_at":"2026-08-20T05:57:47.064Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.066Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7bea6ec905daaa52011a13ce: done: 0.018565 sec","job_status":"done","queue_duration_s":0.186094,"scheduling_latency_s":0.186114,"redis_calls":7,"redis_duration_s":0.001055,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018565,"completed_at":"2026-08-20T05:57:47.270Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.287605] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.271Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f12fe069e7d9a4debf9fc870","created_at":"2026-08-20T05:57:47.070Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.071Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f12fe069e7d9a4debf9fc870: start","job_status":"start","queue_duration_s":0.200692,"scheduling_latency_s":0.200706} gitlab # [ 263.292406] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.289Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f12fe069e7d9a4debf9fc870","created_at":"2026-08-20T05:57:47.070Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.071Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f12fe069e7d9a4debf9fc870: done: 0.017347 sec","job_status":"done","queue_duration_s":0.200692,"scheduling_latency_s":0.200706,"redis_calls":7,"redis_duration_s":0.001019,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000318,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017347,"completed_at":"2026-08-20T05:57:47.289Z","load_balancing_strategy":"primary","db_duration_s":0.002822,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.335990] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.290Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1d0f1fda0bd55ab739eea432","created_at":"2026-08-20T05:57:47.076Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.077Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1d0f1fda0bd55ab739eea432: start","job_status":"start","queue_duration_s":0.212562,"scheduling_latency_s":0.2126} gitlab # [ 263.337662] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1d0f1fda0bd55ab739eea432","created_at":"2026-08-20T05:57:47.076Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.077Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1d0f1fda0bd55ab739eea432: done: 0.018998 sec","job_status":"done","queue_duration_s":0.212562,"scheduling_latency_s":0.2126,"redis_calls":10,"redis_duration_s":0.001435,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000421,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018998,"completed_at":"2026-08-20T05:57:47.309Z","load_balancing_strategy":"primary","db_duration_s":0.002888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.376266] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.310Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0a9b819ca43939682c22c5e0","created_at":"2026-08-20T05:57:47.078Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.078Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0a9b819ca43939682c22c5e0: start","job_status":"start","queue_duration_s":0.231436,"scheduling_latency_s":0.23145} gitlab # [ 263.416768] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.326Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0a9b819ca43939682c22c5e0","created_at":"2026-08-20T05:57:47.078Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.078Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0a9b819ca43939682c22c5e0: done: 0.01647 sec","job_status":"done","queue_duration_s":0.231436,"scheduling_latency_s":0.23145,"redis_calls":7,"redis_duration_s":0.000997,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01647,"completed_at":"2026-08-20T05:57:47.326Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.419546] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.327Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"be0b8d32e5bd5f2434f10893","created_at":"2026-08-20T05:57:47.079Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.080Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-be0b8d32e5bd5f2434f10893: start","job_status":"start","queue_duration_s":0.247133,"scheduling_latency_s":0.247147} gitlab # [ 263.432875] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.343Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"be0b8d32e5bd5f2434f10893","created_at":"2026-08-20T05:57:47.079Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.080Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-be0b8d32e5bd5f2434f10893: done: 0.016189 sec","job_status":"done","queue_duration_s":0.247133,"scheduling_latency_s":0.247147,"redis_calls":8,"redis_duration_s":0.001471,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016189,"completed_at":"2026-08-20T05:57:47.343Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.480467] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.345Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f7bf1963ce056ad4d2420a5d","created_at":"2026-08-20T05:57:47.081Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.082Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f7bf1963ce056ad4d2420a5d: start","job_status":"start","queue_duration_s":0.262906,"scheduling_latency_s":0.26292} gitlab # [ 263.481197] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.360Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f7bf1963ce056ad4d2420a5d","created_at":"2026-08-20T05:57:47.081Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.082Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f7bf1963ce056ad4d2420a5d: done: 0.014763 sec","job_status":"done","queue_duration_s":0.262906,"scheduling_latency_s":0.26292,"redis_calls":7,"redis_duration_s":0.000979,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014763,"completed_at":"2026-08-20T05:57:47.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001592,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.516233] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.361Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"83c9645fd150b84f9f103026","created_at":"2026-08-20T05:57:47.082Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.083Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-83c9645fd150b84f9f103026: start","job_status":"start","queue_duration_s":0.277397,"scheduling_latency_s":0.277411} gitlab # [ 263.556881] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.382Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"83c9645fd150b84f9f103026","created_at":"2026-08-20T05:57:47.082Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.083Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-83c9645fd150b84f9f103026: done: 0.020983 sec","job_status":"done","queue_duration_s":0.277397,"scheduling_latency_s":0.277411,"redis_calls":7,"redis_duration_s":0.001193,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020983,"completed_at":"2026-08-20T05:57:47.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.563053] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.383Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"27a48dec764f0f557e21e5e9","created_at":"2026-08-20T05:57:47.084Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.084Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-27a48dec764f0f557e21e5e9: start","job_status":"start","queue_duration_s":0.298452,"scheduling_latency_s":0.298476} gitlab # [ 263.576196] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.394Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"27a48dec764f0f557e21e5e9","created_at":"2026-08-20T05:57:47.084Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.084Z","job_size_bytes":6,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-27a48dec764f0f557e21e5e9: done: 0.011237 sec","job_status":"done","queue_duration_s":0.298452,"scheduling_latency_s":0.298476,"redis_calls":7,"redis_duration_s":0.0010040000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011237,"completed_at":"2026-08-20T05:57:47.394Z","load_balancing_strategy":"primary","db_duration_s":0.000323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.616062] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.395Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a687fd047e89d51219ae9369","created_at":"2026-08-20T05:57:47.085Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.086Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a687fd047e89d51219ae9369: start","job_status":"start","queue_duration_s":0.3097,"scheduling_latency_s":0.309713} gitlab # [ 263.651033] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.411Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a687fd047e89d51219ae9369","created_at":"2026-08-20T05:57:47.085Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.086Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a687fd047e89d51219ae9369: done: 0.015365 sec","job_status":"done","queue_duration_s":0.3097,"scheduling_latency_s":0.309713,"redis_calls":7,"redis_duration_s":0.0009480000000000001,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015365,"completed_at":"2026-08-20T05:57:47.411Z","load_balancing_strategy":"primary","db_duration_s":0.002147,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.654554] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.412Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"22c0d4c95b38acbf381227e0","created_at":"2026-08-20T05:57:47.120Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.121Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-22c0d4c95b38acbf381227e0: start","job_status":"start","queue_duration_s":0.291298,"scheduling_latency_s":0.291311} gitlab # [ 263.697188] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.428Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"22c0d4c95b38acbf381227e0","created_at":"2026-08-20T05:57:47.120Z","trace_propagation_headers":{"sentry-trace":"995c3df79e5645819ee9519cfed836a3-34df8224e11f4ec5","baggage":"sentry-trace_id=995c3df79e5645819ee9519cfed836a3,sentry-release=Unknown"},"correlation_id":"01M0EVWSRANKHK6RSS1WF8BNGY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.121Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-22c0d4c95b38acbf381227e0: done: 0.016658 sec","job_status":"done","queue_duration_s":0.291298,"scheduling_latency_s":0.291311,"redis_calls":8,"redis_duration_s":0.001123,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016658,"completed_at":"2026-08-20T05:57:47.428Z","load_balancing_strategy":"primary","db_duration_s":0.002322,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 263.700558] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"76850b856ce6a73c57d632e8","created_at":"2026-08-20T05:57:47.147Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-b588dc45a43f4db2","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.153Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-76850b856ce6a73c57d632e8: start","job_status":"start","queue_duration_s":0.276419,"scheduling_latency_s":0.276435} gitlab # [ 263.714525] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:47.493Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"76850b856ce6a73c57d632e8","created_at":"2026-08-20T05:57:47.147Z","trace_propagation_headers":{"sentry-trace":"6861cb07084b472897748c88e28f21c8-b588dc45a43f4db2","baggage":"sentry-trace_id=6861cb07084b472897748c88e28f21c8,sentry-release=Unknown"},"correlation_id":"01M0EVWKRP5CBBTHQMEXT929T7","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:47.153Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-76850b856ce6a73c57d632e8: done: 0.063776 sec","job_status":"done","queue_duration_s":0.276419,"scheduling_latency_s":0.276435,"redis_calls":11,"redis_duration_s":0.00164,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227124,"duration_s":0.063776,"completed_at":"2026-08-20T05:57:47.493Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013974,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.816486] gitaly[904]: time="2026-08-20T05:57:48.075Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYEFNY3J0XYAMG4P84V4D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.067" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 263.816725] gitaly[904]: time="2026-08-20T05:57:48.075Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYEFNY3J0XYAMG4P84V4D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.067" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 263.817445] gitaly[904]: time="2026-08-20T05:57:48.075Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYEFNY3J0XYAMG4P84V4D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.067" grpc.time_ms=7.546 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 263.818333] gitlab-workhorse[825]: time="2026-08-20T05:57:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 263.818955] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1462 gitlab # [ 263.880054] gitaly[904]: time="2026-08-20T05:57:48.139Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYFY5PGGBJRXYSJ36XCVC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.132" grpc.time_ms=6.365 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 263.891727] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 48 gitlab # [ 263.904897] nix-daemon[2895]: accepted connection from pid 3411, user nixbot gitlab # [ 263.956699] gitaly[904]: time="2026-08-20T05:57:48.215Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYFZRH4GZDH0DYTC3ZWNR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.206" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 263.957418] gitaly[904]: time="2026-08-20T05:57:48.215Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYFZRH4GZDH0DYTC3ZWNR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.206" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 263.958781] gitaly[904]: time="2026-08-20T05:57:48.216Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYFZRH4GZDH0DYTC3ZWNR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.206" grpc.time_ms=9.322 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 263.992060] gitlab-workhorse[825]: time="2026-08-20T05:57:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 263.992591] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 98 gitlab # [ 264.017733] nixbot[2684]: INFO: ::ffff:127.0.0.1:55848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.04 seconds) gitlab # [ 264.070546] gitaly[904]: time="2026-08-20T05:57:48.329Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYG3WJ1A6XRWX0R00RYSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.318" grpc.time_ms=11.122 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 264.071466] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 45 gitlab # [ 264.130842] gitaly[904]: time="2026-08-20T05:57:48.389Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG5BQ6XXDC9BAM6R3ZHF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.370" pid=904 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 264.131332] gitaly[904]: time="2026-08-20T05:57:48.389Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG5BQ6XXDC9BAM6R3ZHF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.370" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 264.132391] gitaly[904]: time="2026-08-20T05:57:48.390Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG5BQ6XXDC9BAM6R3ZHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:48.370" grpc.time_ms=19.564 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 264.133832] gitlab-workhorse[825]: time="2026-08-20T05:57:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 264.135116] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 59 gitlab # [ 264.274127] gitaly[904]: time="2026-08-20T05:57:48.533Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:18.431" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:48.532" grpc.time_ms=0.707 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 264.314266] gitaly[904]: time="2026-08-20T05:57:48.573Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:58:18.459" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:48.560" grpc.time_ms=13.098 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 264.360083] gitaly[904]: time="2026-08-20T05:57:48.619Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:58.118" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:48.608" grpc.time_ms=10.58 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 264.415062] gitaly[904]: time="2026-08-20T05:57:48.674Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:57:58.182" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:48.673" grpc.time_ms=0.508 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 264.457073] gitaly[904]: time="2026-08-20T05:57:48.716Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:57:58.213" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:48.703" grpc.time_ms=12.045 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 264.537777] gitaly[904]: time="2026-08-20T05:57:48.796Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:48.795" grpc.time_ms=0.643 pid=904 span.kind=server system=grpc gitlab # [ 264.586919] gitaly[904]: time="2026-08-20T05:57:48.845Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:48.844" grpc.time_ms=0.778 pid=904 span.kind=server system=grpc gitlab # [ 264.617323] gitaly[904]: time="2026-08-20T05:57:48.876Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE diskcache=1bf9c6b7-1932-4471-ab5e-bdb420506277 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:58.251" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:48.742" pid=904 ref=refs/keep-around/4eefe3a5d973311e706734a427b5e7ae88bcd95f remote_ip="2001:db8:1::1" revision=4eefe3a5d973311e706734a427b5e7ae88bcd95f span.kind=server system=grpc username=root gitlab # [ 264.618120] gitaly[904]: time="2026-08-20T05:57:48.876Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=118 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5530 command.oublock=8 command.real_time_ms=124 command.spawn_token_fork_ms=0 command.system_time_ms=77 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:57:58.251" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:57:48.742" grpc.time_ms=134.062 pid=904 ref=refs/keep-around/4eefe3a5d973311e706734a427b5e7ae88bcd95f remote_ip="2001:db8:1::1" revision=4eefe3a5d973311e706734a427b5e7ae88bcd95f span.kind=server system=grpc username=root gitlab # [ 264.622368] gitaly[904]: time="2026-08-20T05:57:48.881Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:18.780" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:48.880" grpc.time_ms=0.517 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 264.642709] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:48.900Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"24d83d275d56865103d0f577","created_at":"2026-08-20T05:57:48.891Z","trace_propagation_headers":{"sentry-trace":"69342377f8dc4940a98bd35741a87502-540939b6eaef44bf","baggage":"sentry-trace_id=69342377f8dc4940a98bd35741a87502,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVYG9P67EN6HV54EBS3HXE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:48.898Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-24d83d275d56865103d0f577: start","job_status":"start","queue_duration_s":0.002235,"scheduling_latency_s":0.002291} gitlab # [ 264.683895] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:48.942Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"24d83d275d56865103d0f577","created_at":"2026-08-20T05:57:48.891Z","trace_propagation_headers":{"sentry-trace":"69342377f8dc4940a98bd35741a87502-540939b6eaef44bf","baggage":"sentry-trace_id=69342377f8dc4940a98bd35741a87502,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVYG9P67EN6HV54EBS3HXE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:48.898Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-24d83d275d56865103d0f577: done: 0.041491 sec","job_status":"done","queue_duration_s":0.002235,"scheduling_latency_s":0.002291,"redis_calls":7,"redis_duration_s":0.001779,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041491,"completed_at":"2026-08-20T05:57:48.942Z","load_balancing_strategy":"primary","db_duration_s":0.004168,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 264.741962] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:49.000Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9ffedad41b4fc5edfde6836e","created_at":"2026-08-20T05:57:48.899Z","trace_propagation_headers":{"sentry-trace":"69342377f8dc4940a98bd35741a87502-540939b6eaef44bf","baggage":"sentry-trace_id=69342377f8dc4940a98bd35741a87502,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVYG9P67EN6HV54EBS3HXE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:48.999Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9ffedad41b4fc5edfde6836e: start","job_status":"start","queue_duration_s":0.00144,"scheduling_latency_s":0.001489} gitlab # [ 264.817620] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:49.075Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"9ffedad41b4fc5edfde6836e","created_at":"2026-08-20T05:57:48.899Z","trace_propagation_headers":{"sentry-trace":"69342377f8dc4940a98bd35741a87502-540939b6eaef44bf","baggage":"sentry-trace_id=69342377f8dc4940a98bd35741a87502,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVYG9P67EN6HV54EBS3HXE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:48.999Z","job_size_bytes":65,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-9ffedad41b4fc5edfde6836e: done: 0.075113 sec","job_status":"done","queue_duration_s":0.00144,"scheduling_latency_s":0.001489,"redis_calls":10,"redis_duration_s":0.003546,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001205,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075113,"completed_at":"2026-08-20T05:57:49.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 264.873928] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:49.132Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5c0997bcc87dd46ffed6c8f6","created_at":"2026-08-20T05:57:49.084Z","trace_propagation_headers":{"sentry-trace":"69342377f8dc4940a98bd35741a87502-540939b6eaef44bf","baggage":"sentry-trace_id=69342377f8dc4940a98bd35741a87502,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVYG9P67EN6HV54EBS3HXE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:49.130Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5c0997bcc87dd46ffed6c8f6: start","job_status":"start","queue_duration_s":0.001502,"scheduling_latency_s":0.001553} gitlab # [ 264.896858] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 685 gitlab # [ 264.899544] nixbot[2684]: {"ts": "2026-08-20T05:57:49.157Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4eefe3a5d973311e706734a427b5e7ae88bcd95f \"HTTP/1.1 201 Created\""} gitlab # [ 264.907619] nixbot[2684]: {"ts": "2026-08-20T05:57:49.166Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4eefe3a5d973-4"} gitlab # [ 264.970200] gitaly[904]: time="2026-08-20T05:57:49.228Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:58:19.226" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:49.227" grpc.time_ms=1.345 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 264.994450] nix-daemon[2895]: accepted connection from pid 3471, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f' gitlab # [ 265.041095] gitaly[904]: time="2026-08-20T05:57:49.299Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYG9P67EN6HV54EBS3HXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:19.298" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:49.298" grpc.time_ms=0.833 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.051097] nixbot[2684]: INFO: ::ffff:127.0.0.1:55860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 200 OK gitlab # [ 265.051855] nix-daemon[2895]: accepted connection from pid 3479, user nixbot gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4eefe3a5d973311e706734a427b5e7ae88bcd95f', in 0.05 seconds) (finished: subtest: push delivers the webhook, in 57.88 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4eefe3a5d973311e706734a427b5e7ae88bcd95f/statuses gitlab # [ 265.072508] nixbot[2684]: {"ts": "2026-08-20T05:57:49.330Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4eefe3a5d973-4", "argv0": "bwrap"} gitlab # [ 265.085474] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:49.344Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5c0997bcc87dd46ffed6c8f6","created_at":"2026-08-20T05:57:49.084Z","trace_propagation_headers":{"sentry-trace":"69342377f8dc4940a98bd35741a87502-540939b6eaef44bf","baggage":"sentry-trace_id=69342377f8dc4940a98bd35741a87502,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVYG9P67EN6HV54EBS3HXE","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:49.130Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5c0997bcc87dd46ffed6c8f6: done: 0.211834 sec","job_status":"done","queue_duration_s":0.001502,"scheduling_latency_s":0.001553,"gitaly_calls":2,"gitaly_duration_s":0.059562,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010466,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001197,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001328,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000536,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00414,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000261,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000525,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001282,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107521,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.156778865,"duration_s":0.211834,"completed_at":"2026-08-20T05:57:49.344Z","load_balancing_strategy":"primary","db_duration_s":0.035491,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 265.129327] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:49.388Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"16bd6a2177dddfece4de8d0c","created_at":"2026-08-20T05:57:49.210Z","trace_propagation_headers":{"sentry-trace":"69342377f8dc4940a98bd35741a87502-aaad0553561a469d","baggage":"sentry-trace_id=69342377f8dc4940a98bd35741a87502,sentry-release=Unknown"},"correlation_id":"01M0EVYG9P67EN6HV54EBS3HXE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:49.212Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-16bd6a2177dddfece4de8d0c: start","job_status":"start","queue_duration_s":0.175941,"scheduling_latency_s":0.17598} gitlab # [ 265.143987] gitaly[904]: time="2026-08-20T05:57:49.403Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYH58RSATES95KDH5N3HE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:19.302" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:49.402" grpc.time_ms=0.492 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.154621] nix-daemon[2895]: accepted connection from pid 3498, user nixbot gitlab # [ 265.165254] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4eefe3a5d973311e706734a427b5e7ae88bcd95f/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 71 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4eefe3a5d973311e706734a427b5e7ae88bcd95f/statuses, in 0.10 seconds) gitlab # [ 265.173445] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:49.432Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"16bd6a2177dddfece4de8d0c","created_at":"2026-08-20T05:57:49.210Z","trace_propagation_headers":{"sentry-trace":"69342377f8dc4940a98bd35741a87502-aaad0553561a469d","baggage":"sentry-trace_id=69342377f8dc4940a98bd35741a87502,sentry-release=Unknown"},"correlation_id":"01M0EVYG9P67EN6HV54EBS3HXE","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:49.212Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-16bd6a2177dddfece4de8d0c: done: 0.044356 sec","job_status":"done","queue_duration_s":0.175941,"scheduling_latency_s":0.17598,"redis_calls":7,"redis_duration_s":0.001149,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044356,"completed_at":"2026-08-20T05:57:49.432Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 265.207949] nix-daemon[2895]: accepted connection from pid 3508, user nixbot gitlab # [ 265.246324] nix-daemon[2895]: accepted connection from pid 3515, user nixbot gitlab # [ 265.260064] nix-daemon[2895]: accepted connection from pid 3498, user nixbot gitlab # [ 265.331483] gitaly[904]: time="2026-08-20T05:57:49.590Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:19.488" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:49.588" grpc.time_ms=1.192 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.392490] gitaly[904]: time="2026-08-20T05:57:49.651Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:59.148" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:49.638" grpc.time_ms=12.464 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.472393] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:49.730Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"88b52f588cfeb0c2466ff7fc","created_at":"2026-08-20T05:57:49.723Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-7084c6d407a84cbc","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:49.728Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-88b52f588cfeb0c2466ff7fc: start","job_status":"start","queue_duration_s":0.002119,"scheduling_latency_s":0.002174} gitlab # [ 265.485718] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 197 gitlab # [ 265.488188] nixbot[2684]: {"ts": "2026-08-20T05:57:49.746Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4eefe3a5d973311e706734a427b5e7ae88bcd95f \"HTTP/1.1 201 Created\""} gitlab # [ 265.533480] gitaly[904]: time="2026-08-20T05:57:49.792Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHHR2QNV8F0VKAC7V5MC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:19.690" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:49.791" grpc.time_ms=0.975 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.605856] gitaly[904]: time="2026-08-20T05:57:49.864Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYHHR2QNV8F0VKAC7V5MC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:59.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:49.858" grpc.time_ms=6.781 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.643230] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 149 gitlab # [ 265.644445] nixbot[2684]: {"ts": "2026-08-20T05:57:49.903Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4eefe3a5d973311e706734a427b5e7ae88bcd95f \"HTTP/1.1 201 Created\""} gitlab # [ 265.646836] gitaly[904]: time="2026-08-20T05:57:49.905Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:49.905" grpc.time_ms=0.324 pid=904 span.kind=server system=grpc gitlab # [ 265.683740] gitaly[904]: time="2026-08-20T05:57:49.942Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:49.941" grpc.time_ms=1.147 pid=904 span.kind=server system=grpc gitlab # [ 265.707436] gitaly[904]: time="2026-08-20T05:57:49.966Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHPWEZC9DKV1D2RF09RY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:19.865" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:49.965" grpc.time_ms=0.568 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.720725] gitaly[904]: time="2026-08-20T05:57:49.979Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:57:49.978" grpc.time_ms=1.7 pid=904 span.kind=server system=grpc gitlab # [ 265.732286] gitaly[904]: time="2026-08-20T05:57:49.991Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:19.855" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:49.856" operations="[repack_refs]" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.735505] gitaly[904]: time="2026-08-20T05:57:49.994Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYHPWEZC9DKV1D2RF09RY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:57:59.247" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:49.988" grpc.time_ms=6.508 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.738694] gitaly[904]: time="2026-08-20T05:57:49.997Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 diskcache=1926d0f9-3213-4ba5-892a-c77d6777c848 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:19.855" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:49.856" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.739392] gitaly[904]: time="2026-08-20T05:57:49.998Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=108 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7423 command.oublock=0 command.real_time_ms=134 command.spawn_token_fork_ms=0 command.system_time_ms=66 command.user_time_ms=42 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:19.855" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:49.856" grpc.time_ms=141.948 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.772554] gitaly[904]: time="2026-08-20T05:57:50.031Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:19.855" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:49.856" pid=904 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-20 05:56:45.030807105 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 265.783514] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4eefe3a5d973311e706734a427b5e7ae88bcd95f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 122 gitlab # [ 265.783840] nixbot[2684]: {"ts": "2026-08-20T05:57:50.039Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4eefe3a5d973311e706734a427b5e7ae88bcd95f \"HTTP/1.1 201 Created\""} gitlab # [ 265.795126] gitaly[904]: time="2026-08-20T05:57:50.054Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:19.855" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:49.856" pid=904 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 265.797732] gitaly[904]: time="2026-08-20T05:57:50.056Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:58:20.055" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:50.055" grpc.time_ms=0.764 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.816328] gitaly[904]: time="2026-08-20T05:57:50.075Z" level=info msg="optimized repository" clean_stale_data_time=22.248359ms clean_work_trees_time="93.867µs" commit_graph_time="3.911µs" correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.19µs" pid=904 prune_time="3.631µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="24.864µs" storage_name=default system=housekeeping total_time=43.352437ms gitlab # [ 265.822094] gitaly[904]: time="2026-08-20T05:57:50.075Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:58:19.855" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:57:49.856" pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.844295] gitaly[904]: time="2026-08-20T05:57:50.103Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYHBABQ96NAM1PK1F0RR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:20.102" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:50.102" grpc.time_ms=0.573 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 265.853459] nix-daemon[2895]: accepted connection from pid 3565, user nixbot gitlab # [ 265.864568] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.123Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f1f30ddccf7fa4dd2c88fd80","created_at":"2026-08-20T05:57:50.121Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"88b52f588cfeb0c2466ff7fc","job_size_bytes":3,"pid":2621,"job_status":"deduplicated","message":"PipelineProcessWorker JID-f1f30ddccf7fa4dd2c88fd80: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 265.877334] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.124Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"88b52f588cfeb0c2466ff7fc","created_at":"2026-08-20T05:57:49.723Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-7084c6d407a84cbc","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:49.728Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2621,"job_status":"rescheduled","message":"PipelineProcessWorker JID-88b52f588cfeb0c2466ff7fc: rescheduled"} gitlab # [ 265.877625] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.129Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"88b52f588cfeb0c2466ff7fc","created_at":"2026-08-20T05:57:49.723Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-7084c6d407a84cbc","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:49.728Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-88b52f588cfeb0c2466ff7fc: done: 0.398774 sec","job_status":"done","queue_duration_s":0.002119,"scheduling_latency_s":0.002174,"gitaly_calls":3,"gitaly_duration_s":0.164502,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015204,"redis_read_bytes":239,"redis_write_bytes":21784,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001651,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001125,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003681,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14469,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004361,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000341,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000355,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002039,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.029,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.032,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.139162,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.349215613,"duration_s":0.398774,"completed_at":"2026-08-20T05:57:50.129Z","load_balancing_strategy":"primary","db_duration_s":0.07925,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 265.915901] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.130Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e94b181270e42c8d4d9ec89e","created_at":"2026-08-20T05:57:49.846Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:49.849Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e94b181270e42c8d4d9ec89e: start","job_status":"start","queue_duration_s":0.281464,"scheduling_latency_s":0.28149} gitlab # [ 265.949416] gitaly[904]: time="2026-08-20T05:57:50.208Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVYHYK67M75GME0396EAXE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:50.201" grpc.time_ms=6.931 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 265.950482] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 45 gitlab # [ 265.992520] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.251Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e94b181270e42c8d4d9ec89e","created_at":"2026-08-20T05:57:49.846Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:49.849Z","job_size_bytes":23,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e94b181270e42c8d4d9ec89e: done: 0.120719 sec","job_status":"done","queue_duration_s":0.281464,"scheduling_latency_s":0.28149,"redis_calls":7,"redis_duration_s":0.001082,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.086,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.082,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.120719,"completed_at":"2026-08-20T05:57:50.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086056,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 266.001636] gitaly[904]: time="2026-08-20T05:57:50.260Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYJ02B36EF11F9RYNMJDY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:50.253" pid=904 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 266.002267] gitaly[904]: time="2026-08-20T05:57:50.260Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYJ02B36EF11F9RYNMJDY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:50.253" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 266.010708] gitaly[904]: time="2026-08-20T05:57:50.264Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYJ02B36EF11F9RYNMJDY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:57:50.253" grpc.time_ms=6.479 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 266.022567] gitlab-workhorse[825]: time="2026-08-20T05:57:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 266.023854] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 54 gitlab # [ 266.063615] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.322Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bf9d7785ce812a7ad8882f4c","created_at":"2026-08-20T05:57:50.005Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.008Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bf9d7785ce812a7ad8882f4c: start","job_status":"start","queue_duration_s":0.314398,"scheduling_latency_s":0.314431} gitlab # [ 266.073435] nix-daemon[2895]: accepted connection from pid 3590, user nixbot gitlab # [ 266.104709] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.363Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"bf9d7785ce812a7ad8882f4c","created_at":"2026-08-20T05:57:50.005Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.008Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-bf9d7785ce812a7ad8882f4c: done: 0.041209 sec","job_status":"done","queue_duration_s":0.314398,"scheduling_latency_s":0.314431,"redis_calls":7,"redis_duration_s":0.001636,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000394,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041209,"completed_at":"2026-08-20T05:57:50.363Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.105709] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.364Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2997e247c28a3663e2e51c2d","created_at":"2026-08-20T05:57:50.015Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.017Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2997e247c28a3663e2e51c2d: start","job_status":"start","queue_duration_s":0.347284,"scheduling_latency_s":0.347306} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4eefe3a5d973311e706734a427b5e7ae88bcd95f/statuses gitlab # [ 266.156350] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.415Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2997e247c28a3663e2e51c2d","created_at":"2026-08-20T05:57:50.015Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.017Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2997e247c28a3663e2e51c2d: done: 0.050406 sec","job_status":"done","queue_duration_s":0.347284,"scheduling_latency_s":0.347306,"redis_calls":7,"redis_duration_s":0.001264,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050406,"completed_at":"2026-08-20T05:57:50.415Z","load_balancing_strategy":"primary","db_duration_s":0.003066,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.191108] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.449Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"65d0ee2c765282d2f99cd9f0","created_at":"2026-08-20T05:57:50.022Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.023Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-65d0ee2c765282d2f99cd9f0: start","job_status":"start","queue_duration_s":0.426089,"scheduling_latency_s":0.426127} gitlab # [ 266.223868] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.482Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"65d0ee2c765282d2f99cd9f0","created_at":"2026-08-20T05:57:50.022Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.023Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-65d0ee2c765282d2f99cd9f0: done: 0.032977 sec","job_status":"done","queue_duration_s":0.426089,"scheduling_latency_s":0.426127,"redis_calls":10,"redis_duration_s":0.002509,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000735,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032977,"completed_at":"2026-08-20T05:57:50.482Z","load_balancing_strategy":"primary","db_duration_s":0.006837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.260439] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.519Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b41d7171b3fd6df0c746bdb8","created_at":"2026-08-20T05:57:50.024Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.025Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b41d7171b3fd6df0c746bdb8: start","job_status":"start","queue_duration_s":0.494116,"scheduling_latency_s":0.494145} gitlab # [ 266.282278] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.541Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b41d7171b3fd6df0c746bdb8","created_at":"2026-08-20T05:57:50.024Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.025Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b41d7171b3fd6df0c746bdb8: done: 0.021981 sec","job_status":"done","queue_duration_s":0.494116,"scheduling_latency_s":0.494145,"redis_calls":7,"redis_duration_s":0.001365,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000356,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021981,"completed_at":"2026-08-20T05:57:50.541Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.301662] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.542Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d6f59735755944420dfca27c","created_at":"2026-08-20T05:57:50.025Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.026Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d6f59735755944420dfca27c: start","job_status":"start","queue_duration_s":0.515596,"scheduling_latency_s":0.51561} gitlab # [ 266.308563] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.567Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d6f59735755944420dfca27c","created_at":"2026-08-20T05:57:50.025Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.026Z","job_size_bytes":19,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d6f59735755944420dfca27c: done: 0.02462 sec","job_status":"done","queue_duration_s":0.515596,"scheduling_latency_s":0.51561,"redis_calls":8,"redis_duration_s":0.0023109999999999997,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001687,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000624,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02462,"completed_at":"2026-08-20T05:57:50.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005565,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.349709] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.569Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e329dac847f60762df3d6b2a","created_at":"2026-08-20T05:57:50.027Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.028Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e329dac847f60762df3d6b2a: start","job_status":"start","queue_duration_s":0.540887,"scheduling_latency_s":0.54092} gitlab # [ 266.350584] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.592Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e329dac847f60762df3d6b2a","created_at":"2026-08-20T05:57:50.027Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.028Z","job_size_bytes":66,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e329dac847f60762df3d6b2a: done: 0.023309 sec","job_status":"done","queue_duration_s":0.540887,"scheduling_latency_s":0.54092,"redis_calls":7,"redis_duration_s":0.001827,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000555,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023309,"completed_at":"2026-08-20T05:57:50.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003686,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.409987] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.593Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"57789b1c2f72adc49b8d4375","created_at":"2026-08-20T05:57:50.029Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.030Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-57789b1c2f72adc49b8d4375: start","job_status":"start","queue_duration_s":0.563711,"scheduling_latency_s":0.563725} gitlab # [ 266.427733] gitaly[904]: time="2026-08-20T05:57:50.686Z" level=info msg="finished unary call with code OK" catfile.duration_ms=126 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=126 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVYJ7Z51297ZJFT2D2Z3GS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:58:20.457" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:57:50.558" grpc.time_ms=127.459 pid=904 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 266.439916] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.698Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"57789b1c2f72adc49b8d4375","created_at":"2026-08-20T05:57:50.029Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.030Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-57789b1c2f72adc49b8d4375: done: 0.104735 sec","job_status":"done","queue_duration_s":0.563711,"scheduling_latency_s":0.563725,"redis_calls":7,"redis_duration_s":0.002379,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001596,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000783,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.104735,"completed_at":"2026-08-20T05:57:50.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.476454] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.735Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"b8e905b0d6790b63693daee0","created_at":"2026-08-20T05:57:50.037Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:50.040Z","job_size_bytes":3,"pid":2621,"sidekiq_tid":"m82x","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-b8e905b0d6790b63693daee0: start","job_status":"start","queue_duration_s":0.694623,"scheduling_latency_s":0.694675} gitlab # [ 266.482883] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4eefe3a5d973311e706734a427b5e7ae88bcd95f/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 278 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4eefe3a5d973311e706734a427b5e7ae88bcd95f/statuses, in 0.33 seconds) (finished: subtest: eval and build post commit statuses, in 1.43 seconds) (finished: run the VM test script, in 323.62 seconds) test script finished in 323.65s cleanup kill QemuMachine (pid 46) gitlab # [ 266.525419] sidekiq-cluster[2621]: {"severity":"INFO","time":"2026-08-20T05:57:50.783Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"b8e905b0d6790b63693daee0","created_at":"2026-08-20T05:57:50.037Z","trace_propagation_headers":{"sentry-trace":"f369a6acfae94cb08a74c5524a00c650-9dc19d7c5ae14f41","baggage":"sentry-trace_id=f369a6acfae94cb08a74c5524a00c650,sentry-release=Unknown"},"correlation_id":"01M0EVYHBABQ96NAM1PK1F0RR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) gitlab # 0 (finished: cleanup, in 1.71 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T05:56:51.129Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '4eefe3a5d973311e706734a427b5e7ae88bcd95f', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T05:57:48.462791Z', 'started_at': '2026-08-20T05:57:49.159307Z', 'finished_at': None}] [{'id': 5, 'sha': '4eefe3a5d973311e706734a427b5e7ae88bcd95f', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T05:57:49.075Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '4eefe3a5d973311e706734a427b5e7ae88bcd95f', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-20T05:57:49.075Z', 'started_at': None, 'finished_at': '2026-08-20T05:57:49.712Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '4eefe3a5d973311e706734a427b5e7ae88bcd95f', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-20T05:57:49.882Z', 'started_at': None, 'finished_at': '2026-08-20T05:57:50.014Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]