tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab: QEMU running (pid 46) gitlab # Formatting '/build/vm-state-gitlab/tmp.AwcnbvzHNE', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes (finished: start all VMs, in 48.34 seconds) gitlab # Filesystem UUID: 5f4248af-ff31-4267-859a-94a4d72b7533 gitlab: waiting for unit setup-gitlab.service gitlab # Superblock backups stored on blocks: gitlab: waiting for the VM to finish booting gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/yhwv21vll9s8zfpzjrcbn5k5pp4bdafw-nixos-system-gitlab-test/init regInfo=/nix/store/v36kmawal5jsgwm7nsmicgnzgp09l5hg-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 468062527 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor gitlab # [ 0.000803] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000879] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002729] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002740] Using GB pages for direct mapping gitlab # [ 0.002848] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002857] ACPI: Early table checksum verification disabled gitlab # [ 0.002859] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002863] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002867] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002874] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002876] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002877] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002879] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002881] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002882] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002883] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002884] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002884] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002885] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002885] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003114] No NUMA configuration found gitlab # [ 0.003115] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003117] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff] gitlab # [ 0.005470] Zone ranges: gitlab # [ 0.005471] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005472] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005473] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005474] Device empty gitlab # [ 0.005475] Movable zone start for each node gitlab # [ 0.005476] Early memory node ranges gitlab # [ 0.005476] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005477] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005478] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005479] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005499] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005771] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.116428] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.116846] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.116860] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.116891] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.116894] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.116895] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.116897] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.116898] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.116898] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.116901] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.116902] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.116907] TSC deadline timer available gitlab # [ 0.116912] CPU topo: Max. logical packages: 1 gitlab # [ 0.116913] CPU topo: Max. logical dies: 1 gitlab # [ 0.116913] CPU topo: Max. dies per package: 1 gitlab # [ 0.116917] CPU topo: Max. threads per core: 1 gitlab # [ 0.116917] CPU topo: Num. cores per package: 4 gitlab # [ 0.116918] CPU topo: Num. threads per package: 4 gitlab # [ 0.116918] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.116941] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.116958] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.116960] kvm-guest: setup PV sched yield gitlab # [ 0.116975] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.116977] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.116978] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.116980] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.116981] Booting paravirtualized kernel on KVM gitlab # [ 0.116985] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.121435] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.123672] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.123717] kvm-guest: PV spinlocks enabled gitlab # [ 0.123719] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.123722] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/yhwv21vll9s8zfpzjrcbn5k5pp4bdafw-nixos-system-gitlab-test/init regInfo=/nix/store/v36kmawal5jsgwm7nsmicgnzgp09l5hg-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.123823] Unknown kernel command line parameters "regInfo=/nix/store/v36kmawal5jsgwm7nsmicgnzgp09l5hg-closure-info/registration", will be passed to user space. gitlab # [ 0.123836] random: crng init done gitlab # [ 0.123837] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.132868] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.137557] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.137630] software IO TLB: area num 4. gitlab # [ 0.213399] Fallback order for Node 0: 0 gitlab # [ 0.213407] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.213409] Policy zone: Normal gitlab # [ 0.215984] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.225597] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.239938] allocated 12582912 bytes of page_ext gitlab # [ 0.250036] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.250038] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.250901] Dynamic Preempt: lazy gitlab # [ 0.251068] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.251068] rcu: RCU event tracing is enabled. gitlab # [ 0.251069] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.251071] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.251071] Rude variant of Tasks RCU enabled. gitlab # [ 0.251072] Tracing variant of Tasks RCU enabled. gitlab # [ 0.251072] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.251073] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.251093] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.251095] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.251096] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.255499] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.255789] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.255797] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.255906] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.259488] Console: colour VGA+ 80x25 gitlab # [ 0.259491] printk: legacy console [tty0] enabled gitlab # [ 0.290386] printk: legacy console [ttyS0] enabled gitlab # [ 0.387901] ACPI: Core revision 20250807 gitlab # [ 0.388843] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.390327] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.391275] x2apic enabled gitlab # [ 0.392009] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.392900] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.394085] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.395489] kvm-guest: setup PV IPIs gitlab # [ 0.397024] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.398048] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.399746] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008) gitlab # [ 0.400829] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.402822] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.404744] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.405747] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.406744] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.407744] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.409526] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.410487] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.410744] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.412750] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.413509] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.414744] active return thunk: srso_alias_return_thunk gitlab # [ 0.415765] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.416744] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.417743] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.418744] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.419743] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.420743] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.422586] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.423744] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.424743] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.425744] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.426743] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.427743] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.428743] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.458806] Freeing SMP alternatives memory: 44K gitlab # [ 0.459601] pid_max: default: 32768 minimum: 301 gitlab # [ 0.460436] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.460847] landlock: Up and running. gitlab # [ 0.462213] Yama: becoming mindful. gitlab # [ 0.462954] LSM support for eBPF active gitlab # [ 0.463953] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.464901] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.467871] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.469373] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.469752] ... version: 2 gitlab # [ 0.470499] ... bit width: 48 gitlab # [ 0.470746] ... generic counters: 6 gitlab # [ 0.471486] ... generic bitmap: 000000000000003f gitlab # [ 0.471746] ... fixed-purpose counters: 0 gitlab # [ 0.472483] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.472746] ... value mask: 0000ffffffffffff gitlab # [ 0.473667] ... max period: 00007fffffffffff gitlab # [ 0.474459] ... global_ctrl mask: 000000000000003f gitlab # [ 0.474868] signal: max sigframe size: 3376 gitlab # [ 0.475664] rcu: Hierarchical SRCU implementation. gitlab # [ 0.476366] rcu: Max phase no-delay instances is 400. gitlab # [ 0.476932] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.482376] smp: Bringing up secondary CPUs ... gitlab # [ 0.483150] smpboot: x86: Booting SMP configuration: gitlab # [ 0.483749] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.486887] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.488454] smpboot: Total of 4 processors activated (19200.06 BogoMIPS) gitlab # [ 0.489027] Memory: 6011320K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved) gitlab # [ 0.490128] devtmpfs: initialized gitlab # [ 0.490918] x86/mm: Memory block size: 128MB gitlab # [ 0.493790] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.494832] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.495836] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.496987] PM: RTC time: 17:25:57, date: 2026-08-16 gitlab # [ 0.500785] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.503153] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.503798] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.505878] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.506760] audit: initializing netlink subsys (disabled) gitlab # [ 0.507772] audit: type=2000 audit(1786901158.599:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.508025] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.509747] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.510746] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.511736] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.512515] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.512762] cpuidle: using governor menu gitlab # [ 0.514977] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.515980] PCI: Using configuration type 1 for base access gitlab # [ 0.516747] PCI: Using configuration type 1 for extended access gitlab # [ 0.517863] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.524794] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.525748] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.526746] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.527747] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.532878] ACPI: Added _OSI(Module Device) gitlab # [ 0.534755] ACPI: Added _OSI(Processor Device) gitlab # [ 0.536753] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.543777] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.549010] ACPI: Interpreter enabled gitlab # [ 0.549765] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.550517] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.550770] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.551752] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.554568] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.568624] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.570773] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.575061] acpiphp: Slot [3] registered gitlab # [ 0.576808] acpiphp: Slot [4] registered gitlab # [ 0.578815] acpiphp: Slot [5] registered gitlab # [ 0.579800] acpiphp: Slot [6] registered gitlab # [ 0.581827] acpiphp: Slot [7] registered gitlab # [ 0.583802] acpiphp: Slot [8] registered gitlab # [ 0.584799] acpiphp: Slot [9] registered gitlab # [ 0.586822] acpiphp: Slot [10] registered gitlab # [ 0.588791] acpiphp: Slot [11] registered gitlab # [ 0.589789] acpiphp: Slot [12] registered gitlab # [ 0.590803] acpiphp: Slot [13] registered gitlab # [ 0.592808] acpiphp: Slot [14] registered gitlab # [ 0.593789] acpiphp: Slot [15] registered gitlab # [ 0.594788] acpiphp: Slot [16] registered gitlab # [ 0.595788] acpiphp: Slot [17] registered gitlab # [ 0.597804] acpiphp: Slot [18] registered gitlab # [ 0.598787] acpiphp: Slot [19] registered gitlab # [ 0.599788] acpiphp: Slot [20] registered gitlab # [ 0.601790] acpiphp: Slot [21] registered gitlab # [ 0.602807] acpiphp: Slot [22] registered gitlab # [ 0.603790] acpiphp: Slot [23] registered gitlab # [ 0.605768] acpiphp: Slot [24] registered gitlab # [ 0.606510] acpiphp: Slot [25] registered gitlab # [ 0.606767] acpiphp: Slot [26] registered gitlab # [ 0.607478] acpiphp: Slot [27] registered gitlab # [ 0.607766] acpiphp: Slot [28] registered gitlab # [ 0.608499] acpiphp: Slot [29] registered gitlab # [ 0.609768] acpiphp: Slot [30] registered gitlab # [ 0.610482] acpiphp: Slot [31] registered gitlab # [ 0.610759] PCI host bridge to bus 0000:00 gitlab # [ 0.611470] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.612747] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.613752] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.614747] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.616746] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.617813] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.620626] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.625040] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.629808] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.635820] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.638819] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.640752] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.642752] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.645753] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.648197] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.654926] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.659263] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.663410] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.666767] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.669186] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.687815] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.688760] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.689693] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.690867] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.694258] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.698765] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.699629] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.700524] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.712699] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.715135] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.718763] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.719613] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.720540] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.722915] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.727766] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.729754] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.730745] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.732992] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.735768] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.736664] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.737506] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.740963] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.744755] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.745618] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.746539] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.748931] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.752766] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.753683] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.754508] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.756941] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.762759] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.763673] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.764502] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.766690] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.769116] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.772760] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.773768] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.776983] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.779747] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.780637] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.781529] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.784561] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.788755] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.789640] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.790514] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.795874] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.796890] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.797880] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.798874] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.799819] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.802793] iommu: Default domain type: Translated gitlab # [ 0.803748] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.805038] ACPI: bus type USB registered gitlab # [ 0.805826] usbcore: registered new interface driver usbfs gitlab # [ 0.806761] usbcore: registered new interface driver hub gitlab # [ 0.807668] usbcore: registered new device driver usb gitlab # [ 0.809990] NetLabel: Initializing gitlab # [ 0.810636] NetLabel: domain hash size = 128 gitlab # [ 0.811309] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.812781] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.813720] PCI: Using ACPI for IRQ routing gitlab # [ 0.814947] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.815742] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.815742] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.817750] vgaarb: loaded gitlab # [ 0.818501] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.819746] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.824828] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.828173] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.828905] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.830504] pnp: PnP ACPI init gitlab # [ 0.831679] pnp: PnP ACPI: found 6 devices gitlab # [ 0.843009] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.846574] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.849090] NET: Registered PF_INET protocol family gitlab # [ 0.854076] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.889867] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.891339] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.892729] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.896573] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.897907] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.899143] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.900469] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.902096] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.903501] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.904455] NET: Registered PF_XDP protocol family gitlab # [ 0.905326] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 0.906358] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 0.907390] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 0.908510] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.909651] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.911020] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 0.912011] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 0.914440] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 0.916973] PCI: CLS 0 bytes, default 64 gitlab # [ 0.917716] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 0.918022] Trying to unpack rootfs image as initramfs... gitlab # [ 0.918805] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 0.921225] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.941680] Initialise system trusted keyrings gitlab # [ 0.943183] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 0.954776] Key type asymmetric registered gitlab # [ 0.955499] Asymmetric key parser 'x509' registered gitlab # [ 0.956389] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 0.958207] io scheduler mq-deadline registered gitlab # [ 0.959010] io scheduler kyber registered gitlab # [ 0.963313] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.964612] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 0.967090] Linux agpgart interface v0.103 gitlab # [ 0.967867] ACPI: bus type drm_connector registered gitlab # [ 0.970344] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.971437] usbserial: USB Serial support registered for generic gitlab # [ 0.972454] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 0.972454] Please enable it if your BIOS has the CPPC option. gitlab # [ 0.974743] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 0.976185] drop_monitor: Initializing network drop monitor service gitlab # [ 0.977391] NET: Registered PF_INET6 protocol family gitlab # [ 0.979082] Segment Routing with IPv6 gitlab # [ 0.979742] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.982287] IPI shorthand broadcast: enabled gitlab # [ 0.986722] sched_clock: Marking stable (850013527, 135946261)->(1007528171, -21568383) gitlab # [ 0.988540] registered taskstats version 1 gitlab # [ 0.989589] Loading compiled-in X.509 certificates gitlab # [ 0.999333] Demotion targets for Node 0: null gitlab # [ 1.000521] Key type .fscrypt registered gitlab # [ 1.001242] Key type fscrypt-provisioning registered gitlab # [ 1.002226] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 1.003171] ima: Allocated hash algorithm: sha1 gitlab # [ 1.003990] ima: No architecture policies found gitlab # [ 1.005044] PM: Magic number: 6:393:441 gitlab # [ 1.006663] RAS: Correctable Errors collector initialized. gitlab # [ 1.011187] clk: Disabling unused clocks gitlab # [ 1.011887] PM: genpd: Disabling unused power domains gitlab # [ 1.182374] Freeing initrd memory: 29392K gitlab # [ 1.186270] Freeing unused decrypted memory: 2028K gitlab # [ 1.189083] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.190160] Write protecting the kernel read-only data: 32768k gitlab # [ 1.192325] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.194037] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.245382] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.246497] Run /init as init process gitlab # [ 1.258455] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.282611] fuse: init (API version 7.45) gitlab # [ 1.290542] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.297347] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.300705] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.334652] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.671189] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.709320] systemd[1]: Detected virtualization kvm. gitlab # [ 1.711424] systemd[1]: Detected architecture x86-64. gitlab # [ 1.713438] systemd[1]: Running in initrd. gitlab # [ 1.715772] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.718577] systemd[1]: Hostname set to . gitlab # [ 1.828272] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.870686] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.880551] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.881695] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.883108] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.884261] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.885346] systemd[1]: Reached target Path Units. gitlab # [ 1.886228] systemd[1]: Reached target Slice Units. gitlab # [ 1.887096] systemd[1]: Reached target Swaps. gitlab # [ 1.887880] systemd[1]: Reached target Timer Units. gitlab # [ 1.888898] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.890125] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.891274] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.892280] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.893273] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.894216] systemd[1]: Reached target Socket Units. gitlab # [ 1.896161] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.898303] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.901702] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 1.914034] systemd[1]: Starting Journal Service... gitlab # [ 1.916261] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.917224] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.922104] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.925677] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.931665] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 1.939662] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 1.943605] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 1.949469] systemd-journald[93]: Collecting audit messages is disabled. gitlab # [ 1.958071] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.964792] netfs: FS-Cache loaded gitlab # [ 1.966520] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.971460] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.974759] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.977022] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.981336] 9pnet: Installing 9P2000 support gitlab # [ 1.986381] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.988378] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.990091] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.992514] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.994308] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.865044] systemd-modules-load[94]: Using 4 probe threads gitlab # [ 2.001334] systemd[1]: Started Journal Service. gitlab # [ 1.866342] systemd-modules-load[94]: Inserted module 'virtio_balloon' gitlab # [ 1.867687] systemd-modules-load[94]: Inserted module 'dm_mod' gitlab # [ 1.868595] systemd-modules-load[94]: Inserted module 'virtio_gpu' gitlab # [ 1.872409] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.874741] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.875666] systemd[1]: Reached target Local File Systems. gitlab # [ 1.876982] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.878747] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.893627] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.899554] systemd-udevd[113]: Using default interface naming scheme 'v261'. gitlab # [ 1.910058] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.922117] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 1.923119] systemd[1]: Reached target System Initialization. gitlab # [ 1.923853] systemd[1]: Reached target Basic System. gitlab # [ 2.151575] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.154516] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.156320] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.158120] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.159175] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.160058] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.160103] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.162245] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.163459] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.163536] virtio_blk virtio5: [vdb] 11830728 512-byte logical blocks (6.06 GB/5.64 GiB) gitlab # [ 2.163778] usb usb1: Product: UHCI Host Controller gitlab # [ 2.167017] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.167838] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.168869] hub 1-0:1.0: USB hub found gitlab # [ 2.169438] hub 1-0:1.0: 2 ports detected gitlab # [ 2.172723] SCSI subsystem initialized gitlab # [ 2.179157] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.185771] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.187120] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.231381] scsi host0: ata_piix gitlab # [ 2.233350] scsi host1: ata_piix gitlab # [ 2.234042] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.099334] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.235212] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.114332] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.117835] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.118686] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.120116] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.123964] systemd-vconsole-setup[147]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.129069] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.142221] systemd-fsck[156]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.145458] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.400160] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.400405] ata2: found unknown device (class 0) gitlab # [ 2.405339] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.409427] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.298711] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.436690] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.306168] (udev-worker)[129]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.310848] (udev-worker)[129]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.476272] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.503664] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.565936] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.568831] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.571336] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.572864] usb 1-1: Manufacturer: QEMU gitlab # [ 2.574285] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.605863] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.618733] usbcore: registered new interface driver usbhid gitlab # [ 2.620770] usbhid: USB HID core driver gitlab # [ 2.629895] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.633665] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.791154] systemd[1]: Mounting /sysroot... gitlab # [ 3.080771] EXT4-fs (vda): mounted filesystem 5f4248af-ff31-4267-859a-94a4d72b7533 r/w with ordered data mode. Quota mode: none. gitlab # [ 2.950710] systemd[1]: Mounted /sysroot. gitlab # [ 2.952391] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.954372] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.956265] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.958185] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.959835] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.961815] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.966395] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.118216] 9p: Installing v9fs 9p2000 file system support gitlab # [ 2.984314] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.985522] systemd[1]: Mounted /sysroot/run. gitlab # [ 2.990631] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.128285] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 2.992975] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.996921] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.998365] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.999797] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.001246] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.002789] systemd[1]: Reloading... gitlab # [ 3.055146] systemd[1]: Reloading finished in 57 ms. gitlab # [ 3.079468] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.082236] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.084542] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.086394] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace... gitlab # [ 3.088620] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.091658] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.095983] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.098236] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.101783] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.104055] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.791815] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.839617] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.841385] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.843221] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.845247] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.869353] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.871978] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.883280] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.885104] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.886955] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.918582] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.920511] systemd[1]: Stopped target Basic System. gitlab # [ 3.922175] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.923887] systemd[1]: Stopped target Path Units. gitlab # [ 3.925409] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.927665] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.930586] systemd[1]: Stopped target Slice Units. gitlab # [ 3.932513] systemd[1]: Stopped target Socket Units. gitlab # [ 3.935080] systemd[1]: Stopped target System Initialization. gitlab # [ 3.937241] systemd[1]: Stopped target Swaps. gitlab # [ 3.938809] systemd[1]: Stopped target Timer Units. gitlab # [ 3.940378] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.942393] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.944237] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.946479] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.948066] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 3.951697] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.953570] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.955494] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.956942] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.958806] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.960275] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.962357] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.964549] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.966419] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.967898] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.969268] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.970909] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.972623] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.973613] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.974818] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.976105] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.977326] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.978563] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.979698] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.980820] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.981995] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.983208] systemd[1]: Closed udev Control Socket. gitlab # [ 3.983957] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.984676] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.985654] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.986442] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.987443] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.988329] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.989270] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 3.990115] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.991045] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.992314] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 3.993275] systemd[1]: Finished Cleanup udev Database. gitlab # [ 3.994323] systemd[1]: Reached target Switch Root. gitlab # [ 3.995831] systemd[1]: Starting NixOS Activation... gitlab # [ 4.113680] initrd-nixos-activation-start[227]: booting system configuration /nix/store/yhwv21vll9s8zfpzjrcbn5k5pp4bdafw-nixos-system-gitlab-test gitlab # [ 4.161298] initrd-nixos-activation-start[227]: running activation script... gitlab # [ 4.420824] initrd-nixos-activation-start[250]: setting up /etc... gitlab # [ 4.536477] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.538915] systemd[1]: Finished NixOS Activation. gitlab # [ 4.540982] systemd[1]: Starting Switch Root... gitlab # [ 4.584715] systemd[1]: Switching root. gitlab # [ 4.777112] systemd-journald[93]: Received SIGTERM from PID 1 (systemd). gitlab # [ 4.896651] NET: Registered PF_VSOCK protocol family gitlab # [ 5.269025] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.278925] systemd[1]: Detected virtualization kvm. gitlab # [ 5.280729] systemd[1]: Detected architecture x86-64. gitlab # [ 5.282696] systemd[1]: Detected first boot. gitlab # [ 5.285184] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.428361] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.522476] systemd[1]: Applying preset policy. gitlab # [ 5.666307] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.783545] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.784814] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.787077] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.789055] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.790389] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.791790] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.792676] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.793809] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.794865] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.795824] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.796540] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.797337] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.798093] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.798913] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.799846] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.800731] systemd[1]: Reached target Path Units. gitlab # [ 5.801414] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.802196] systemd[1]: Reached target Slice Units. gitlab # [ 5.802894] systemd[1]: Reached target Swaps. gitlab # [ 5.804278] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.806172] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.807580] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.809134] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.810029] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.812343] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.813703] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.815591] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.816694] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.817799] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.819133] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.821852] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.822870] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.823800] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.827042] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.829003] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.830921] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 5.834023] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 5.846324] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 5.852404] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 5.861596] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 5.863778] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 5.867288] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.871023] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.904755] systemd[1]: Mounting FUSE Control File System... gitlab # [ 5.906486] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.914051] systemd[1]: Starting Journal Service... gitlab # [ 5.917565] systemd[1]: Starting Load Kernel Modules... gitlab # [ 5.920678] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 5.923053] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 5.923976] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.931035] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 5.933651] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 5.935648] systemd[1]: Mounted Huge Pages File System. gitlab # [ 5.936587] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 5.937523] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 5.938548] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 5.940012] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 5.941154] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 5.942577] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 5.943685] systemd[1]: Mounted FUSE Control File System. gitlab # [ 5.947048] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 5.951019] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 5.953322] EXT4-fs (vda): re-mounted 5f4248af-ff31-4267-859a-94a4d72b7533. gitlab # [ 5.958198] systemd-journald[321]: Collecting audit messages is enabled. gitlab # [ 5.959412] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 5.969137] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.970305] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 5.971249] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 5.973590] loop: module loaded gitlab # [ 5.842040] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 5.978567] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 5.843342] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.844850] s[ 5.980489] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # ystemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 5.982109] systemd[1]: Started Journal Service. gitlab # [ 5.847073] systemd-modules-load[322]: Using 3 probe threads gitlab # [ 5.848109] systemd-modules-load[322]: Inserted module 'tls' gitlab # [ 5.849193] systemd-modules-load[322]: Inserted module 'loop' gitlab # [ 5.850490] systemd[1]: Finished Load Kernel Modules. gitlab # [ 5.851707] systemd-oomd[323]: No swap; memory pressure usage will be degraded gitlab # [ 5.853274] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.854412] systemd[1]: Starting Firewall... gitlab # [ 5.858058] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.858964] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 5.867907] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 5.870797] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.008687] systemd-journald[321]: Received client request to flush runtime journal. gitlab # [ 5.908130] systemd[1]: Reached target First Boot Complete. gitlab # [ 5.909229] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 5.911396] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 5.912169] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 5.913040] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 5.913928] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 5.914853] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 5.926976] systemd-udevd[357]: Using default interface naming scheme 'v261'. gitlab # [ 5.953422] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 5.955559] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.028040] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 6.052397] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 6.085491] (udev-worker)[424]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 6.087433] (udev-worker)[424]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.097074] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 6.101316] (udev-worker)[417]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 6.105954] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 6.108336] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.109809] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.111783] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.115220] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.116444] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.118339] systemd[1]: Finished Firewall. gitlab # [ 6.264031] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 6.277547] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 6.279468] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 6.281181] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 6.283006] ACPI: button: Power Button [PWRF] gitlab # [ 6.293288] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 6.306487] Console: switching to colour dummy device 80x25 gitlab # [ 6.308031] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 6.308432] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 6.310191] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 6.310869] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 6.312616] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 6.312925] Floppy drive(s): gitlab # [ 6.313341] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 6.313766] fd0 is 2.88M AMI BIOS gitlab # [ 6.314699] mousedev: PS/2 mouse device common for all mice gitlab # [ 6.319806] rtc_cmos 00:05: registered as rtc0 gitlab # [ 6.320691] rtc_cmos 00:05: setting system clock to 2026-08-16T17:26:03 UTC (1786901163) gitlab # [ 6.321682] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 6.322872] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4 gitlab # [ 6.324741] systemd-journald[321]: Time jumped backwards, rotating. gitlab # [ 6.333494] FDC 0 is a S82078B gitlab # [ 6.343875] Console: switching to colour frame buffer device 160x50 gitlab # [ 6.346381] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 6.347209] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 gitlab # [ 6.349999] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 6.275598] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.295214] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.301574] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.313221] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.325384] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 6.326614] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 6.473162] ppdev: user-space parallel port driver gitlab # [ 6.338482] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.476784] kvm_amd: TSC scaling supported gitlab # [ 6.477252] kvm_amd: Nested Virtualization enabled gitlab # [ 6.477684] kvm_amd: Nested Paging enabled gitlab # [ 6.478103] kvm_amd: LBR virtualization supported gitlab # [ 6.478543] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.479019] kvm_amd: Virtual GIF supported gitlab # [ 6.479388] kvm_amd: Virtual NMI enabled gitlab # [ 6.513752] EDAC MC: Ver: 3.0.0 gitlab # [ 6.418379] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 6.420807] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.652422] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.674722] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.676460] systemd[1]: Reached target Local File Systems. gitlab # [ 6.678344] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.680856] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.683117] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.685166] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.688815] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.690956] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.729450] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.735284] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.737344] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.744237] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.747771] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.770617] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.783197] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.784668] systemd[1]: Starting Update is Completed... gitlab # [ 6.802383] systemd[1]: Finished Update is Completed. gitlab # [ 6.840866] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 6.841907] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.086686] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.088850] systemd[1]: Reached target System Initialization. gitlab # [ 7.090936] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.093333] systemd[1]: Started logrotate.timer. gitlab # [ 7.095105] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.097373] systemd[1]: Reached target Timer Units. gitlab # [ 7.099210] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.101413] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.103223] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.105165] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.107892] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.109928] systemd[1]: Reached target Socket Units. gitlab # [ 7.111803] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.162785] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.165785] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.168422] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.173538] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.188481] dbus-broker-launch[577]: Ready gitlab # [ 7.190966] systemd[1]: Reached target Basic System. gitlab # [ 7.193733] systemd[1]: Started backdoor.service. gitlab # [ 7.196246] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.199158] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.207142] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.211824] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.220189] systemd[1]: Starting Post-Boot Actions... gitlab # [ 7.224119] systemd[1]: Started Reset console on configuration changes. gitlab # [ 7.229607] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 7.234269] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 7.238196] logrotate[582]: note: 'monthly' overrides previously specified 'weekly' gitlab # connecting to host... gitlab # [ 7.242437] logrotate[582]: Reading state from file: /var/lib/logrotate.status gitlab # [ 7.243851] logrotate[582]: state file /var/lib/logrotate.status does not exist gitlab # [ 7.246770] logrotate[582]: Allocating hash table for state file, size 64 entries gitlab # [ 7.247830] logrotate[582]: Handling 4 logs gitlab # [ 7.249058] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.250929] logrotate[582]: considering log /var/log/btmp gitlab # [ 7.253412] logrotate[582]: Creating new state gitlab # [ 7.255071] logrotate[582]: Now: 2026-08-16 17:26 gitlab # [ 7.255628] logrotate[582]: Last rotated at 2026-08-16 17:00 gitlab # [ 7.257130] logrotate[582]: log does not need rotating (log has already been rotated) gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.257726] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 7.258910] logrotate[582]: considering log /var/log/wtmp gitlab # [ 7.261076] logrotate[582]: Creating new state gitlab: connected to guest root shell gitlab # [ 7.261632] logrotate[582]: Now: 2026-08-16 17:26 gitlab: (connecting took 7.88 seconds) gitlab # [ 7.263101] logrotate[582]: Last rotated at 2026-08-16 17:00 gitlab: (finished: waiting for the VM to finish booting, in 7.88 seconds) gitlab # [ 7.263605] logrotate[582]: log does not need rotating (log has already been rotated) gitlab # [ 7.264113] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 7.264477] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582) gitlab # [ 7.264935] logrotate[582]: considering log /var/gitlab/state/log/*.log gitlab # [ 7.265498] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 7.265940] logrotate[582]: Creating new state gitlab # [ 7.267522] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582) gitlab # [ 7.267947] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 7.268506] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582) gitlab # [ 7.268936] logrotate[582]: considering log /var/log/nginx/*.log gitlab # [ 7.269505] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 7.269925] logrotate[582]: Creating new state gitlab # [ 7.270917] logrotate[582]: not running postrotate script, since no logs were rotated gitlab # [ 7.271441] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582) gitlab # [ 7.272420] systemd[1]: Starting resolvconf update... gitlab # [ 7.273226] systemd[1]: Finished Logrotate configuration check. gitlab # [ 7.273775] systemd[1]: Finished Post-Boot Actions. gitlab # [ 7.274420] nsncd[583]: Aug 16 17:26:04.585 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.276166] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.276870] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.277681] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.278996] systemd[1]: Starting User Login Management... gitlab # [ 7.284890] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 7.314561] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 7.316421] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 7.317134] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 7.317757] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 7.318380] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 7.321368] systemd-logind[614]: New seat seat0. gitlab # [ 7.322147] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 7.322678] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 7.323269] systemd[1]: nscd.service: Consumed 22ms CPU time over 109ms wall clock time, 7.2M memory peak, 5.5M read from disk. gitlab # [ 7.327377] systemd-logind[614]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 7.328945] systemd-logind[614]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 7.329506] systemd-logind[614]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 7.329949] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 7.330935] systemd[1]: Started User Login Management. gitlab # [ 7.336901] systemd[1]: Starting linger-users.service... gitlab # [ 7.349307] nsncd[677]: Aug 16 17:26:04.664 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 7.349902] systemd[1]: Finished resolvconf update. gitlab # [ 7.351746] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 7.354342] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 7.355051] systemd[1]: Finished linger-users.service. gitlab # [ 7.357088] systemd[1]: Reached target Preparation for Network. gitlab # [ 7.357992] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 7.358971] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 7.359798] systemd[1]: Starting DHCP Client... gitlab # [ 7.361674] systemd[1]: Starting Address configuration of eth1... gitlab # [ 7.362736] systemd[1]: Starting Extra networking commands.... gitlab # [ 7.388480] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done gitlab # [ 7.392180] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done gitlab # [ 7.398575] systemd[1]: Finished Address configuration of eth1. gitlab # [ 7.421480] systemd[1]: Finished Extra networking commands.. gitlab # [ 7.422373] systemd[1]: Reached target Network. gitlab # [ 7.425237] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 7.426199] systemd[1]: Starting Nginx Web Server... gitlab # [ 7.428821] systemd[1]: Starting PostgreSQL Server... gitlab # [ 7.429718] dhcpcd[710]: dhcpcd-10.3.2 starting gitlab # [ 7.432244] dhcpcd[768]: dev: loaded udev gitlab # [ 7.434564] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 7.436258] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.574513] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.575391] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 7.454730] systemd[1]: Finished Permit User Sessions. gitlab # [ 7.457187] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 7.462888] systemd[1]: Started Getty on tty1. gitlab # [ 7.469728] systemd[1]: Reached target Login Prompts. gitlab # [ 7.668666] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.672396] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.673281] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.675037] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.675853] cfg80211: failed to load regulatory.db gitlab # [ 7.557632] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.558603] postgresql-pre-start[791]: This user must also own the server process. gitlab # [ 7.560465] nginx-pre-start[792]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.561242] nginx-pre-start[792]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.563027] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.563624] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.564078] postgresql-pre-start[791]: The default text search configuration will be set to "english". gitlab # [ 7.564486] postgresql-pre-start[791]: Data page checksums are enabled. gitlab # [ 7.565046] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.565462] postgresql-pre-start[791]: creating subdirectories ... ok gitlab # [ 7.565976] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.708261] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.574036] systemd[1]: Started Nginx Web Server. gitlab # [ 7.575190] dhcpcd[768]: eth0: waiting for carrier gitlab # [ 7.575753] dhcpcd[768]: eth0: carrier acquired gitlab # [ 7.581468] dhcpcd[768]: DUID 00:01:00:01:32:14:af:2c:52:54:00:12:34:56 gitlab # [ 7.581959] dhcpcd[768]: eth0: IAID 00:12:34:56 gitlab # [ 7.582663] dhcpcd[768]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.594847] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.599673] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.600542] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.601227] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started gitlab # [ 7.601617] redis-server[789]: Configuration loaded gitlab # [ 7.603279] redis[789]: monotonic clock: POSIX clock_gettime gitlab # [ 7.603959] redis[789]: Running mode=standalone, port=0. gitlab # [ 7.604725] postgresql-pre-start[791]: selecting default "max_connections" ... 100 gitlab # [ 7.605178] redis[789]: Server initialized gitlab # [ 7.605648] redis[789]: Ready to accept connections unix gitlab # [ 7.606177] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.639252] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB gitlab # [ 7.910398] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 8.038231] postgresql-pre-start[791]: selecting default time zone ... UTC gitlab # [ 8.040852] postgresql-pre-start[791]: creating configuration files ... ok gitlab # [ 8.094735] gitlab-workhorse[825]: time="2026-08-16T17:26:05Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 8.095130] gitlab-workhorse[825]: time="2026-08-16T17:26:05Z" level=info msg="Using redis/go-redis" gitlab # [ 8.095633] gitlab-workhorse[825]: time="2026-08-16T17:26:05Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 8.207233] postgresql-pre-start[791]: running bootstrap script ... ok gitlab # [ 8.608212] dhcpcd[768]: eth0: soliciting a DHCP lease gitlab # [ 8.756585] NET: Registered PF_PACKET protocol family gitlab # [ 8.628719] dhcpcd[768]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.631443] dhcpcd[768]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.654433] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok gitlab # [ 8.925283] postgresql-pre-start[791]: syncing data to disk ... ok gitlab # [ 8.927104] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 8.928124] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 8.929191] postgresql-pre-start[791]: Success. You can now start the database server using: gitlab # [ 8.930273] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 9.060694] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 9.062308] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 9.063423] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 9.069030] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 9.080511] postgres[864]: [864] LOG: database system was shut down at 2026-08-16 17:26:05 GMT gitlab # [ 9.087519] postgres[851]: [851] LOG: database system is ready to accept connections gitlab # [ 9.092335] systemd[1]: Started PostgreSQL Server. gitlab # [ 9.095619] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 9.218636] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[860]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 9.221812] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[860]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 9.283763] systemd[1]: Finished gitlab-config.service. gitlab # [ 9.285752] systemd[1]: Started gitaly.service. gitlab # [ 9.300216] postgresql-setup-start[876]: CREATE DATABASE gitlab # [ 9.324773] postgresql-setup-start[895]: CREATE ROLE gitlab # [ 9.334072] postgresql-setup-start[897]: ALTER DATABASE gitlab # [ 9.355939] postgresql-setup-start[902]: CREATE ROLE gitlab # [ 9.359667] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 9.360450] systemd[1]: Reached target PostgreSQL. gitlab # [ 9.362186] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 9.363534] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 9.451656] gitlab-postgresql-start[921]: CREATE DATABASE gitlab # [ 9.498077] gitlab-postgresql-start[931]: CREATE EXTENSION gitlab # [ 9.577350] gitlab-postgresql-start[934]: CREATE EXTENSION gitlab # [ 9.580278] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 9.687580] dhcpcd[768]: eth0: soliciting an IPv6 router gitlab # [ 9.689201] dhcpcd[768]: eth0: Router Advertisement from fe80::2 gitlab # [ 9.690455] dhcpcd[768]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 9.691471] dhcpcd[768]: eth0: adding route to fec0::/64 gitlab # [ 9.692946] dhcpcd[768]: eth0: adding default route via fe80::2 gitlab # [ 9.786554] gitaly[890]: time="2026-08-16T17:26:07.101Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=890 gitlab # [ 9.791080] gitaly[890]: time="2026-08-16T17:26:07.101Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=890 gitlab # [ 9.791732] gitaly[890]: time="2026-08-16T17:26:07.101Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=890 gitlab # [ 9.792201] gitaly[890]: time="2026-08-16T17:26:07.101Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=890 gitlab # [ 9.792843] gitaly[890]: time="2026-08-16T17:26:07.101Z" level=info msg="Starting Gitaly" pid=890 version= gitlab # [ 9.949536] gitaly[890]: time="2026-08-16T17:26:07.264Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=161 pid=890 gitlab # [ 9.950532] gitaly[890]: time="2026-08-16T17:26:07.264Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=890 gitlab # [ 9.952882] gitaly[890]: time="2026-08-16T17:26:07.268Z" level=info msg="finished initializing command factory" duration_ms=3 pid=890 gitlab # [ 9.953492] gitaly[890]: time="2026-08-16T17:26:07.268Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-890/git-exec-3837902647.d/git pid=890 gitlab # [ 9.959906] gitaly[890]: time="2026-08-16T17:26:07.275Z" level=info msg="finished detecting git version" duration_ms=6 pid=890 gitlab # [ 9.960499] gitaly[890]: time="2026-08-16T17:26:07.275Z" level=info msg="using Git version" pid=890 version=2.53.g gitlab # [ 9.962908] gitaly[890]: time="2026-08-16T17:26:07.278Z" level=info msg="clearing disk cache object folder" pid=890 storage=default gitlab # [ 9.964558] gitaly[890]: time="2026-08-16T17:26:07.279Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3938998511 pid=890 storage=default gitlab # [ 9.965208] gitaly[890]: time="2026-08-16T17:26:07.279Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3938998511 pid=890 storage=default gitlab # [ 9.969557] gitaly[890]: time="2026-08-16T17:26:07.279Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=890 gitlab # [ 9.970242] gitaly[890]: time="2026-08-16T17:26:07.284Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=890 gitlab # [ 9.974388] gitaly[890]: time="2026-08-16T17:26:07.280Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3938998511 clear_duration_ms=0 pid=890 storage=default gitlab # [ 10.012086] gitaly[890]: time="2026-08-16T17:26:07.326Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=890 gitlab # [ 10.012410] gitaly[890]: time="2026-08-16T17:26:07.326Z" level=info msg="finished tempdir cleaner walk" pid=890 storage=default time_ms=0 gitlab # [ 10.012914] gitaly[890]: time="2026-08-16T17:26:07.326Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=890 schema=unix gitlab # [ 10.013625] gitaly[890]: time="2026-08-16T17:26:07.327Z" level=info msg="listening at address" address=/run/gitaly/gitaly-890/sock.d/intern pid=890 schema=unix gitlab # [ 10.014171] gitaly[890]: time="2026-08-16T17:26:07.326Z" level=info msg="counting repositories" pid=890 gitlab # [ 10.014814] gitaly[890]: time="2026-08-16T17:26:07.327Z" level=info msg="starting to count repositories" pid=890 storage_path=/var/gitlab/state/repositories gitlab # [ 10.016407] gitaly[890]: time="2026-08-16T17:26:07.327Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=890 storage_path=/var/gitlab/state/repositories gitlab # [ 10.017047] gitaly[890]: time="2026-08-16T17:26:07.327Z" level=info msg="completed counting all repositories" counting_duration=0 pid=890 gitlab # [ 10.026773] gitaly[890]: time="2026-08-16T17:26:07.341Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=890 gitlab # [ 10.028480] gitaly[890]: time="2026-08-16T17:26:07.341Z" level=info msg="Started Gitaly" duration_ms=240 pid=890 gitlab # [ 10.029896] gitaly[890]: time="2026-08-16T17:26:07.342Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=890 gitlab # [ 10.031511] gitaly[890]: time="2026-08-16T17:26:07.342Z" level=info msg="maintenance: daily scheduled" pid=890 scheduled="2026-08-17 12:00:00 +0000 UTC" gitlab # [ 10.719554] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.720862] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 10.748117] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.926835] gitaly[890]: time="2026-08-16T17:26:09.241Z" level=info msg="License database preloaded" duration_ms=2139 pid=890 gitlab # [ 13.683910] dhcpcd[768]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.684962] dhcpcd[768]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.685840] dhcpcd[768]: eth0: adding default route via 10.0.2.2 gitlab # [ 13.802548] systemd[1]: Started DHCP Client. gitlab # [ 13.804267] systemd[1]: Reached target Network is Online. gitlab # [ 39.580484] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: W, [2026-08-16T17:26:36.894973 #914] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 41.515230] postgres[1299]: [1299] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 41.517315] postgres[1299]: [1299] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 41.518941] postgres[1299]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 41.521136] postgres[1299]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 41.522847] postgres[1299]: attidentity AS identity, gitlab # [ 41.524958] postgres[1299]: attgenerated as attgenerated gitlab # [ 41.527111] postgres[1299]: FROM pg_attribute a gitlab # [ 41.528448] postgres[1299]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 41.530261] postgres[1299]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 41.531939] postgres[1299]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 41.534097] postgres[1299]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 41.535798] postgres[1299]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 41.538280] postgres[1299]: ORDER BY a.attnum gitlab # [ 41.539998] postgres[1299]: gitlab # [ 44.787937] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1332]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 44.789437] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1332]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 48.144115] gitlab-workhorse[825]: time="2026-08-16T17:26:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 58.154436] gitlab-workhorse[825]: time="2026-08-16T17:26:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 59.266750] postgres[1398]: [1398] ERROR: relation "table_without_models" does not exist gitlab # [ 59.268259] postgres[1398]: [1398] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 68.163717] gitlab-workhorse[825]: time="2026-08-16T17:27:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 70.999771] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 71.001532] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 71.003595] systemd[1]: Starting gitlab.service... gitlab # [ 71.354107] bundle[1565]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 71.355358] bundle[1565]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 71.358602] bundle[1565]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 73.979702] sidekiq-cluster[1564]: {"severity":"INFO","time":"2026-08-16T17:27:11.278Z","message":"Starting cluster with 1 processes"} gitlab # [ 74.094785] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.391Z","pid":1565,"message":"* Enabling systemd notification integration"} gitlab # [ 74.095806] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"Puma starting in cluster mode..."} gitlab # [ 74.096721] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 74.097582] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 74.098149] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"* Min threads: 0"} gitlab # [ 74.098705] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"* Max threads: 4"} gitlab # [ 74.099550] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"* Environment: production"} gitlab # [ 74.100407] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"* Master PID: 1565"} gitlab # [ 74.101082] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"* Workers: 2"} gitlab # [ 74.101678] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 74.102565] bundle[1565]: {"timestamp":"2026-08-16T17:27:11.409Z","pid":1565,"message":"* Preloading application"} gitlab # [ 78.165349] gitlab-workhorse[825]: time="2026-08-16T17:27:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 88.174924] gitlab-workhorse[825]: time="2026-08-16T17:27:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 95.834824] bundle[1565]: W, [2026-08-16T17:27:33.148989 #1565] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 98.185070] gitlab-workhorse[825]: time="2026-08-16T17:27:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 98.409201] sidekiq-cluster[1595]: 2026-08-16T17:27:35.723Z pid=1595 tid=wib INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1595, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>437723136} gitlab # [ 98.574468] sidekiq-cluster[1595]: W, [2026-08-16T17:27:35.889511 #1595] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 98.641573] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:35.956Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 100.421278] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.735Z","message":"GitLab reliable fetch activated!"} gitlab # [ 100.424865] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.735Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 100.448406] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.763Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 100.452707] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.767Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 100.457663] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.772Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 100.462487] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.777Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 100.467528] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.782Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 100.472539] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.787Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 100.477166] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.792Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 100.480640] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.795Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 100.484734] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.799Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 100.488951] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.804Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 100.492489] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.807Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 100.497032] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.812Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 100.500512] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.815Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 100.504142] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.819Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 100.507229] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.822Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 100.510237] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.825Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 100.514455] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.829Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 100.518512] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.833Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 100.522369] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.837Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 100.526203] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.841Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 100.528712] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.843Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 100.530955] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.846Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 100.533035] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.848Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 100.535342] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.850Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 100.537283] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.852Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 100.539825] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.855Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 100.542350] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.857Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 100.544788] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.859Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 100.547184] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.862Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 100.549613] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.864Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 100.551924] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.867Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 100.554591] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.869Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 100.556847] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.872Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 100.559175] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.874Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 100.561254] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.876Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 100.563203] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.878Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 100.565463] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.880Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 100.567838] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.883Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 100.569834] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.885Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 100.571880] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.887Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 100.573964] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.889Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 100.575945] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.891Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 100.578026] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.893Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 100.579933] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.895Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 100.582388] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.897Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 100.584626] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.899Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 100.586575] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.901Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 100.588795] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.903Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 100.591230] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.906Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 100.627101] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.942Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 100.629811] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.944Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 100.634214] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.949Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 100.643265] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.958Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 100.645730] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.960Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 100.648580] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.963Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 100.650895] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.966Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 100.653617] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.968Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 100.656520] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.971Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 100.658427] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.973Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 100.660509] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.975Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 100.662758] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.977Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 100.664786] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.979Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 100.667556] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.982Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 100.670253] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.985Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 100.672511] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.987Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 100.675219] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.990Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 100.677113] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.992Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 100.679242] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.994Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 100.681104] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.996Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 100.683258] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:37.998Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 100.685096] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.000Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 100.686971] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.002Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 100.689071] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.004Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 100.690848] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.006Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 100.693364] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.008Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 100.695333] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.010Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 100.697472] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.012Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 100.699449] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.014Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 100.701436] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.016Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 100.703276] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.018Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 100.705089] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.020Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 100.707403] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.022Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 100.710238] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.024Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 100.712163] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.027Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 100.714347] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.029Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 100.716606] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.031Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 100.718813] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.034Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 100.720860] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.036Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 100.723274] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.038Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 100.725138] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.040Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 100.727440] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.042Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 100.729295] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.044Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 100.731467] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.046Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 100.733407] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.048Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 100.735825] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.051Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 100.738505] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.053Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 100.740431] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.055Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 100.742522] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.057Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 100.750198] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.065Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 100.752154] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.067Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 100.754348] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.069Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 100.757070] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.072Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 100.759641] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.074Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 100.762119] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.077Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 100.764568] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.079Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 100.766433] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.081Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 100.768616] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.083Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 100.771122] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.086Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 100.773080] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:27:38.088Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 108.194760] gitlab-workhorse[825]: time="2026-08-16T17:27:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 118.203550] gitlab-workhorse[825]: time="2026-08-16T17:27:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 123.762737] postgres[2024]: [2024] ERROR: relation "table_without_models" does not exist gitlab # [ 123.763534] postgres[2024]: [2024] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 125.747480] postgres[2035]: [2035] ERROR: relation "table_without_models" does not exist gitlab # [ 125.750092] postgres[2035]: [2035] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 126.280029] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:03.594Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 126.285673] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:03.600Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 126.287030] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:03.600Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 126.287707] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:03.600Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 126.298190] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:03.612Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 127.514723] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:04.829Z","message":"Cleaning working queues"} gitlab # [ 127.520080] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:04.834Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"dc29ed8728d11470b46b5f6f","created_at":"2026-08-16T17:27:07.974Z","trace_propagation_headers":{"sentry-trace":"185b3caa12f74d1a9d170289dc746d55-da5b8a150ac34e26","baggage":"sentry-trace_id=185b3caa12f74d1a9d170289dc746d55,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ddbf58e1418db13dbc7e0262a71051cf","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:27:07.982Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-dc29ed8728d11470b46b5f6f: start","job_status":"start","queue_duration_s":56.852038,"scheduling_latency_s":56.852107} gitlab # [ 127.737553] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:05.052Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"dc29ed8728d11470b46b5f6f","created_at":"2026-08-16T17:27:07.974Z","trace_propagation_headers":{"sentry-trace":"185b3caa12f74d1a9d170289dc746d55-da5b8a150ac34e26","baggage":"sentry-trace_id=185b3caa12f74d1a9d170289dc746d55,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ddbf58e1418db13dbc7e0262a71051cf","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:27:07.982Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-dc29ed8728d11470b46b5f6f: done: 0.217871 sec","job_status":"done","queue_duration_s":56.852038,"scheduling_latency_s":56.852107,"redis_calls":31,"redis_duration_s":0.009513,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.00576,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00225,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001503,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.087866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09798256500000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.217871,"completed_at":"2026-08-16T17:28:05.052Z","load_balancing_strategy":"primary","db_duration_s":0.061432,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 128.206415] gitlab-workhorse[825]: time="2026-08-16T17:28:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 128.481406] bundle[1565]: {"timestamp":"2026-08-16T17:28:05.795Z","pid":1565,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 128.483235] bundle[1565]: {"timestamp":"2026-08-16T17:28:05.795Z","pid":1565,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 128.484249] bundle[1565]: {"timestamp":"2026-08-16T17:28:05.795Z","pid":1565,"message":"! #\u003cThread:0x00007aabcfc01db8 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 128.485317] bundle[1565]: {"timestamp":"2026-08-16T17:28:05.795Z","pid":1565,"message":"! #\u003cThread:0x00007aabcfe83c80 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 128.486430] bundle[1565]: {"timestamp":"2026-08-16T17:28:05.795Z","pid":1565,"message":"Use Ctrl-C to stop"} gitlab # [ 128.487426] bundle[1565]: {"timestamp":"2026-08-16T17:28:05.796Z","pid":1565,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 128.803054] bundle[1565]: {"timestamp":"2026-08-16T17:28:06.117Z","pid":1565,"message":"- Worker 0 (PID: 2134) booted in 0.26s, phase: 0"} gitlab # [ 128.843336] bundle[1565]: {"timestamp":"2026-08-16T17:28:06.158Z","pid":1565,"message":"- Worker 1 (PID: 2138) booted in 0.28s, phase: 0"} gitlab # [ 128.849333] systemd[1]: Started gitlab.service. gitlab # [ 128.850052] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 128.852303] systemd[1]: Starting setup-gitlab.service... gitlab # [ 128.881930] setup-gitlab-start[2162]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 131.108054] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:28:08 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2197 gitlab # [ 131.111381] setup-gitlab-start[2162]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 131.112324] setup-gitlab-start[2162]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 131.127448] runuser[2185]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 131.512348] setup-gitlab-start[2186]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 131.516994] setup-gitlab-start[2186]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 131.521544] setup-gitlab-start[2186]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.073333] setup-gitlab-start[2186]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.075202] setup-gitlab-start[2186]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 132.076178] setup-gitlab-start[2186]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 141.424126] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:18.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3771aa6b3e5676c0634e68e6","created_at":"2026-08-16T17:28:18.708Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23d46cbec4dded82eab201add3ef2bb4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.735Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3771aa6b3e5676c0634e68e6: start","job_status":"start","queue_duration_s":0.002256,"scheduling_latency_s":0.002289} gitlab # [ 141.503967] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:18.818Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 141.528711] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:18.842Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3771aa6b3e5676c0634e68e6","created_at":"2026-08-16T17:28:18.708Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23d46cbec4dded82eab201add3ef2bb4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.735Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3771aa6b3e5676c0634e68e6: done: 0.10463 sec","job_status":"done","queue_duration_s":0.002256,"scheduling_latency_s":0.002289,"redis_calls":10,"redis_duration_s":0.018383,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001573,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003164,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002518197,"duration_s":0.10463,"completed_at":"2026-08-16T17:28:18.842Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.531488] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:18.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"97136a31a2d7840e1b39115f","created_at":"2026-08-16T17:28:18.776Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"025351057e21a1b085b68f2bc65fcda9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.792Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-97136a31a2d7840e1b39115f: start","job_status":"start","queue_duration_s":0.053494,"scheduling_latency_s":0.053537} gitlab # [ 141.585829] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:18.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"97136a31a2d7840e1b39115f","created_at":"2026-08-16T17:28:18.776Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"025351057e21a1b085b68f2bc65fcda9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.792Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-97136a31a2d7840e1b39115f: done: 0.033862 sec","job_status":"done","queue_duration_s":0.053494,"scheduling_latency_s":0.053537,"redis_calls":12,"redis_duration_s":0.004141,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001364,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000705,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000545041,"duration_s":0.033862,"completed_at":"2026-08-16T17:28:18.879Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.642969] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:18.957Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1d28545e33d678891a9a53e7","created_at":"2026-08-16T17:28:18.816Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"667fe2e3abf618e2063e27ca92e61bfc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.955Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1d28545e33d678891a9a53e7: start","job_status":"start","queue_duration_s":0.001868,"scheduling_latency_s":0.001913} gitlab # [ 141.686231] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.001Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 141.713380] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1d28545e33d678891a9a53e7","created_at":"2026-08-16T17:28:18.816Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"667fe2e3abf618e2063e27ca92e61bfc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.955Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1d28545e33d678891a9a53e7: done: 0.070202 sec","job_status":"done","queue_duration_s":0.001868,"scheduling_latency_s":0.001913,"redis_calls":10,"redis_duration_s":0.013658,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006357,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001057118,"duration_s":0.070202,"completed_at":"2026-08-16T17:28:19.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.732871] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.034Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"51b9ed1464d12fb9b6b2b393","created_at":"2026-08-16T17:28:18.974Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3de57f0b7f0d893b38f55fa7739669ed","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.987Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-51b9ed1464d12fb9b6b2b393: start","job_status":"start","queue_duration_s":0.046539,"scheduling_latency_s":0.046574} gitlab # [ 141.793166] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.107Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"51b9ed1464d12fb9b6b2b393","created_at":"2026-08-16T17:28:18.974Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3de57f0b7f0d893b38f55fa7739669ed","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.987Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-51b9ed1464d12fb9b6b2b393: done: 0.073759 sec","job_status":"done","queue_duration_s":0.046539,"scheduling_latency_s":0.046574,"redis_calls":10,"redis_duration_s":0.009022,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001971,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001363301,"duration_s":0.073759,"completed_at":"2026-08-16T17:28:19.107Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.822798] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"0bda577cbc7b0ed3d0ab8742","created_at":"2026-08-16T17:28:19.001Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbd7a64716d33e5196b77cc0bdda7c6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.019Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-0bda577cbc7b0ed3d0ab8742: start","job_status":"start","queue_duration_s":0.118593,"scheduling_latency_s":0.118612} gitlab # [ 141.833804] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.148Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 141.838819] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.153Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"0bda577cbc7b0ed3d0ab8742","created_at":"2026-08-16T17:28:19.001Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbd7a64716d33e5196b77cc0bdda7c6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.019Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-0bda577cbc7b0ed3d0ab8742: done: 0.015923 sec","job_status":"done","queue_duration_s":0.118593,"scheduling_latency_s":0.118612,"redis_calls":10,"redis_duration_s":0.002158,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000486,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342781,"duration_s":0.015923,"completed_at":"2026-08-16T17:28:19.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.840370] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"295c16f63cd18fd681484cdd","created_at":"2026-08-16T17:28:19.029Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a064c474fa0c7c95f079a0d9c183a18c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.046Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-295c16f63cd18fd681484cdd: start","job_status":"start","queue_duration_s":0.107914,"scheduling_latency_s":0.107927} gitlab # [ 141.883978] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"295c16f63cd18fd681484cdd","created_at":"2026-08-16T17:28:19.029Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a064c474fa0c7c95f079a0d9c183a18c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.046Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-295c16f63cd18fd681484cdd: done: 0.022602 sec","job_status":"done","queue_duration_s":0.107914,"scheduling_latency_s":0.107927,"redis_calls":12,"redis_duration_s":0.001652,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000627,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000351721,"exclusive_lock_hold_duration_s":0.005734806,"duration_s":0.022602,"completed_at":"2026-08-16T17:28:19.177Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.885351] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f04f72b734df02af9c5d6df2","created_at":"2026-08-16T17:28:19.085Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3697d815356ddca5b43b324f16c21bf9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.100Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f04f72b734df02af9c5d6df2: start","job_status":"start","queue_duration_s":0.077977,"scheduling_latency_s":0.077989} gitlab # [ 141.896580] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"f04f72b734df02af9c5d6df2","created_at":"2026-08-16T17:28:19.085Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3697d815356ddca5b43b324f16c21bf9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.100Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-f04f72b734df02af9c5d6df2: done: 0.014033 sec","job_status":"done","queue_duration_s":0.077977,"scheduling_latency_s":0.077989,"redis_calls":12,"redis_duration_s":0.001678,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000309536,"exclusive_lock_hold_duration_s":0.002764317,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.014033,"completed_at":"2026-08-16T17:28:19.192Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 141.972837] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bcf6979c8704e31060383d90","created_at":"2026-08-16T17:28:19.133Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.285Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bcf6979c8704e31060383d90: start","job_status":"start","queue_duration_s":0.001757,"scheduling_latency_s":0.001786} gitlab # [ 142.100407] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bcf6979c8704e31060383d90","created_at":"2026-08-16T17:28:19.133Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.285Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bcf6979c8704e31060383d90: done: 0.127393 sec","job_status":"done","queue_duration_s":0.001757,"scheduling_latency_s":0.001786,"redis_calls":19,"redis_duration_s":0.053434,"redis_read_bytes":21,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.013059,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00064,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.037358,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002377,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.009886732,"duration_s":0.127393,"completed_at":"2026-08-16T17:28:19.414Z","load_balancing_strategy":"primary","db_duration_s":0.005456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.166372] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"df26b090476f1577456eb708","created_at":"2026-08-16T17:28:19.328Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fc091dd9eada6650283aee5d7ff2760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.346Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-df26b090476f1577456eb708: start","job_status":"start","queue_duration_s":0.074637,"scheduling_latency_s":0.074672} gitlab # [ 142.194639] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"df26b090476f1577456eb708","created_at":"2026-08-16T17:28:19.328Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5fc091dd9eada6650283aee5d7ff2760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.346Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-df26b090476f1577456eb708: done: 0.088597 sec","job_status":"done","queue_duration_s":0.074637,"scheduling_latency_s":0.074672,"redis_calls":12,"redis_duration_s":0.015463999999999999,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000701,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006214,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008549,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00121468,"exclusive_lock_hold_duration_s":0.037992816000000006,"duration_s":0.088597,"completed_at":"2026-08-16T17:28:19.509Z","load_balancing_strategy":"primary","db_duration_s":0.040291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.213672] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"107f1ea54ef8e1e387be5371","created_at":"2026-08-16T17:28:19.364Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6d555ea42de54a101480a9874c60e11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.384Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-107f1ea54ef8e1e387be5371: start","job_status":"start","queue_duration_s":0.13167,"scheduling_latency_s":0.131687} gitlab # [ 142.277172] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"107f1ea54ef8e1e387be5371","created_at":"2026-08-16T17:28:19.364Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6d555ea42de54a101480a9874c60e11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.384Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-107f1ea54ef8e1e387be5371: done: 0.074287 sec","job_status":"done","queue_duration_s":0.13167,"scheduling_latency_s":0.131687,"redis_calls":10,"redis_duration_s":0.030336000000000002,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001504,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.026866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001966,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000685283,"duration_s":0.074287,"completed_at":"2026-08-16T17:28:19.590Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001129,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.283202] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.598Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"90d570ce5772cd5312f982b7","created_at":"2026-08-16T17:28:19.348Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-2e0b64304e4f4f1c","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.386Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-90d570ce5772cd5312f982b7: start","job_status":"start","queue_duration_s":0.211096,"scheduling_latency_s":0.211128} gitlab # [ 142.328073] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.643Z","message":"No existing merge request to be cleaned up."} gitlab # [ 142.342226] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.657Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"90d570ce5772cd5312f982b7","created_at":"2026-08-16T17:28:19.348Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-2e0b64304e4f4f1c","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.386Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-90d570ce5772cd5312f982b7: done: 0.059152 sec","job_status":"done","queue_duration_s":0.211096,"scheduling_latency_s":0.211128,"redis_calls":13,"redis_duration_s":0.008458,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00363,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003317,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000407593,"duration_s":0.059152,"completed_at":"2026-08-16T17:28:19.657Z","load_balancing_strategy":"primary","db_duration_s":0.005714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.361430] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.662Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c5b0b67d4b253f0c9394f975","created_at":"2026-08-16T17:28:19.348Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-2e0b64304e4f4f1c","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.386Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c5b0b67d4b253f0c9394f975: start","job_status":"start","queue_duration_s":0.275239,"scheduling_latency_s":0.275254} gitlab # [ 142.362027] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.669Z","message":"No existing merge request to be cleaned up."} gitlab # [ 142.362427] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.674Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c5b0b67d4b253f0c9394f975","created_at":"2026-08-16T17:28:19.348Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-2e0b64304e4f4f1c","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.386Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c5b0b67d4b253f0c9394f975: done: 0.012768 sec","job_status":"done","queue_duration_s":0.275239,"scheduling_latency_s":0.275254,"redis_calls":10,"redis_duration_s":0.001434,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000869,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012768,"completed_at":"2026-08-16T17:28:19.674Z","load_balancing_strategy":"primary","db_duration_s":0.001358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.417896] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.732Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2528833280d4f6e334726d20","created_at":"2026-08-16T17:28:19.348Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-2e0b64304e4f4f1c","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.386Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2528833280d4f6e334726d20: start","job_status":"start","queue_duration_s":0.34593,"scheduling_latency_s":0.345956} gitlab # [ 142.472355] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.787Z","message":"No existing merge request to be cleaned up."} gitlab # [ 142.505792] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.820Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2528833280d4f6e334726d20","created_at":"2026-08-16T17:28:19.348Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-2e0b64304e4f4f1c","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.386Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2528833280d4f6e334726d20: done: 0.087452 sec","job_status":"done","queue_duration_s":0.34593,"scheduling_latency_s":0.345956,"redis_calls":10,"redis_duration_s":0.02487,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.020558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004312,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.087452,"completed_at":"2026-08-16T17:28:19.820Z","load_balancing_strategy":"primary","db_duration_s":0.009003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.542738] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.830Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"981520226e3bd80caafb4029","created_at":"2026-08-16T17:28:19.348Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-2e0b64304e4f4f1c","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.386Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-981520226e3bd80caafb4029: start","job_status":"start","queue_duration_s":0.443333,"scheduling_latency_s":0.443428} gitlab # [ 142.543644] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.846Z","message":"No existing merge request to be cleaned up."} gitlab # [ 142.546336] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.860Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"981520226e3bd80caafb4029","created_at":"2026-08-16T17:28:19.348Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-2e0b64304e4f4f1c","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"5882f189ff5f320fb90188a7bfd4aecb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.386Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-981520226e3bd80caafb4029: done: 0.029862 sec","job_status":"done","queue_duration_s":0.443333,"scheduling_latency_s":0.443428,"redis_calls":10,"redis_duration_s":0.0022630000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001302,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029862,"completed_at":"2026-08-16T17:28:19.860Z","load_balancing_strategy":"primary","db_duration_s":0.001997,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.561508] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.862Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3e3b745eda49a203015c2b77","created_at":"2026-08-16T17:28:19.402Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"a9c778fb9086f6eb38e10d48168501a1","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.419Z","job_size_bytes":3,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3e3b745eda49a203015c2b77: start","job_status":"start","queue_duration_s":0.443294,"scheduling_latency_s":0.443317} gitlab # [ 142.615855] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.930Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"3e3b745eda49a203015c2b77","created_at":"2026-08-16T17:28:19.402Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"a9c778fb9086f6eb38e10d48168501a1","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.419Z","job_size_bytes":3,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-3e3b745eda49a203015c2b77: done: 0.06779 sec","job_status":"done","queue_duration_s":0.443294,"scheduling_latency_s":0.443317,"redis_calls":10,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000358,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021567,"duration_s":0.06779,"completed_at":"2026-08-16T17:28:19.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.651461] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0e2d1a739e18ab89985a187f","created_at":"2026-08-16T17:28:19.440Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a26fec9fdc9072b25c9cef1a88a1c0d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.466Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0e2d1a739e18ab89985a187f: start","job_status":"start","queue_duration_s":0.499849,"scheduling_latency_s":0.49988} gitlab # [ 142.681960] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:19.996Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 142.695085] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"0e2d1a739e18ab89985a187f","created_at":"2026-08-16T17:28:19.440Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3a26fec9fdc9072b25c9cef1a88a1c0d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.466Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-0e2d1a739e18ab89985a187f: done: 0.043058 sec","job_status":"done","queue_duration_s":0.499849,"scheduling_latency_s":0.49988,"redis_calls":10,"redis_duration_s":0.003567,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000527,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002505,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000535,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000386642,"duration_s":0.043058,"completed_at":"2026-08-16T17:28:20.009Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 142.730727] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"92f0716e9cba55d830e57455","created_at":"2026-08-16T17:28:19.491Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"741a9f332d90214f64cffe44590ebc5c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.501Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-92f0716e9cba55d830e57455: start","job_status":"start","queue_duration_s":0.544148,"scheduling_latency_s":0.544187} gitlab # [ 142.863420] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"92f0716e9cba55d830e57455","created_at":"2026-08-16T17:28:19.491Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"741a9f332d90214f64cffe44590ebc5c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.501Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-92f0716e9cba55d830e57455: done: 0.132572 sec","job_status":"done","queue_duration_s":0.544148,"scheduling_latency_s":0.544187,"redis_calls":12,"redis_duration_s":0.0033629999999999997,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001204,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000663492,"exclusive_lock_hold_duration_s":0.106763569,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.132572,"completed_at":"2026-08-16T17:28:20.177Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014312,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null} gitlab # [ 142.933159] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"37b27a9b6303d17df4859236","created_at":"2026-08-16T17:28:19.516Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7565fb4aeca58b0074c712f365c90aa3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:28:19.537Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-37b27a9b6303d17df4859236: start","job_status":"start","queue_duration_s":0.710229,"scheduling_latency_s":0.710257} gitlab # [ 142.959765] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.274Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 142.973214] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"37b27a9b6303d17df4859236","created_at":"2026-08-16T17:28:19.516Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7565fb4aeca58b0074c712f365c90aa3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:28:19.537Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-37b27a9b6303d17df4859236: done: 0.039761 sec","job_status":"done","queue_duration_s":0.710229,"scheduling_latency_s":0.710257,"redis_calls":10,"redis_duration_s":0.0038269999999999997,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00039,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002936,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000393067,"duration_s":0.039761,"completed_at":"2026-08-16T17:28:20.287Z","load_balancing_strategy":"primary","db_duration_s":0.00094,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.007958] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.322Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ce86018c0064b946b79f96fb","created_at":"2026-08-16T17:28:19.544Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a49cb35f7b95f9b11882eca43380a4e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.551Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ce86018c0064b946b79f96fb: start","job_status":"start","queue_duration_s":0.770534,"scheduling_latency_s":0.770573} gitlab # [ 143.079494] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.393Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ce86018c0064b946b79f96fb","created_at":"2026-08-16T17:28:19.544Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a49cb35f7b95f9b11882eca43380a4e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.551Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ce86018c0064b946b79f96fb: done: 0.07153 sec","job_status":"done","queue_duration_s":0.770534,"scheduling_latency_s":0.770573,"redis_calls":16,"redis_duration_s":0.004851,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.00231,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001895,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000646,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000793676,"duration_s":0.07153,"completed_at":"2026-08-16T17:28:20.393Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.081920] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"635ecdce4ece54e86bbb7757","created_at":"2026-08-16T17:28:19.558Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"607808ae9ef6490bee61383401310884","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.572Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-635ecdce4ece54e86bbb7757: start","job_status":"start","queue_duration_s":0.824207,"scheduling_latency_s":0.824242} gitlab # [ 143.259910] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"635ecdce4ece54e86bbb7757","created_at":"2026-08-16T17:28:19.558Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"607808ae9ef6490bee61383401310884","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.572Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-635ecdce4ece54e86bbb7757: done: 0.17827 sec","job_status":"done","queue_duration_s":0.824207,"scheduling_latency_s":0.824242,"redis_calls":14,"redis_duration_s":0.004686,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001621,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001578,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001487,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000724673,"exclusive_lock_hold_duration_s":0.14863453399999998,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.17827,"completed_at":"2026-08-16T17:28:20.574Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.307367] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b76f74451bc9d47d512cd21b","created_at":"2026-08-16T17:28:19.594Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b675dda1e1a1cd8bcf15f0d8503eb934","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:28:19.613Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b76f74451bc9d47d512cd21b: start","job_status":"start","queue_duration_s":0.962823,"scheduling_latency_s":0.962836} gitlab # [ 143.308806] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.584Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 143.309653] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b76f74451bc9d47d512cd21b","created_at":"2026-08-16T17:28:19.594Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b675dda1e1a1cd8bcf15f0d8503eb934","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:28:19.613Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b76f74451bc9d47d512cd21b: done: 0.013344 sec","job_status":"done","queue_duration_s":0.962823,"scheduling_latency_s":0.962836,"redis_calls":10,"redis_duration_s":0.0020930000000000002,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256458,"duration_s":0.013344,"completed_at":"2026-08-16T17:28:20.589Z","load_balancing_strategy":"primary","db_duration_s":0.000481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.379483] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"bf9ce65397d57d628591bbfe","created_at":"2026-08-16T17:28:19.615Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11937116032ad6aaa81b77afe1f2f34f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.621Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-bf9ce65397d57d628591bbfe: start","job_status":"start","queue_duration_s":0.968818,"scheduling_latency_s":0.968831} gitlab # [ 143.529480] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.843Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"bf9ce65397d57d628591bbfe","created_at":"2026-08-16T17:28:19.615Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11937116032ad6aaa81b77afe1f2f34f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.621Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-bf9ce65397d57d628591bbfe: done: 0.252967 sec","job_status":"done","queue_duration_s":0.968818,"scheduling_latency_s":0.968831,"redis_calls":565,"redis_duration_s":0.08038,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001172,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.07879,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.196995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000288305,"duration_s":0.252967,"completed_at":"2026-08-16T17:28:20.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.599308] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.844Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a6d9622a2c6a2d0e79d3fa51","created_at":"2026-08-16T17:28:19.628Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85e4b3716bdb83a473129b5c419fb82c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.633Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a6d9622a2c6a2d0e79d3fa51: start","job_status":"start","queue_duration_s":1.211201,"scheduling_latency_s":1.211215} gitlab # [ 143.610935] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a6d9622a2c6a2d0e79d3fa51","created_at":"2026-08-16T17:28:19.628Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"85e4b3716bdb83a473129b5c419fb82c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.633Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a6d9622a2c6a2d0e79d3fa51: done: 0.071831 sec","job_status":"done","queue_duration_s":1.211201,"scheduling_latency_s":1.211215,"redis_calls":10,"redis_duration_s":0.002063,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000268191,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.071831,"completed_at":"2026-08-16T17:28:20.916Z","load_balancing_strategy":"primary","db_duration_s":0.012732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.644869] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"95ce431207a824df384e8b62","created_at":"2026-08-16T17:28:19.635Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0094413a9c77b718d4f14afa6c26256","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:28:19.640Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-95ce431207a824df384e8b62: start","job_status":"start","queue_duration_s":1.276949,"scheduling_latency_s":1.276964} gitlab # [ 143.655642] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.937Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"95ce431207a824df384e8b62","created_at":"2026-08-16T17:28:19.635Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0094413a9c77b718d4f14afa6c26256","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:28:19.640Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-95ce431207a824df384e8b62: done: 0.019965 sec","job_status":"done","queue_duration_s":1.276949,"scheduling_latency_s":1.276964,"redis_calls":10,"redis_duration_s":0.001668,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000345,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225447,"duration_s":0.019965,"completed_at":"2026-08-16T17:28:20.937Z","load_balancing_strategy":"primary","db_duration_s":0.002556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.674298] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.938Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f34848d5bd68339f4ddc6dd1","created_at":"2026-08-16T17:28:19.645Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5402ce56a5a2f4a82c01e9272ca1d5d4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.652Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f34848d5bd68339f4ddc6dd1: start","job_status":"start","queue_duration_s":1.28575,"scheduling_latency_s":1.285762} gitlab # [ 143.674873] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f34848d5bd68339f4ddc6dd1","created_at":"2026-08-16T17:28:19.645Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5402ce56a5a2f4a82c01e9272ca1d5d4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.652Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f34848d5bd68339f4ddc6dd1: done: 0.020757 sec","job_status":"done","queue_duration_s":1.28575,"scheduling_latency_s":1.285762,"redis_calls":12,"redis_duration_s":0.00167,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000667,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000351162,"exclusive_lock_hold_duration_s":0.006497194,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.020757,"completed_at":"2026-08-16T17:28:20.959Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005694,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.715084] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.960Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"422bd108b2e95ecf71bda34c","created_at":"2026-08-16T17:28:19.659Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d422dd8a57c83165a2bcce9d3c7c062","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.675Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-422bd108b2e95ecf71bda34c: start","job_status":"start","queue_duration_s":1.284544,"scheduling_latency_s":1.284557} gitlab # [ 143.715707] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.971Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"422bd108b2e95ecf71bda34c","created_at":"2026-08-16T17:28:19.659Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d422dd8a57c83165a2bcce9d3c7c062","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.675Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-422bd108b2e95ecf71bda34c: done: 0.011422 sec","job_status":"done","queue_duration_s":1.284544,"scheduling_latency_s":1.284557,"redis_calls":12,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000279,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195835,"duration_s":0.011422,"completed_at":"2026-08-16T17:28:20.971Z","load_balancing_strategy":"primary","db_duration_s":0.000241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.752029] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.972Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3e88f53d13315c3a012a9693","created_at":"2026-08-16T17:28:19.740Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59570f134bf7ea5e1f8d79f9a2dd9b26","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.756Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3e88f53d13315c3a012a9693: start","job_status":"start","queue_duration_s":1.21618,"scheduling_latency_s":1.216192} gitlab # [ 143.754675] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3e88f53d13315c3a012a9693","created_at":"2026-08-16T17:28:19.740Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59570f134bf7ea5e1f8d79f9a2dd9b26","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.756Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3e88f53d13315c3a012a9693: done: 0.017135 sec","job_status":"done","queue_duration_s":1.21618,"scheduling_latency_s":1.216192,"redis_calls":13,"redis_duration_s":0.001651,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000829,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005397055,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.017135,"completed_at":"2026-08-16T17:28:20.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001364,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 143.794099] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:20.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d56ca5cc19e65ec041bb0e1b","created_at":"2026-08-16T17:28:19.776Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99016369e938d0a70f8a92dddeccecea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.786Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d56ca5cc19e65ec041bb0e1b: start","job_status":"start","queue_duration_s":1.204191,"scheduling_latency_s":1.204203} gitlab # [ 143.884693] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.198Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d56ca5cc19e65ec041bb0e1b","created_at":"2026-08-16T17:28:19.776Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99016369e938d0a70f8a92dddeccecea","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.786Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d56ca5cc19e65ec041bb0e1b: done: 0.208285 sec","job_status":"done","queue_duration_s":1.204191,"scheduling_latency_s":1.204203,"redis_calls":14,"redis_duration_s":0.003764,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001243,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00131,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001211,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.167,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.157,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000853181,"exclusive_lock_hold_duration_s":0.026091584,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.208285,"completed_at":"2026-08-16T17:28:21.198Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.168085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 143.922809] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ef1530e9f40fbef6d0882e92","created_at":"2026-08-16T17:28:19.812Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.821Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ef1530e9f40fbef6d0882e92: start","job_status":"start","queue_duration_s":1.415559,"scheduling_latency_s":1.415607} gitlab # [ 144.050134] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ef1530e9f40fbef6d0882e92","created_at":"2026-08-16T17:28:19.812Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.821Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ef1530e9f40fbef6d0882e92: done: 0.127636 sec","job_status":"done","queue_duration_s":1.415559,"scheduling_latency_s":1.415607,"redis_calls":71,"redis_duration_s":0.019481000000000002,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002171,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.00103,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.015412,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028132,"duration_s":0.127636,"completed_at":"2026-08-16T17:28:21.364Z","load_balancing_strategy":"primary","db_duration_s":0.003214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.121988] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c63ff4158028666bc8bc436c","created_at":"2026-08-16T17:28:19.827Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88688379c6804738595d87d6735dad65","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.863Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c63ff4158028666bc8bc436c: start","job_status":"start","queue_duration_s":1.572689,"scheduling_latency_s":1.572727} gitlab # [ 144.170684] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c63ff4158028666bc8bc436c","created_at":"2026-08-16T17:28:19.827Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-a52d39ba7a474c0d","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"88688379c6804738595d87d6735dad65","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:19.863Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c63ff4158028666bc8bc436c: done: 0.048417 sec","job_status":"done","queue_duration_s":1.572689,"scheduling_latency_s":1.572727,"redis_calls":10,"redis_duration_s":0.0034449999999999997,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000654,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000541,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000581917,"duration_s":0.048417,"completed_at":"2026-08-16T17:28:21.484Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.175093] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22446e676b54d02373e8a8fd","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22446e676b54d02373e8a8fd: start","job_status":"start","queue_duration_s":0.132198,"scheduling_latency_s":0.132233} gitlab # [ 144.220238] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22446e676b54d02373e8a8fd","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22446e676b54d02373e8a8fd: done: 0.032322 sec","job_status":"done","queue_duration_s":0.132198,"scheduling_latency_s":0.132233,"redis_calls":16,"redis_duration_s":0.006286,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000648,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002762,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000898439,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032322,"completed_at":"2026-08-16T17:28:21.522Z","load_balancing_strategy":"primary","db_duration_s":0.000752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.223898] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b3a544148aa35b05bc87eb1","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b3a544148aa35b05bc87eb1: start","job_status":"start","queue_duration_s":0.165567,"scheduling_latency_s":0.165581} gitlab # [ 144.234215] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b3a544148aa35b05bc87eb1","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b3a544148aa35b05bc87eb1: done: 0.010196 sec","job_status":"done","queue_duration_s":0.165567,"scheduling_latency_s":0.165581,"redis_calls":13,"redis_duration_s":0.002516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010196,"completed_at":"2026-08-16T17:28:21.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.286037] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49d020f44bb3a30134128ffb","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49d020f44bb3a30134128ffb: start","job_status":"start","queue_duration_s":0.177095,"scheduling_latency_s":0.177108} gitlab # [ 144.286735] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49d020f44bb3a30134128ffb","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49d020f44bb3a30134128ffb: done: 0.020424 sec","job_status":"done","queue_duration_s":0.177095,"scheduling_latency_s":0.177108,"redis_calls":13,"redis_duration_s":0.009381,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006444,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020424,"completed_at":"2026-08-16T17:28:21.555Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.308886] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3340b0d001368a956da78093","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3340b0d001368a956da78093: start","job_status":"start","queue_duration_s":0.201054,"scheduling_latency_s":0.201069} gitlab # [ 144.319022] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3340b0d001368a956da78093","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3340b0d001368a956da78093: done: 0.012203 sec","job_status":"done","queue_duration_s":0.201054,"scheduling_latency_s":0.201069,"redis_calls":13,"redis_duration_s":0.003626,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012203,"completed_at":"2026-08-16T17:28:21.570Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.366250] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bc9e6922e8f434c9e3acf14","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bc9e6922e8f434c9e3acf14: start","job_status":"start","queue_duration_s":0.214365,"scheduling_latency_s":0.214379} gitlab # [ 144.366846] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bc9e6922e8f434c9e3acf14","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bc9e6922e8f434c9e3acf14: done: 0.010026 sec","job_status":"done","queue_duration_s":0.214365,"scheduling_latency_s":0.214379,"redis_calls":13,"redis_duration_s":0.0024159999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001671,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010026,"completed_at":"2026-08-16T17:28:21.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.391515] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a6b567bc4d12ac616b09a82","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a6b567bc4d12ac616b09a82: start","job_status":"start","queue_duration_s":0.225437,"scheduling_latency_s":0.22545} gitlab # [ 144.429161] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a6b567bc4d12ac616b09a82","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a6b567bc4d12ac616b09a82: done: 0.010174 sec","job_status":"done","queue_duration_s":0.225437,"scheduling_latency_s":0.22545,"redis_calls":13,"redis_duration_s":0.002576,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001782,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010174,"completed_at":"2026-08-16T17:28:21.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.432460] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8452f9a2e487237abbd594f","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8452f9a2e487237abbd594f: start","job_status":"start","queue_duration_s":0.236939,"scheduling_latency_s":0.236953} gitlab # [ 144.442499] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8452f9a2e487237abbd594f","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8452f9a2e487237abbd594f: done: 0.020988 sec","job_status":"done","queue_duration_s":0.236939,"scheduling_latency_s":0.236953,"redis_calls":13,"redis_duration_s":0.005581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004456,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020988,"completed_at":"2026-08-16T17:28:21.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.478671] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"761b95a971955e74729b7edf","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-761b95a971955e74729b7edf: start","job_status":"start","queue_duration_s":0.259768,"scheduling_latency_s":0.259799} gitlab # [ 144.483485] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"761b95a971955e74729b7edf","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-761b95a971955e74729b7edf: done: 0.013228 sec","job_status":"done","queue_duration_s":0.259768,"scheduling_latency_s":0.259799,"redis_calls":13,"redis_duration_s":0.002196,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001451,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013228,"completed_at":"2026-08-16T17:28:21.630Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.515527] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd07ac1c7c9415b2b839ab42","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd07ac1c7c9415b2b839ab42: start","job_status":"start","queue_duration_s":0.273736,"scheduling_latency_s":0.273749} gitlab # [ 144.552627] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd07ac1c7c9415b2b839ab42","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd07ac1c7c9415b2b839ab42: done: 0.009463 sec","job_status":"done","queue_duration_s":0.273736,"scheduling_latency_s":0.273749,"redis_calls":13,"redis_duration_s":0.001686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009463,"completed_at":"2026-08-16T17:28:21.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.559200] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d8357d00b8c6a4c1023ebf5","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d8357d00b8c6a4c1023ebf5: start","job_status":"start","queue_duration_s":0.284003,"scheduling_latency_s":0.284016} gitlab # [ 144.569579] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d8357d00b8c6a4c1023ebf5","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d8357d00b8c6a4c1023ebf5: done: 0.009317 sec","job_status":"done","queue_duration_s":0.284003,"scheduling_latency_s":0.284016,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009317,"completed_at":"2026-08-16T17:28:21.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.599609] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f416139a23aa0b1aa433f9e","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f416139a23aa0b1aa433f9e: start","job_status":"start","queue_duration_s":0.294588,"scheduling_latency_s":0.294601} gitlab # [ 144.611694] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f416139a23aa0b1aa433f9e","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f416139a23aa0b1aa433f9e: done: 0.009366 sec","job_status":"done","queue_duration_s":0.294588,"scheduling_latency_s":0.294601,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009366,"completed_at":"2026-08-16T17:28:21.661Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.656575] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42344bf607193d008dd64506","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42344bf607193d008dd64506: start","job_status":"start","queue_duration_s":0.304775,"scheduling_latency_s":0.304788} gitlab # [ 144.657208] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42344bf607193d008dd64506","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42344bf607193d008dd64506: done: 0.009307 sec","job_status":"done","queue_duration_s":0.304775,"scheduling_latency_s":0.304788,"redis_calls":13,"redis_duration_s":0.001594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009307,"completed_at":"2026-08-16T17:28:21.671Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.679043] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e04d8481a16e251705965c2","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e04d8481a16e251705965c2: start","job_status":"start","queue_duration_s":0.3149,"scheduling_latency_s":0.314913} gitlab # [ 144.689193] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e04d8481a16e251705965c2","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e04d8481a16e251705965c2: done: 0.009213 sec","job_status":"done","queue_duration_s":0.3149,"scheduling_latency_s":0.314913,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009213,"completed_at":"2026-08-16T17:28:21.681Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.728653] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0a69aa5cba2d66843e68d54","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0a69aa5cba2d66843e68d54: start","job_status":"start","queue_duration_s":0.325251,"scheduling_latency_s":0.325264} gitlab # [ 144.729763] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0a69aa5cba2d66843e68d54","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0a69aa5cba2d66843e68d54: done: 0.00891 sec","job_status":"done","queue_duration_s":0.325251,"scheduling_latency_s":0.325264,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00891,"completed_at":"2026-08-16T17:28:21.691Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.786127] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b0a7e8d10ffbaa007664a23","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b0a7e8d10ffbaa007664a23: start","job_status":"start","queue_duration_s":0.335111,"scheduling_latency_s":0.335124} gitlab # [ 144.786764] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b0a7e8d10ffbaa007664a23","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b0a7e8d10ffbaa007664a23: done: 0.008861 sec","job_status":"done","queue_duration_s":0.335111,"scheduling_latency_s":0.335124,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008861,"completed_at":"2026-08-16T17:28:21.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.834886] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34b73d6effe6d12d57494211","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34b73d6effe6d12d57494211: start","job_status":"start","queue_duration_s":0.344788,"scheduling_latency_s":0.3448} gitlab # [ 144.835565] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34b73d6effe6d12d57494211","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34b73d6effe6d12d57494211: done: 0.008899 sec","job_status":"done","queue_duration_s":0.344788,"scheduling_latency_s":0.3448,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008899,"completed_at":"2026-08-16T17:28:21.711Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.872253] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e17f5ddfc6494d88a9543a45","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e17f5ddfc6494d88a9543a45: start","job_status":"start","queue_duration_s":0.354511,"scheduling_latency_s":0.354525} gitlab # [ 144.872917] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e17f5ddfc6494d88a9543a45","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e17f5ddfc6494d88a9543a45: done: 0.009078 sec","job_status":"done","queue_duration_s":0.354511,"scheduling_latency_s":0.354525,"redis_calls":13,"redis_duration_s":0.001573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009078,"completed_at":"2026-08-16T17:28:21.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.882914] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1c27b16841be7c2e6430d5d","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1c27b16841be7c2e6430d5d: start","job_status":"start","queue_duration_s":0.364558,"scheduling_latency_s":0.364571} gitlab # [ 144.892898] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1c27b16841be7c2e6430d5d","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1c27b16841be7c2e6430d5d: done: 0.008987 sec","job_status":"done","queue_duration_s":0.364558,"scheduling_latency_s":0.364571,"redis_calls":13,"redis_duration_s":0.001553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008987,"completed_at":"2026-08-16T17:28:21.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.944876] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0afb0475f9b1b9cb0354ff8","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0afb0475f9b1b9cb0354ff8: start","job_status":"start","queue_duration_s":0.374372,"scheduling_latency_s":0.374385} gitlab # [ 144.945567] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0afb0475f9b1b9cb0354ff8","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0afb0475f9b1b9cb0354ff8: done: 0.009084 sec","job_status":"done","queue_duration_s":0.374372,"scheduling_latency_s":0.374385,"redis_calls":13,"redis_duration_s":0.001738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009084,"completed_at":"2026-08-16T17:28:21.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 144.994089] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0741c7d6cf1366cbfaab7a46","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0741c7d6cf1366cbfaab7a46: start","job_status":"start","queue_duration_s":0.384284,"scheduling_latency_s":0.384298} gitlab # [ 144.994718] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0741c7d6cf1366cbfaab7a46","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0741c7d6cf1366cbfaab7a46: done: 0.009019 sec","job_status":"done","queue_duration_s":0.384284,"scheduling_latency_s":0.384298,"redis_calls":13,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009019,"completed_at":"2026-08-16T17:28:21.750Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.005852] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62a6f019222394445bc0b8b8","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62a6f019222394445bc0b8b8: start","job_status":"start","queue_duration_s":0.394145,"scheduling_latency_s":0.394158} gitlab # [ 145.042698] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62a6f019222394445bc0b8b8","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62a6f019222394445bc0b8b8: done: 0.008911 sec","job_status":"done","queue_duration_s":0.394145,"scheduling_latency_s":0.394158,"redis_calls":13,"redis_duration_s":0.001584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008911,"completed_at":"2026-08-16T17:28:21.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.046482] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad4762249dc95238e5008266","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad4762249dc95238e5008266: start","job_status":"start","queue_duration_s":0.404026,"scheduling_latency_s":0.404039} gitlab # [ 145.088638] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad4762249dc95238e5008266","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad4762249dc95238e5008266: done: 0.008944 sec","job_status":"done","queue_duration_s":0.404026,"scheduling_latency_s":0.404039,"redis_calls":13,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008944,"completed_at":"2026-08-16T17:28:21.770Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.089491] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37cb220b99ab3951aef3e93e","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37cb220b99ab3951aef3e93e: start","job_status":"start","queue_duration_s":0.413915,"scheduling_latency_s":0.413928} gitlab # [ 145.097090] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37cb220b99ab3951aef3e93e","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37cb220b99ab3951aef3e93e: done: 0.008969 sec","job_status":"done","queue_duration_s":0.413915,"scheduling_latency_s":0.413928,"redis_calls":13,"redis_duration_s":0.001573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008969,"completed_at":"2026-08-16T17:28:21.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.157637] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48ae79448f19f2e352e83ec8","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48ae79448f19f2e352e83ec8: start","job_status":"start","queue_duration_s":0.423817,"scheduling_latency_s":0.42383} gitlab # [ 145.158402] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48ae79448f19f2e352e83ec8","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48ae79448f19f2e352e83ec8: done: 0.008842 sec","job_status":"done","queue_duration_s":0.423817,"scheduling_latency_s":0.42383,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000481,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008842,"completed_at":"2026-08-16T17:28:21.790Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.168705] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"951e889c79f20670fd4b2e71","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-951e889c79f20670fd4b2e71: start","job_status":"start","queue_duration_s":0.433484,"scheduling_latency_s":0.433497} gitlab # [ 145.211802] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"951e889c79f20670fd4b2e71","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-951e889c79f20670fd4b2e71: done: 0.01974 sec","job_status":"done","queue_duration_s":0.433484,"scheduling_latency_s":0.433497,"redis_calls":13,"redis_duration_s":0.012008,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002319,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009689,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01974,"completed_at":"2026-08-16T17:28:21.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.212769] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04380a663aa2d89f04ac27d8","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04380a663aa2d89f04ac27d8: start","job_status":"start","queue_duration_s":0.455919,"scheduling_latency_s":0.455934} gitlab # [ 145.219408] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04380a663aa2d89f04ac27d8","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04380a663aa2d89f04ac27d8: done: 0.011715 sec","job_status":"done","queue_duration_s":0.455919,"scheduling_latency_s":0.455934,"redis_calls":13,"redis_duration_s":0.003084,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001525,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011715,"completed_at":"2026-08-16T17:28:21.825Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.266870] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d49f345764f0c7c0c7d8a22","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d49f345764f0c7c0c7d8a22: start","job_status":"start","queue_duration_s":0.468494,"scheduling_latency_s":0.468507} gitlab # [ 145.267664] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d49f345764f0c7c0c7d8a22","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d49f345764f0c7c0c7d8a22: done: 0.009079 sec","job_status":"done","queue_duration_s":0.468494,"scheduling_latency_s":0.468507,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009079,"completed_at":"2026-08-16T17:28:21.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.303780] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2c83e00a4315ce49d7c8168","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2c83e00a4315ce49d7c8168: start","job_status":"start","queue_duration_s":0.478444,"scheduling_latency_s":0.478458} gitlab # [ 145.304495] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2c83e00a4315ce49d7c8168","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2c83e00a4315ce49d7c8168: done: 0.009197 sec","job_status":"done","queue_duration_s":0.478444,"scheduling_latency_s":0.478458,"redis_calls":13,"redis_duration_s":0.001725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009197,"completed_at":"2026-08-16T17:28:21.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.348090] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a20ea163ef66ba455f7b0c20","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a20ea163ef66ba455f7b0c20: start","job_status":"start","queue_duration_s":0.488467,"scheduling_latency_s":0.48848} gitlab # [ 145.348734] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a20ea163ef66ba455f7b0c20","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a20ea163ef66ba455f7b0c20: done: 0.008946 sec","job_status":"done","queue_duration_s":0.488467,"scheduling_latency_s":0.48848,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008946,"completed_at":"2026-08-16T17:28:21.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.372260] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4cbc0c5a09cdaaa428c9500","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4cbc0c5a09cdaaa428c9500: start","job_status":"start","queue_duration_s":0.498242,"scheduling_latency_s":0.498255} gitlab # [ 145.382445] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4cbc0c5a09cdaaa428c9500","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4cbc0c5a09cdaaa428c9500: done: 0.008891 sec","job_status":"done","queue_duration_s":0.498242,"scheduling_latency_s":0.498255,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008891,"completed_at":"2026-08-16T17:28:21.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.425987] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"177b1b558da5d344fba61e6b","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-177b1b558da5d344fba61e6b: start","job_status":"start","queue_duration_s":0.508087,"scheduling_latency_s":0.5081} gitlab # [ 145.426641] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"177b1b558da5d344fba61e6b","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-177b1b558da5d344fba61e6b: done: 0.018755 sec","job_status":"done","queue_duration_s":0.508087,"scheduling_latency_s":0.5081,"redis_calls":13,"redis_duration_s":0.0072640000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018755,"completed_at":"2026-08-16T17:28:21.884Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.481754] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd06dd41f38b6b7cc6b4cf36","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd06dd41f38b6b7cc6b4cf36: start","job_status":"start","queue_duration_s":0.528849,"scheduling_latency_s":0.528863} gitlab # [ 145.482448] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd06dd41f38b6b7cc6b4cf36","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd06dd41f38b6b7cc6b4cf36: done: 0.018254 sec","job_status":"done","queue_duration_s":0.528849,"scheduling_latency_s":0.528863,"redis_calls":13,"redis_duration_s":0.009713,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002341,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007372,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018254,"completed_at":"2026-08-16T17:28:21.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.519694] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff9d6b34f5bf7e08eedcab37","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff9d6b34f5bf7e08eedcab37: start","job_status":"start","queue_duration_s":0.549884,"scheduling_latency_s":0.549899} gitlab # [ 145.520510] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff9d6b34f5bf7e08eedcab37","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff9d6b34f5bf7e08eedcab37: done: 0.015193 sec","job_status":"done","queue_duration_s":0.549884,"scheduling_latency_s":0.549899,"redis_calls":13,"redis_duration_s":0.006599000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004491,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015193,"completed_at":"2026-08-16T17:28:21.922Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.535521] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26d0104b0078f565a4d00f5e","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26d0104b0078f565a4d00f5e: start","job_status":"start","queue_duration_s":0.56628,"scheduling_latency_s":0.566294} gitlab # [ 145.545609] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26d0104b0078f565a4d00f5e","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26d0104b0078f565a4d00f5e: done: 0.017088 sec","job_status":"done","queue_duration_s":0.56628,"scheduling_latency_s":0.566294,"redis_calls":13,"redis_duration_s":0.008894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007322,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017088,"completed_at":"2026-08-16T17:28:21.940Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.587507] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"140df343412552a8b17ad570","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-140df343412552a8b17ad570: start","job_status":"start","queue_duration_s":0.584234,"scheduling_latency_s":0.584248} gitlab # [ 145.588111] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"140df343412552a8b17ad570","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-140df343412552a8b17ad570: done: 0.008876 sec","job_status":"done","queue_duration_s":0.584234,"scheduling_latency_s":0.584248,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008876,"completed_at":"2026-08-16T17:28:21.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.630939] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdbafd831f1fb29249d3c179","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdbafd831f1fb29249d3c179: start","job_status":"start","queue_duration_s":0.593964,"scheduling_latency_s":0.593985} gitlab # [ 145.631599] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdbafd831f1fb29249d3c179","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdbafd831f1fb29249d3c179: done: 0.008812 sec","job_status":"done","queue_duration_s":0.593964,"scheduling_latency_s":0.593985,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008812,"completed_at":"2026-08-16T17:28:21.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.679866] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"248ec8548a9e2c6bf625ad00","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-248ec8548a9e2c6bf625ad00: start","job_status":"start","queue_duration_s":0.603593,"scheduling_latency_s":0.603606} gitlab # [ 145.680607] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"248ec8548a9e2c6bf625ad00","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-248ec8548a9e2c6bf625ad00: done: 0.008779 sec","job_status":"done","queue_duration_s":0.603593,"scheduling_latency_s":0.603606,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000479,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008779,"completed_at":"2026-08-16T17:28:21.969Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.727624] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"116b8c5e9cb7145ef0d75726","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-116b8c5e9cb7145ef0d75726: start","job_status":"start","queue_duration_s":0.613343,"scheduling_latency_s":0.613356} gitlab # [ 145.728432] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"116b8c5e9cb7145ef0d75726","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-116b8c5e9cb7145ef0d75726: done: 0.017959 sec","job_status":"done","queue_duration_s":0.613343,"scheduling_latency_s":0.613356,"redis_calls":13,"redis_duration_s":0.010199,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002354,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017959,"completed_at":"2026-08-16T17:28:21.988Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.738737] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:21.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da0564e9d319340a8cde7fdf","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da0564e9d319340a8cde7fdf: start","job_status":"start","queue_duration_s":0.634861,"scheduling_latency_s":0.634876} gitlab # [ 145.748678] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da0564e9d319340a8cde7fdf","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da0564e9d319340a8cde7fdf: done: 0.017346 sec","job_status":"done","queue_duration_s":0.634861,"scheduling_latency_s":0.634876,"redis_calls":13,"redis_duration_s":0.008838,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002343,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006495,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017346,"completed_at":"2026-08-16T17:28:22.009Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.800253] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7c6447a1ed018a7f7d78142","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7c6447a1ed018a7f7d78142: start","job_status":"start","queue_duration_s":0.653127,"scheduling_latency_s":0.653141} gitlab # [ 145.800925] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7c6447a1ed018a7f7d78142","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7c6447a1ed018a7f7d78142: done: 0.008855 sec","job_status":"done","queue_duration_s":0.653127,"scheduling_latency_s":0.653141,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000484,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008855,"completed_at":"2026-08-16T17:28:22.019Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.843569] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7ea0c9cd97a3e08bfe76efb","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7ea0c9cd97a3e08bfe76efb: start","job_status":"start","queue_duration_s":0.662777,"scheduling_latency_s":0.662789} gitlab # [ 145.844197] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7ea0c9cd97a3e08bfe76efb","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7ea0c9cd97a3e08bfe76efb: done: 0.008783 sec","job_status":"done","queue_duration_s":0.662777,"scheduling_latency_s":0.662789,"redis_calls":13,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000468,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.008783,"completed_at":"2026-08-16T17:28:22.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.878558] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ca0ea25f2e9d7e06a36fd73","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ca0ea25f2e9d7e06a36fd73: start","job_status":"start","queue_duration_s":0.672827,"scheduling_latency_s":0.67284} gitlab # [ 145.879168] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ca0ea25f2e9d7e06a36fd73","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ca0ea25f2e9d7e06a36fd73: done: 0.009505 sec","job_status":"done","queue_duration_s":0.672827,"scheduling_latency_s":0.67284,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000474,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009505,"completed_at":"2026-08-16T17:28:22.039Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.928856] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d830527fa2dc9bf2a17823fe","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d830527fa2dc9bf2a17823fe: start","job_status":"start","queue_duration_s":0.68356,"scheduling_latency_s":0.683574} gitlab # [ 145.929552] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d830527fa2dc9bf2a17823fe","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d830527fa2dc9bf2a17823fe: done: 0.009856 sec","job_status":"done","queue_duration_s":0.68356,"scheduling_latency_s":0.683574,"redis_calls":13,"redis_duration_s":0.001693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009856,"completed_at":"2026-08-16T17:28:22.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 145.942241] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41a51537554a7f8929b8102c","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41a51537554a7f8929b8102c: start","job_status":"start","queue_duration_s":0.694534,"scheduling_latency_s":0.694547} gitlab # [ 145.952191] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41a51537554a7f8929b8102c","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41a51537554a7f8929b8102c: done: 0.00987 sec","job_status":"done","queue_duration_s":0.694534,"scheduling_latency_s":0.694547,"redis_calls":13,"redis_duration_s":0.0015760000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00987,"completed_at":"2026-08-16T17:28:22.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.011845] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bcc0b727fcd36fa71abfdc9","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bcc0b727fcd36fa71abfdc9: start","job_status":"start","queue_duration_s":0.705533,"scheduling_latency_s":0.705545} gitlab # [ 146.012580] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bcc0b727fcd36fa71abfdc9","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bcc0b727fcd36fa71abfdc9: done: 0.009551 sec","job_status":"done","queue_duration_s":0.705533,"scheduling_latency_s":0.705545,"redis_calls":13,"redis_duration_s":0.001778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009551,"completed_at":"2026-08-16T17:28:22.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.024599] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ddbeccf3ec875fff9cf6209","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ddbeccf3ec875fff9cf6209: start","job_status":"start","queue_duration_s":0.715921,"scheduling_latency_s":0.715934} gitlab # [ 146.064624] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ddbeccf3ec875fff9cf6209","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ddbeccf3ec875fff9cf6209: done: 0.009894 sec","job_status":"done","queue_duration_s":0.715921,"scheduling_latency_s":0.715934,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009894,"completed_at":"2026-08-16T17:28:22.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.065568] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"038e79e79727a7a7716192d1","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-038e79e79727a7a7716192d1: start","job_status":"start","queue_duration_s":0.726779,"scheduling_latency_s":0.726792} gitlab # [ 146.074881] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"038e79e79727a7a7716192d1","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-038e79e79727a7a7716192d1: done: 0.009857 sec","job_status":"done","queue_duration_s":0.726779,"scheduling_latency_s":0.726792,"redis_calls":13,"redis_duration_s":0.001795,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009857,"completed_at":"2026-08-16T17:28:22.094Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.113967] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75a1ae0f08d92fef1ad1521","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75a1ae0f08d92fef1ad1521: start","job_status":"start","queue_duration_s":0.73744,"scheduling_latency_s":0.737454} gitlab # [ 146.115507] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e75a1ae0f08d92fef1ad1521","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e75a1ae0f08d92fef1ad1521: done: 0.015946 sec","job_status":"done","queue_duration_s":0.73744,"scheduling_latency_s":0.737454,"redis_calls":13,"redis_duration_s":0.007409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015946,"completed_at":"2026-08-16T17:28:22.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.150852] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03a03eff743775dfed2d8255","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03a03eff743775dfed2d8255: start","job_status":"start","queue_duration_s":0.756992,"scheduling_latency_s":0.757006} gitlab # [ 146.155683] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03a03eff743775dfed2d8255","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03a03eff743775dfed2d8255: done: 0.010415 sec","job_status":"done","queue_duration_s":0.756992,"scheduling_latency_s":0.757006,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010415,"completed_at":"2026-08-16T17:28:22.124Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.192863] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"098980c4bfa425a572682426","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-098980c4bfa425a572682426: start","job_status":"start","queue_duration_s":0.768238,"scheduling_latency_s":0.768251} gitlab # [ 146.195845] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:22.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"098980c4bfa425a572682426","created_at":"2026-08-16T17:28:21.268Z","trace_propagation_headers":{"sentry-trace":"e870912cb7a14d079ce721bdc34040f6-faa27c2016a44da8","baggage":"sentry-trace_id=e870912cb7a14d079ce721bdc34040f6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"b8bcf3a2fdda7123aab08ea8add225d6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:28:21.357Z","job_size_bytes":2,"pid":1595,"sidekiq_tid":"magf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-098980c4bfa425a572682426: done: 0.009605 sec","job_status":"done","queue_duration_s":0.768238,"scheduling_latency_s":0.768251,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009605,"completed_at":"2026-08-16T17:28:22.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 146.396838] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1988291678 wd_nsec: 1988291662 gitlab # [ 156.503349] setup-gitlab-start[2186]: W, [2026-08-16T17:28:33.817695 #2186] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 176.692356] postgres[2379]: [2379] ERROR: relation "table_without_models" does not exist gitlab # [ 176.694583] postgres[2379]: [2379] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 179.535770] runuser[2185]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 179.537398] setup-gitlab-start[2162]: + systemctl restart gitlab-sidekiq.service gitlab # [ 179.560599] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 179.562242] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:56.875Z","message":"Shutting down"} gitlab # [ 179.563270] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:56.877Z","message":"Scheduler exiting..."} gitlab # [ 179.567714] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:56.882Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 179.568739] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:56.883Z","message":"Scheduler exiting..."} gitlab # [ 180.076427] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:57.391Z","message":"Bye!"} gitlab # [ 180.100679] sidekiq-cluster[1595]: {"severity":"INFO","time":"2026-08-16T17:28:57.415Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1595,"worker_id":"sidekiq_0","memwd_rss_bytes":923795456,"retry":0} gitlab # [ 184.013255] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 184.015175] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 184.016783] systemd[1]: gitlab-sidekiq.service: Consumed 53.844s CPU time over 1min 53.011s wall clock time, 954.2M memory peak, 4.4M read from disk. gitlab # [ 184.021553] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 184.025849] setup-gitlab-start[2162]: + mkdir -p /var/lib/secrets gitlab # [ 184.029365] setup-gitlab-start[2162]: + echo nixbot-test-token-of-20-chars gitlab # [ 184.031196] setup-gitlab-start[2162]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 184.036577] setup-gitlab-start[2162]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 184.969308] gitaly[890]: time="2026-08-16T17:29:02.283Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.283" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 184.971583] gitaly[890]: time="2026-08-16T17:29:02.283Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.283" grpc.time_ms=0.382 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.113833] gitaly[890]: time="2026-08-16T17:29:02.428Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.148" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.428" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.134428] gitaly[890]: time="2026-08-16T17:29:02.449Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.148" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.428" grpc.time_ms=0.395 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.197687] gitaly[890]: time="2026-08-16T17:29:02.512Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV diskcache=4dd32c5e-997a-4c6f-9962-7d0f81e88fd1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:29:12.179" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.460" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.199320] gitaly[890]: time="2026-08-16T17:29:02.513Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1582 command.oublock=32 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:29:12.179" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.460" grpc.time_ms=52.274 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.257253] gitaly[890]: time="2026-08-16T17:29:02.572Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.290" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.571" pid=890 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 185.259127] gitaly[890]: time="2026-08-16T17:29:02.572Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.290" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.571" grpc.time_ms=0.858 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.292573] gitaly[890]: time="2026-08-16T17:29:02.607Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:29:12.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.598" grpc.time_ms=8.544 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.365082] gitaly[890]: time="2026-08-16T17:29:02.680Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.089" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.679" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.385590] gitaly[890]: time="2026-08-16T17:29:02.700Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.089" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.679" grpc.time_ms=20.577 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.461622] gitaly[890]: time="2026-08-16T17:29:02.776Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV diskcache=aaabb232-7504-4924-9a1a-d76b39b4db5b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:29:12.131" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.722" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.481944] gitaly[890]: time="2026-08-16T17:29:02.776Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1578 command.oublock=32 command.real_time_ms=25 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:29:12.131" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.722" grpc.time_ms=54.324 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.505661] gitaly[890]: time="2026-08-16T17:29:02.820Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.229" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.820" pid=890 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 185.506712] gitaly[890]: time="2026-08-16T17:29:02.821Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.229" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.820" grpc.time_ms=0.828 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.536050] gitaly[890]: time="2026-08-16T17:29:02.851Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:29:12.252" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.842" grpc.time_ms=8.506 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.572054] gitaly[890]: time="2026-08-16T17:29:02.887Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:29:12.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.886" grpc.time_ms=0.104 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.580930] gitaly[890]: time="2026-08-16T17:29:02.895Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:29:12.014" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:02.895" grpc.time_ms=0.379 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 185.970242] gitaly[890]: time="2026-08-16T17:29:03.284Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SX95S3K5RQYSN6A4NNBFV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:29:13.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:03.274" grpc.time_ms=10.513 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 186.340041] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:03 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 2285 gitlab # [ 186.346344] setup-gitlab-start[2162]: + mkdir -p /tmp/test-flake gitlab # [ 186.350746] setup-gitlab-start[2162]: + cd /tmp/test-flake gitlab # [ 186.352244] setup-gitlab-start[2162]: + git init -b master gitlab # [ 186.375872] setup-gitlab-start[2469]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 186.377304] setup-gitlab-start[2162]: + git config user.name test gitlab # [ 186.384129] setup-gitlab-start[2162]: + git config user.email test@example.com gitlab # [ 186.389335] setup-gitlab-start[2162]: + cat gitlab # [ 186.393920] setup-gitlab-start[2162]: + git add flake.nix gitlab # [ 186.400687] setup-gitlab-start[2162]: + git commit -m 'initial commit' gitlab # [ 186.427525] setup-gitlab-start[2474]: [master (root-commit) cd19ba4] initial commit gitlab # [ 186.428882] setup-gitlab-start[2474]: 1 file changed, 10 insertions(+) gitlab # [ 186.430059] setup-gitlab-start[2474]: create mode 100644 flake.nix gitlab # [ 186.430731] setup-gitlab-start[2162]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 186.438719] setup-gitlab-start[2162]: + git push -u origin master gitlab # [ 186.494088] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 27 gitlab # [ 186.748258] gitaly[890]: time="2026-08-16T17:29:04.063Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBJ5VMMX3TGJPB7HT4B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:04.052" grpc.time_ms=10.746 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 186.750248] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:04 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 249 gitlab # [ 186.974453] gitaly[890]: time="2026-08-16T17:29:04.288Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:29:14.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:04.280" grpc.time_ms=8.634 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 186.995447] sidekiq-cluster[2421]: {"severity":"INFO","time":"2026-08-16T17:29:04.293Z","message":"Starting cluster with 1 processes"} gitlab # [ 187.017226] gitaly[890]: time="2026-08-16T17:29:04.332Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:29:34.026" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:29:04.326" grpc.time_ms=5.55 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 187.042584] gitaly[890]: time="2026-08-16T17:29:04.357Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 duration_ms=131ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 187.066954] gitaly[890]: time="2026-08-16T17:29:04.382Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 duration_ms=21ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 187.070756] gitaly[890]: time="2026-08-16T17:29:04.382Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:04.225" grpc.time_ms=156.745 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 187.104175] gitaly[890]: time="2026-08-16T17:29:04.418Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:04.418" grpc.time_ms=0.479 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 187.139213] gitaly[890]: time="2026-08-16T17:29:04.454Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:04.453" grpc.time_ms=0.744 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 187.170471] gitaly[890]: time="2026-08-16T17:29:04.485Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:04.485" grpc.time_ms=0.25 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 187.256925] gitaly[890]: time="2026-08-16T17:29:04.571Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:29:14.282" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:04.563" grpc.time_ms=8.589 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 187.279828] gitaly[890]: time="2026-08-16T17:29:04.594Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1564 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:29:14.300" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:04.580" grpc.time_ms=14.005 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 187.290758] gitaly[890]: time="2026-08-16T17:29:04.605Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 duration_ms=81ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 187.293262] gitaly[890]: time="2026-08-16T17:29:04.606Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:04.523" grpc.time_ms=82.387 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 187.313702] gitaly[890]: time="2026-08-16T17:29:04.628Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 diskcache=18cf4c3e-0d8f-4fb3-a776-9edcfb06a075 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:04.155" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 187.321887] gitaly[890]: time="2026-08-16T17:29:04.629Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=199 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13712 command.oublock=32 command.real_time_ms=462 command.spawn_token_fork_ms=0 command.system_time_ms=116 command.user_time_ms=83 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:04.155" grpc.time_ms=473.841 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 187.332763] gitlab-workhorse[825]: time="2026-08-16T17:29:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 187.334419] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:04 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 526 gitlab # [ 187.336223] setup-gitlab-start[2478]: To http://gitlab/root/test-flake.git gitlab # [ 187.337066] setup-gitlab-start[2478]: * [new branch] master -> master gitlab # [ 187.337838] setup-gitlab-start[2478]: branch 'master' set up to track 'origin/master'. gitlab # [ 187.339077] systemd[1]: Finished setup-gitlab.service. gitlab # [ 187.343786] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 188.34 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 188.464084] nixbot[2562]: {"ts": "2026-08-16T17:29:05.778Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 188.501848] nixbot[2562]: {"ts": "2026-08-16T17:29:05.816Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 188.521171] nixbot[2562]: {"ts": "2026-08-16T17:29:05.834Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 188.526162] nixbot[2562]: {"ts": "2026-08-16T17:29:05.840Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 188.533163] nixbot[2562]: {"ts": "2026-08-16T17:29:05.848Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 188.541151] nixbot[2562]: {"ts": "2026-08-16T17:29:05.854Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 188.545508] nixbot[2562]: {"ts": "2026-08-16T17:29:05.857Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 188.550053] nixbot[2562]: {"ts": "2026-08-16T17:29:05.859Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 188.550676] nixbot[2562]: {"ts": "2026-08-16T17:29:05.863Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 188.558517] nixbot[2562]: {"ts": "2026-08-16T17:29:05.873Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 188.569051] nixbot[2562]: {"ts": "2026-08-16T17:29:05.884Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 188.580233] nixbot[2562]: {"ts": "2026-08-16T17:29:05.895Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 188.589211] nixbot[2562]: {"ts": "2026-08-16T17:29:05.904Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 188.593913] nixbot[2562]: {"ts": "2026-08-16T17:29:05.906Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 188.599067] nixbot[2562]: {"ts": "2026-08-16T17:29:05.911Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 188.603857] nixbot[2562]: {"ts": "2026-08-16T17:29:05.918Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 188.608568] nixbot[2562]: {"ts": "2026-08-16T17:29:05.921Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 188.612655] nixbot[2562]: {"ts": "2026-08-16T17:29:05.927Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 188.622622] nixbot[2562]: {"ts": "2026-08-16T17:29:05.937Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 188.629185] nixbot[2562]: {"ts": "2026-08-16T17:29:05.944Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 188.633186] nixbot[2562]: {"ts": "2026-08-16T17:29:05.947Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 188.638815] nixbot[2562]: {"ts": "2026-08-16T17:29:05.953Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 188.642668] nixbot[2562]: {"ts": "2026-08-16T17:29:05.956Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 188.646541] nixbot[2562]: {"ts": "2026-08-16T17:29:05.960Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 188.650213] nixbot[2562]: {"ts": "2026-08-16T17:29:05.962Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 189.001438] nixbot[2562]: INFO: Started server process [2562] gitlab # [ 189.003516] nixbot[2562]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 189.034762] nixbot[2562]: INFO: ::ffff:127.0.0.1:60138 - "GET /health HTTP/1.1" 200 OK gitlab # [ 189.039476] systemd[1]: Started nixbot CI service. gitlab # [ 189.041780] systemd[1]: Reached target Multi-User System. gitlab # [ 189.043306] systemd[1]: Startup finished in 1.114s (kernel) + 3.598s (initrd) + 3min 4.330s (userspace) = 3min 9.043s. gitlab # [ 189.682782] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:06 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 644 gitlab # [ 189.690201] nixbot[2562]: {"ts": "2026-08-16T17:29:07.004Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 189.720085] nixbot[2562]: {"ts": "2026-08-16T17:29:07.035Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 189.780281] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 46 gitlab # [ 189.782126] nixbot[2562]: {"ts": "2026-08-16T17:29:07.096Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 189.783134] nixbot[2562]: {"ts": "2026-08-16T17:29:07.097Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 189.855313] nixbot[2562]: INFO: ::ffff:127.0.0.1:60142 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 189.878117] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 94 gitlab # [ 189.879487] nixbot[2562]: {"ts": "2026-08-16T17:29:07.193Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 189.971881] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 73 gitlab # [ 189.977935] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 89 gitlab # [ 189.978592] nixbot[2562]: {"ts": "2026-08-16T17:29:07.293Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.13 seconds) (finished: subtest: project discovered and webhook registered, in 0.13 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 190.024978] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 36 gitlab # [ 190.030231] nixbot[2562]: {"ts": "2026-08-16T17:29:07.345Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 190.039335] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 20 gitlab # [ 190.074086] nixbot[2562]: {"ts": "2026-08-16T17:29:07.388Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 190.074786] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 37 gitlab # [ 190.124605] gitaly[890]: time="2026-08-16T17:29:07.439Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF106JDAMSRRR6DMYES3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.430" grpc.time_ms=8.441 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.129882] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 84 gitlab # [ 190.135474] gitaly[890]: time="2026-08-16T17:29:07.450Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF22G8CW2G4BX099HCT2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T17:29:37.042" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:07.442" grpc.time_ms=7.481 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 190.143451] gitaly[890]: time="2026-08-16T17:29:07.458Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF22G8CW2G4BX099HCT2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:29:37.057" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:07.458" grpc.time_ms=0.411 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 190.150053] gitaly[890]: time="2026-08-16T17:29:07.465Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF22G8CW2G4BX099HCT2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T17:29:17.010" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:07.460" grpc.time_ms=4.735 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 190.170095] nixbot[2562]: {"ts": "2026-08-16T17:29:07.482Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 190.170730] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 90 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 190.236199] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 63 gitlab # [ 190.238370] nixbot[2562]: {"ts": "2026-08-16T17:29:07.551Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 190.240600] nixbot[2562]: {"ts": "2026-08-16T17:29:07.553Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 190.301413] gitaly[890]: time="2026-08-16T17:29:07.616Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF7SW5PRYTSVR6M80VPH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.610" grpc.time_ms=5.974 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.311454] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 48 gitlab # [ 190.351235] gitaly[890]: time="2026-08-16T17:29:07.666Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:29:37.360" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:29:07.660" grpc.time_ms=5.751 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 190.370896] gitaly[890]: time="2026-08-16T17:29:07.685Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05SXF64TGK17AHTY3PS68PS duration_ms=62ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 190.386946] gitaly[890]: time="2026-08-16T17:29:07.702Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF9CF8SQABY05X49589D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.695" pid=890 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 190.396707] gitaly[890]: time="2026-08-16T17:29:07.704Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF9CF8SQABY05X49589D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.695" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.407417] gitaly[890]: time="2026-08-16T17:29:07.703Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05SXF64TGK17AHTY3PS68PS duration_ms=16ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 190.409897] gitlab-workhorse[825]: time="2026-08-16T17:29:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 190.411535] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 77 gitlab # [ 190.413230] gitaly[890]: time="2026-08-16T17:29:07.704Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:07.623" grpc.time_ms=81.492 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.421625] gitaly[890]: time="2026-08-16T17:29:07.704Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF9CF8SQABY05X49589D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.695" grpc.time_ms=9.465 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.433245] gitaly[890]: time="2026-08-16T17:29:07.744Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:07.743" grpc.time_ms=1.021 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.456748] gitaly[890]: time="2026-08-16T17:29:07.771Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFBW3VSDXJ5Q64YWEHXY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.755" pid=890 remote_ip="2001:db8:1::1" request_sha=e6a65c87df9d06a3311cc11cf65d75911769e1db response_bytes=223 span.kind=server system=grpc gitlab # [ 190.457917] gitaly[890]: time="2026-08-16T17:29:07.772Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFBW3VSDXJ5Q64YWEHXY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.755" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.458547] gitlab-workhorse[825]: time="2026-08-16T17:29:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 190.458955] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 63 gitlab # [ 190.459531] gitaly[890]: time="2026-08-16T17:29:07.772Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFBW3VSDXJ5Q64YWEHXY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.755" grpc.time_ms=17.349 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.498044] gitaly[890]: time="2026-08-16T17:29:07.813Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:07.812" grpc.time_ms=0.35 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.526424] gitaly[890]: time="2026-08-16T17:29:07.841Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:07.839" grpc.time_ms=0.431 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.577216] gitaly[890]: time="2026-08-16T17:29:07.892Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05SXF64TGK17AHTY3PS68PS duration_ms=30ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 190.579853] gitaly[890]: time="2026-08-16T17:29:07.893Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXFGB1EJ21E9V5W517VCT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.886" grpc.time_ms=6.879 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.591763] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 42 gitlab # [ 190.593652] gitaly[890]: time="2026-08-16T17:29:07.895Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:07.862" grpc.time_ms=33.555 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.609071] gitaly[890]: time="2026-08-16T17:29:07.924Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS diskcache=c375f580-2eb7-4aec-bce4-b66fb5d61852 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.574" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.619060] gitaly[890]: time="2026-08-16T17:29:07.932Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=117 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13424 command.oublock=32 command.real_time_ms=331 command.spawn_token_fork_ms=2 command.system_time_ms=76 command.user_time_ms=41 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.574" grpc.time_ms=357.997 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 190.631191] gitlab-workhorse[825]: time="2026-08-16T17:29:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 190.632843] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 408 gitlab # [ 190.634457] gitlab-workhorse[825]: time="2026-08-16T17:29:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 190.636053] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 39 gitlab # [ 190.637762] gitaly[890]: time="2026-08-16T17:29:07.933Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFHQHETMSMFYFF54MYT8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.927" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # To http://gitlab/root/test-flake.git gitlab # cd19ba4..55b0367 master -> master gitlab # [ 190.646895] gitaly[890]: time="2026-08-16T17:29:07.934Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFHQHETMSMFYFF54MYT8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.927" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.657660] gitaly[890]: time="2026-08-16T17:29:07.934Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFHQHETMSMFYFF54MYT8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.927" grpc.time_ms=6.85 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.69 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 190.681277] gitaly[890]: time="2026-08-16T17:29:07.996Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFK00CGCJEM5346T7CX7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.982" pid=890 remote_ip="2001:db8:1::1" request_sha=73cdc2b8ad0fbc8a380ffd8224c625e3799862d8 response_bytes=338 span.kind=server system=grpc gitlab # [ 190.682260] gitaly[890]: time="2026-08-16T17:29:07.997Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1190 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFK00CGCJEM5346T7CX7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.982" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.682779] gitaly[890]: time="2026-08-16T17:29:07.997Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1190 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFK00CGCJEM5346T7CX7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:07.982" grpc.time_ms=14.35 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.683641] gitlab-workhorse[825]: time="2026-08-16T17:29:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=338 gitlab # [ 190.684125] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 61 gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 190.768118] nixbot[2562]: INFO: ::ffff:127.0.0.1:60154 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.05 seconds) gitlab # [ 190.821620] gitaly[890]: time="2026-08-16T17:29:08.136Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXFR0WHXD8TW6DQQZEKHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:08.126" grpc.time_ms=10.225 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.838616] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 41 gitlab # [ 190.872165] gitaly[890]: time="2026-08-16T17:29:08.187Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFSC40BRB204GNSHA8ZM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:08.171" pid=890 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 190.881168] gitaly[890]: time="2026-08-16T17:29:08.187Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFSC40BRB204GNSHA8ZM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:08.171" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.892371] gitlab-workhorse[825]: time="2026-08-16T17:29:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 190.892934] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 47 gitlab # [ 190.893513] gitaly[890]: time="2026-08-16T17:29:08.187Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFSC40BRB204GNSHA8ZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:08.171" grpc.time_ms=15.944 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 190.969373] gitaly[890]: time="2026-08-16T17:29:08.284Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:29:38.083" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:08.283" grpc.time_ms=0.663 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.026494] gitaly[890]: time="2026-08-16T17:29:08.341Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:29:38.132" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:08.332" grpc.time_ms=8.567 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.045444] gitaly[890]: time="2026-08-16T17:29:08.358Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:29:18.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:08.350" grpc.time_ms=7.952 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.059157] gitaly[890]: time="2026-08-16T17:29:08.374Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:29:18.014" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:08.364" grpc.time_ms=9.81 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.120747] gitaly[890]: time="2026-08-16T17:29:08.435Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:29:18.084" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:08.435" grpc.time_ms=0.318 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.156052] gitaly[890]: time="2026-08-16T17:29:08.470Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:29:18.010" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:08.460" grpc.time_ms=9.904 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.192662] gitaly[890]: time="2026-08-16T17:29:08.507Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:08.507" grpc.time_ms=0.456 pid=890 span.kind=server system=grpc gitlab # [ 191.235988] gitaly[890]: time="2026-08-16T17:29:08.551Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:08.549" grpc.time_ms=0.566 pid=890 span.kind=server system=grpc gitlab # [ 191.253415] gitaly[890]: time="2026-08-16T17:29:08.568Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 diskcache=d0fb7070-7dfc-45ab-9622-40ea9b815963 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:29:18.023" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:08.473" pid=890 ref=refs/keep-around/cd19ba45625c2443430fbf2ce9fde9139567aa3d remote_ip="2001:db8:1::1" revision=cd19ba45625c2443430fbf2ce9fde9139567aa3d span.kind=server system=grpc username=root gitlab # [ 191.262859] gitaly[890]: time="2026-08-16T17:29:08.577Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=79 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5398 command.oublock=8 command.real_time_ms=86 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:29:18.023" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:08.473" grpc.time_ms=94.658 pid=890 ref=refs/keep-around/cd19ba45625c2443430fbf2ce9fde9139567aa3d remote_ip="2001:db8:1::1" revision=cd19ba45625c2443430fbf2ce9fde9139567aa3d span.kind=server system=grpc username=root gitlab # [ 191.279148] gitaly[890]: time="2026-08-16T17:29:08.594Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:29:38.193" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:08.593" grpc.time_ms=0.479 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 191.403267] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 471 gitlab # [ 191.408920] nixbot[2562]: {"ts": "2026-08-16T17:29:08.719Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d \"HTTP/1.1 201 Created\""} gitlab # [ 191.416385] nixbot[2562]: {"ts": "2026-08-16T17:29:08.731Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-cd19ba45625c-0"} gitlab # [ 191.476717] systemd[1]: Started Nix Daemon. gitlab # [ 191.540788] nix-daemon[2783]: accepted connection from pid 2777, user nixbot gitlab # [ 191.616812] nix-daemon[2783]: accepted connection from pid 2790, user nixbot gitlab # [ 191.628568] nixbot[2562]: {"ts": "2026-08-16T17:29:08.943Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-cd19ba45625c-0", "argv0": "bwrap"} gitlab # [ 191.750766] nix-daemon[2783]: accepted connection from pid 2800, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 191.799842] nixbot[2562]: INFO: ::ffff:127.0.0.1:60168 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab # [ 191.824169] nix-daemon[2783]: accepted connection from pid 2810, user nixbot gitlab # [ 191.841708] nix-daemon[2783]: accepted connection from pid 2800, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 192.835238] nixbot[2562]: INFO: ::ffff:127.0.0.1:60170 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 193.873778] nixbot[2562]: INFO: ::ffff:127.0.0.1:36754 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 194.912423] nixbot[2562]: INFO: ::ffff:127.0.0.1:36756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 195.950632] nixbot[2562]: INFO: ::ffff:127.0.0.1:36764 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab # [ 196.700195] nix-daemon[2783]: accepted connection from pid 2841, user nixbot gitlab # [ 196.755629] gitaly[890]: time="2026-08-16T17:29:14.070Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXNGVNCHPSTKSEZKFKBJC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:29:44.069" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:14.069" grpc.time_ms=0.62 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.799121] gitaly[890]: time="2026-08-16T17:29:14.114Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05SXNGVNCHPSTKSEZKFKBJC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:29:24.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:14.102" grpc.time_ms=11.479 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 196.860135] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 162 gitlab # [ 196.861594] nixbot[2562]: {"ts": "2026-08-16T17:29:14.175Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 196.968137] gitaly[890]: time="2026-08-16T17:29:14.279Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXNP204GGN09BYTQ7XEBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:29:44.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:14.279" grpc.time_ms=0.688 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.008698] nixbot[2562]: INFO: ::ffff:127.0.0.1:36768 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.06 seconds) gitlab # [ 197.016415] gitaly[890]: time="2026-08-16T17:29:14.331Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXNP204GGN09BYTQ7XEBR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:29:24.220" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:14.320" grpc.time_ms=10.461 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 197.087486] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 223 gitlab # [ 197.093113] nixbot[2562]: {"ts": "2026-08-16T17:29:14.403Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 198.047140] nixbot[2562]: INFO: ::ffff:127.0.0.1:36778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab # [ 199.086196] nixbot[2562]: INFO: ::ffff:127.0.0.1:36794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 200.120552] nixbot[2562]: INFO: ::ffff:127.0.0.1:36798 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab # [ 201.010907] nix-daemon[2783]: accepted connection from pid 2882, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 201.103985] gitaly[890]: time="2026-08-16T17:29:18.418Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXSRNAR2HJRJVAJ63DKQ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:29:48.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:18.417" grpc.time_ms=0.667 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.154944] nixbot[2562]: INFO: ::ffff:127.0.0.1:36814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab # [ 201.251912] gitaly[890]: time="2026-08-16T17:29:18.566Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXSRNAR2HJRJVAJ63DKQ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:29:28.275" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:18.556" grpc.time_ms=10.798 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.435190] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 391 gitlab # [ 201.440917] nixbot[2562]: {"ts": "2026-08-16T17:29:18.755Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d \"HTTP/1.1 201 Created\""} gitlab # [ 201.534759] nix-daemon[2783]: accepted connection from pid 2899, user nixbot gitlab # [ 201.622461] gitaly[890]: time="2026-08-16T17:29:18.937Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXT98EJ1G45ACP6884ZWJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:18.927" grpc.time_ms=9.632 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.644744] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 70 gitlab # [ 201.694815] gitaly[890]: time="2026-08-16T17:29:19.009Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXTBKM1ZEM32G7BY6P249 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:19.002" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 201.695761] gitaly[890]: time="2026-08-16T17:29:19.010Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXTBKM1ZEM32G7BY6P249 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:19.002" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.696811] gitaly[890]: time="2026-08-16T17:29:19.010Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXTBKM1ZEM32G7BY6P249 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:19.002" grpc.time_ms=7.66 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 201.697929] gitlab-workhorse[825]: time="2026-08-16T17:29:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 201.698727] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 48 gitlab # [ 201.803155] nix-daemon[2783]: accepted connection from pid 2924, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 202.193378] nixbot[2562]: INFO: ::ffff:127.0.0.1:36826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 203.231735] nixbot[2562]: INFO: ::ffff:127.0.0.1:59018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 204.269323] nixbot[2562]: INFO: ::ffff:127.0.0.1:59020 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 205.305163] nixbot[2562]: INFO: ::ffff:127.0.0.1:59028 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 206.342747] nixbot[2562]: INFO: ::ffff:127.0.0.1:59036 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 207.378450] nixbot[2562]: INFO: ::ffff:127.0.0.1:59042 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 208.414264] nixbot[2562]: INFO: ::ffff:127.0.0.1:59056 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 209.450468] nixbot[2562]: INFO: ::ffff:127.0.0.1:59066 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 210.487913] nixbot[2562]: INFO: ::ffff:127.0.0.1:59070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab # [ 211.216253] sidekiq-cluster[2514]: 2026-08-16T17:29:28.530Z pid=2514 tid=xve INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2514, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>435666944} gitlab # [ 211.379952] sidekiq-cluster[2514]: W, [2026-08-16T17:29:28.694868 #2514] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 211.416110] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:28.730Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 211.525419] nixbot[2562]: INFO: ::ffff:127.0.0.1:59082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 212.561982] nixbot[2562]: INFO: ::ffff:127.0.0.1:59084 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab # [ 213.108436] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:30.422Z","message":"GitLab reliable fetch activated!"} gitlab # [ 213.110256] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:30.422Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 213.599783] nixbot[2562]: INFO: ::ffff:127.0.0.1:54958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 214.635339] nixbot[2562]: INFO: ::ffff:127.0.0.1:54964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 215.670345] nixbot[2562]: INFO: ::ffff:127.0.0.1:54976 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 216.706171] nixbot[2562]: INFO: ::ffff:127.0.0.1:54978 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 217.743922] nixbot[2562]: INFO: ::ffff:127.0.0.1:54992 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 218.781489] nixbot[2562]: INFO: ::ffff:127.0.0.1:55004 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 219.818739] nixbot[2562]: INFO: ::ffff:127.0.0.1:55006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 220.856212] nixbot[2562]: INFO: ::ffff:127.0.0.1:55018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 221.893745] nixbot[2562]: INFO: ::ffff:127.0.0.1:55024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 222.931823] nixbot[2562]: INFO: ::ffff:127.0.0.1:55030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 223.972148] nixbot[2562]: INFO: ::ffff:127.0.0.1:49884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 225.009735] nixbot[2562]: INFO: ::ffff:127.0.0.1:49886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 226.046840] nixbot[2562]: INFO: ::ffff:127.0.0.1:49892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 227.083785] nixbot[2562]: INFO: ::ffff:127.0.0.1:49908 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 228.120839] nixbot[2562]: INFO: ::ffff:127.0.0.1:49918 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 229.160134] nixbot[2562]: INFO: ::ffff:127.0.0.1:49926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab # [ 230.197642] nixbot[2562]: INFO: ::ffff:127.0.0.1:49928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 231.228758] nixbot[2562]: INFO: ::ffff:127.0.0.1:49932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab # [ 232.264567] nixbot[2562]: INFO: ::ffff:127.0.0.1:49946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab # [ 232.529150] postgres[3034]: [3034] ERROR: relation "table_without_models" does not exist gitlab # [ 232.531105] postgres[3034]: [3034] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 233.298611] nixbot[2562]: INFO: ::ffff:127.0.0.1:32950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 234.333523] nixbot[2562]: INFO: ::ffff:127.0.0.1:32964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) gitlab # [ 234.895498] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:52.210Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 234.898651] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:52.213Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 234.900414] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:52.213Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 234.901922] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:52.213Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 234.903692] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:52.215Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 235.368394] nixbot[2562]: INFO: ::ffff:127.0.0.1:32972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.04 seconds) gitlab # [ 236.168980] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:53.482Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"25f1fa620ec50b09d22103d4","created_at":"2026-08-16T17:29:02.622Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:02.661Z","job_size_bytes":2,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-25f1fa620ec50b09d22103d4: start","job_status":"start","queue_duration_s":50.820991,"scheduling_latency_s":50.821059} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 236.393407] nixbot[2562]: INFO: ::ffff:127.0.0.1:32980 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.02 seconds) gitlab # [ 236.415899] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:53.730Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"25f1fa620ec50b09d22103d4","created_at":"2026-08-16T17:29:02.622Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:02.661Z","job_size_bytes":2,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-25f1fa620ec50b09d22103d4: done: 0.24765 sec","job_status":"done","queue_duration_s":50.820991,"scheduling_latency_s":50.821059,"redis_calls":25,"redis_duration_s":0.007844,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004639,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00174,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001465,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.107459188,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.24765,"completed_at":"2026-08-16T17:29:53.730Z","load_balancing_strategy":"primary","db_duration_s":0.065595,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.418616] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:53.732Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"acf016721d7d9d01d7bd9ba6","created_at":"2026-08-16T17:29:02.672Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:02.676Z","job_size_bytes":2,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-acf016721d7d9d01d7bd9ba6: start","job_status":"start","queue_duration_s":51.056406,"scheduling_latency_s":51.056448} gitlab # [ 236.505111] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:53.819Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"acf016721d7d9d01d7bd9ba6","created_at":"2026-08-16T17:29:02.672Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:02.676Z","job_size_bytes":2,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-acf016721d7d9d01d7bd9ba6: done: 0.087457 sec","job_status":"done","queue_duration_s":51.056406,"scheduling_latency_s":51.056448,"redis_calls":14,"redis_duration_s":0.002467,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000825,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.062871678,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.087457,"completed_at":"2026-08-16T17:29:53.819Z","load_balancing_strategy":"primary","db_duration_s":0.017815,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.506662] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:53.820Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7fa65c9798b01d16a7cdbb19","created_at":"2026-08-16T17:29:03.183Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:03.188Z","job_size_bytes":5,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7fa65c9798b01d16a7cdbb19: start","job_status":"start","queue_duration_s":50.632736,"scheduling_latency_s":50.632749} gitlab # [ 236.619778] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:53.934Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7fa65c9798b01d16a7cdbb19","created_at":"2026-08-16T17:29:03.183Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:03.188Z","job_size_bytes":5,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7fa65c9798b01d16a7cdbb19: done: 0.113585 sec","job_status":"done","queue_duration_s":50.632736,"scheduling_latency_s":50.632749,"redis_calls":12,"redis_duration_s":0.002676,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001617,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000366248,"duration_s":0.113585,"completed_at":"2026-08-16T17:29:53.934Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024739,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.622545] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:53.935Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9365af718a676658b7e6284b","created_at":"2026-08-16T17:29:03.208Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:03.210Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9365af718a676658b7e6284b: start","job_status":"start","queue_duration_s":50.724845,"scheduling_latency_s":50.724859} gitlab # [ 236.772502] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:54.087Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9365af718a676658b7e6284b","created_at":"2026-08-16T17:29:03.208Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:03.210Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9365af718a676658b7e6284b: done: 0.151457 sec","job_status":"done","queue_duration_s":50.724845,"scheduling_latency_s":50.724859,"redis_calls":11,"redis_duration_s":0.002401,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000672,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001291,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.127,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.127,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000284952,"duration_s":0.151457,"completed_at":"2026-08-16T17:29:54.087Z","load_balancing_strategy":"primary","db_duration_s":0.072717,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.775239] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:54.088Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0498e49d06b42eb84bcec8e8","created_at":"2026-08-16T17:29:03.212Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:03.215Z","job_size_bytes":89,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0498e49d06b42eb84bcec8e8: start","job_status":"start","queue_duration_s":50.873012,"scheduling_latency_s":50.873026} gitlab # [ 236.843952] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:54.114Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0498e49d06b42eb84bcec8e8","created_at":"2026-08-16T17:29:03.212Z","trace_propagation_headers":{"sentry-trace":"68ef38bac9e645dbad08dde11e61f421-6078c2d35a9642f7","baggage":"sentry-trace_id=68ef38bac9e645dbad08dde11e61f421,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SX95S3K5RQYSN6A4NNBFV","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:03.215Z","job_size_bytes":89,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0498e49d06b42eb84bcec8e8: done: 0.025569 sec","job_status":"done","queue_duration_s":50.873012,"scheduling_latency_s":50.873026,"redis_calls":11,"redis_duration_s":0.002249,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000626,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000320711,"duration_s":0.025569,"completed_at":"2026-08-16T17:29:54.114Z","load_balancing_strategy":"primary","db_duration_s":0.005563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.853648] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:54.115Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 cd19ba45625c2443430fbf2ce9fde9139567aa3d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"048e6d6f93c9b49255f9e0aa","created_at":"2026-08-16T17:29:04.548Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-52517f92d6954618","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:29:04.551Z","job_size_bytes":185,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-048e6d6f93c9b49255f9e0aa: start","job_status":"start","queue_duration_s":49.563904,"scheduling_latency_s":49.563917} gitlab # [ 236.890740] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:54.126Z","message":"changes: \"0000000000000000000000000000000000000000 cd19ba45625c2443430fbf2ce9fde9139567aa3d refs/heads/master\\n\""} gitlab # [ 236.891697] gitaly[890]: time="2026-08-16T17:29:54.162Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:04.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:54.150" grpc.time_ms=11.601 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 236.892412] gitaly[890]: time="2026-08-16T17:29:54.180Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:30:04.031" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:54.171" grpc.time_ms=8.361 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 236.924529] gitaly[890]: time="2026-08-16T17:29:54.239Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:30:04.089" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:54.230" grpc.time_ms=9.361 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 236.960540] gitaly[890]: time="2026-08-16T17:29:54.275Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:54.275" grpc.time_ms=0.432 pid=890 span.kind=server system=grpc gitlab # [ 236.995823] gitaly[890]: time="2026-08-16T17:29:54.310Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:54.310" grpc.time_ms=0.26 pid=890 span.kind=server system=grpc gitlab # [ 237.014424] gitaly[890]: time="2026-08-16T17:29:54.329Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 diskcache=6bb80699-1ff0-48f7-b686-d1704ab28794 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:30:04.113" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:54.253" pid=890 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 237.015337] gitaly[890]: time="2026-08-16T17:29:54.329Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=58 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5254 command.oublock=8 command.real_time_ms=66 command.spawn_token_fork_ms=0 command.system_time_ms=32 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:30:04.113" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:54.253" grpc.time_ms=75.716 pid=890 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 237.051471] gitaly[890]: time="2026-08-16T17:29:54.366Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:30:04.226" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:54.366" grpc.time_ms=0.122 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.070357] gitaly[890]: time="2026-08-16T17:29:54.385Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=946 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:30:04.230" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:54.371" grpc.time_ms=13.997 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.164791] gitaly[890]: time="2026-08-16T17:29:54.479Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T17:30:24.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:54.472" grpc.time_ms=7.604 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.223538] gitaly[890]: time="2026-08-16T17:29:54.538Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:30:04.007" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:54.537" grpc.time_ms=0.401 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.255565] gitaly[890]: time="2026-08-16T17:29:54.570Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:30:04.032" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:29:54.563" grpc.time_ms=7.333 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.284051] gitaly[890]: time="2026-08-16T17:29:54.599Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:04.057" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:54.587" grpc.time_ms=10.959 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.312736] gitaly[890]: time="2026-08-16T17:29:54.627Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:04.075" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:54.616" grpc.time_ms=10.69 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.338490] gitaly[890]: time="2026-08-16T17:29:54.653Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=966 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:30:24.240" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:54.641" grpc.time_ms=12.238 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 237.438628] nixbot[2562]: INFO: ::ffff:127.0.0.1:32988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.05 seconds) gitlab # [ 237.686846] gitaly[890]: time="2026-08-16T17:29:55.001Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:30:04.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:55.000" grpc.time_ms=0.954 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.735682] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.049Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 cd19ba45625c2443430fbf2ce9fde9139567aa3d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"048e6d6f93c9b49255f9e0aa","created_at":"2026-08-16T17:29:04.548Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-52517f92d6954618","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:29:04.551Z","job_size_bytes":185,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-048e6d6f93c9b49255f9e0aa: done: 0.933741 sec","job_status":"done","queue_duration_s":49.563904,"scheduling_latency_s":49.563917,"gitaly_calls":13,"gitaly_duration_s":0.302859,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.047432,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.004834,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.007397,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002185,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003205,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.019263,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.010548,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.165,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.186,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.054,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.51862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000453689,"exclusive_lock_hold_duration_s":0.033195281,"duration_s":0.933741,"completed_at":"2026-08-16T17:29:55.049Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.095954,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 237.742186] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.052Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","cd19ba45625c2443430fbf2ce9fde9139567aa3d 55b03671163490acf063b77d0c1e7e7cc4e90ae6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b9051e2c7da8da5a2fab0b8c","created_at":"2026-08-16T17:29:07.882Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-5aca9393967f49cd","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:29:07.883Z","job_size_bytes":185,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b9051e2c7da8da5a2fab0b8c: start","job_status":"start","queue_duration_s":47.168436,"scheduling_latency_s":47.168467} gitlab # [ 237.756221] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.067Z","message":"changes: \"cd19ba45625c2443430fbf2ce9fde9139567aa3d 55b03671163490acf063b77d0c1e7e7cc4e90ae6 refs/heads/master\\n\""} gitlab # [ 237.783992] gitaly[890]: time="2026-08-16T17:29:55.099Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:05.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:55.087" grpc.time_ms=11.124 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.798358] gitaly[890]: time="2026-08-16T17:29:55.113Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:30:05.023" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:55.103" grpc.time_ms=9.805 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.804913] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.119Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"c14c4b52dbda1bf2545883d3","created_at":"2026-08-16T17:29:55.117Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-fe506b90af384d27","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"9eb5cadefb042f2e23dda25d","job_size_bytes":46,"pid":2514,"job_status":"deduplicated","message":"ProjectCacheWorker JID-c14c4b52dbda1bf2545883d3: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 237.828763] gitaly[890]: time="2026-08-16T17:29:55.143Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:30:05.054" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:55.134" grpc.time_ms=8.859 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.843803] gitaly[890]: time="2026-08-16T17:29:55.158Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T17:30:25.046" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:55.147" grpc.time_ms=11.688 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.860577] gitaly[890]: time="2026-08-16T17:29:55.175Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=349 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:30:05.089" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:29:55.170" grpc.time_ms=5.561 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.873201] gitaly[890]: time="2026-08-16T17:29:55.188Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:05.103" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:55.183" grpc.time_ms=4.932 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.984790] gitaly[890]: time="2026-08-16T17:29:55.299Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:30:05.165" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:55.245" grpc.time_ms=53.453 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 237.999953] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.314Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","cd19ba45625c2443430fbf2ce9fde9139567aa3d 55b03671163490acf063b77d0c1e7e7cc4e90ae6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b9051e2c7da8da5a2fab0b8c","created_at":"2026-08-16T17:29:07.882Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-5aca9393967f49cd","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:29:07.883Z","job_size_bytes":185,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b9051e2c7da8da5a2fab0b8c: done: 0.262708 sec","job_status":"done","queue_duration_s":47.168436,"scheduling_latency_s":47.168467,"gitaly_calls":7,"gitaly_duration_s":0.120274,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.021284,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.001647,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000933,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004011,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.008012,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.006681,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.156803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000744788,"exclusive_lock_hold_duration_s":0.021893565,"duration_s":0.262708,"completed_at":"2026-08-16T17:29:55.314Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024337,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.020456] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.316Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b96df9443c32d9342a29a9c8","created_at":"2026-08-16T17:29:08.602Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-067d2d3f659e47f0","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:08.612Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b96df9443c32d9342a29a9c8: start","job_status":"start","queue_duration_s":46.70416,"scheduling_latency_s":46.704176} gitlab # [ 238.073257] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.387Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b96df9443c32d9342a29a9c8","created_at":"2026-08-16T17:29:08.602Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-067d2d3f659e47f0","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:08.612Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b96df9443c32d9342a29a9c8: done: 0.070704 sec","job_status":"done","queue_duration_s":46.70416,"scheduling_latency_s":46.704176,"redis_calls":16,"redis_duration_s":0.0036430000000000004,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001988,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001268,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000345016,"duration_s":0.070704,"completed_at":"2026-08-16T17:29:55.386Z","load_balancing_strategy":"primary","db_duration_s":0.021467,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.080838] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.388Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4a1164f4b4837ef68dad31e8","created_at":"2026-08-16T17:29:08.613Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-067d2d3f659e47f0","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:08.618Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4a1164f4b4837ef68dad31e8: start","job_status":"start","queue_duration_s":46.769944,"scheduling_latency_s":46.769969} gitlab # [ 238.151243] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.465Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4a1164f4b4837ef68dad31e8","created_at":"2026-08-16T17:29:08.613Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-067d2d3f659e47f0","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:08.618Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4a1164f4b4837ef68dad31e8: done: 0.077111 sec","job_status":"done","queue_duration_s":46.769944,"scheduling_latency_s":46.769969,"redis_calls":21,"redis_duration_s":0.00377,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001198,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000455365,"duration_s":0.077111,"completed_at":"2026-08-16T17:29:55.465Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.153184] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.467Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f627726d27c668f3ee4c0ceb","created_at":"2026-08-16T17:29:08.702Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-067d2d3f659e47f0","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:08.707Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f627726d27c668f3ee4c0ceb: start","job_status":"start","queue_duration_s":46.760504,"scheduling_latency_s":46.760542} gitlab # [ 238.278433] gitaly[890]: time="2026-08-16T17:29:55.593Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:55.593" grpc.time_ms=0.322 pid=890 span.kind=server system=grpc gitlab # [ 238.319996] gitaly[890]: time="2026-08-16T17:29:55.635Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:55.634" grpc.time_ms=1.012 pid=890 span.kind=server system=grpc gitlab # [ 238.356443] gitaly[890]: time="2026-08-16T17:29:55.671Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:55.671" grpc.time_ms=0.226 pid=890 span.kind=server system=grpc gitlab # [ 238.376252] gitaly[890]: time="2026-08-16T17:29:55.691Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 diskcache=c07c04f1-3604-453c-a149-327e95f3a95d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:25.461" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:55.562" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.384602] gitaly[890]: time="2026-08-16T17:29:55.699Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=127 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7630 command.oublock=0 command.real_time_ms=118 command.spawn_token_fork_ms=0 command.system_time_ms=83 command.user_time_ms=44 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:25.461" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:55.562" grpc.time_ms=128.899 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 238.482281] gitaly[890]: time="2026-08-16T17:29:55.797Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:30:25.695" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:55.796" grpc.time_ms=1.188 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.506815] nixbot[2562]: INFO: ::ffff:127.0.0.1:32998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.07 seconds) gitlab # [ 238.512768] gitaly[890]: time="2026-08-16T17:29:55.827Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:25.727" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:55.827" grpc.time_ms=0.438 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.528935] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.843Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f627726d27c668f3ee4c0ceb","created_at":"2026-08-16T17:29:08.702Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-067d2d3f659e47f0","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:08.707Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2514,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f627726d27c668f3ee4c0ceb: rescheduled"} gitlab # [ 238.542106] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.856Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f627726d27c668f3ee4c0ceb","created_at":"2026-08-16T17:29:08.702Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-067d2d3f659e47f0","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:08.707Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f627726d27c668f3ee4c0ceb: done: 0.389132 sec","job_status":"done","queue_duration_s":46.760504,"scheduling_latency_s":46.760542,"gitaly_calls":3,"gitaly_duration_s":0.145791,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025376,"redis_read_bytes":462,"redis_write_bytes":29289,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000953,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001836,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009064,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003953,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15577,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005472,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000575,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000579,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001991,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.017,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.02,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.156824,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.332857947,"duration_s":0.389132,"completed_at":"2026-08-16T17:29:55.856Z","load_balancing_strategy":"primary","db_duration_s":0.066542,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.581069] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.858Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9eb5cadefb042f2e23dda25d","created_at":"2026-08-16T17:29:54.183Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.198Z","job_size_bytes":46,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9eb5cadefb042f2e23dda25d: start","job_status":"start","queue_duration_s":1.659443,"scheduling_latency_s":1.659468} gitlab # [ 238.588083] gitaly[890]: time="2026-08-16T17:29:55.903Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T23:29:55.900" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:55.900" grpc.time_ms=2.118 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.605386] gitaly[890]: time="2026-08-16T17:29:55.920Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:30:25.809" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:55.910" grpc.time_ms=9.938 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.625895] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.940Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9eb5cadefb042f2e23dda25d","created_at":"2026-08-16T17:29:54.183Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.198Z","job_size_bytes":46,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9eb5cadefb042f2e23dda25d: done: 0.082412 sec","job_status":"done","queue_duration_s":1.659443,"scheduling_latency_s":1.659468,"gitaly_calls":2,"gitaly_duration_s":0.015932,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006359,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001193,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000485,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001596,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002548,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000428546,"duration_s":0.082412,"completed_at":"2026-08-16T17:29:55.940Z","load_balancing_strategy":"primary","db_duration_s":0.013176,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.629475] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:55.941Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ded35d2119fec93421d93296","created_at":"2026-08-16T17:29:54.218Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.224Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ded35d2119fec93421d93296: start","job_status":"start","queue_duration_s":1.717189,"scheduling_latency_s":1.717202} gitlab # [ 238.733078] gitaly[890]: time="2026-08-16T17:29:56.048Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 diskcache=e8b75a22-0f46-47a9-91b3-0e52ba6004f5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:29:56.017" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.018" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.734226] gitaly[890]: time="2026-08-16T17:29:56.048Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1276 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:29:56.017" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.018" grpc.time_ms=29.628 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.781196] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:56.094Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ded35d2119fec93421d93296","created_at":"2026-08-16T17:29:54.218Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.224Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ded35d2119fec93421d93296: done: 0.153049 sec","job_status":"done","queue_duration_s":1.717189,"scheduling_latency_s":1.717202,"gitaly_calls":1,"gitaly_duration_s":0.033144,"redis_calls":15,"redis_duration_s":0.0525,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000465,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000884,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.049849,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.014,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.024,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.079740582,"duration_s":0.153049,"completed_at":"2026-08-16T17:29:56.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.783417] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:56.096Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8e2627536872dd6fd5c6282c","created_at":"2026-08-16T17:29:54.361Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.363Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8e2627536872dd6fd5c6282c: start","job_status":"start","queue_duration_s":1.733398,"scheduling_latency_s":1.733427} gitlab # [ 238.822173] gitaly[890]: time="2026-08-16T17:29:56.132Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:30:26.021" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.122" grpc.time_ms=9.699 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.831318] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:56.145Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8e2627536872dd6fd5c6282c","created_at":"2026-08-16T17:29:54.361Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.363Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8e2627536872dd6fd5c6282c: done: 0.048815 sec","job_status":"done","queue_duration_s":1.733398,"scheduling_latency_s":1.733427,"gitaly_calls":1,"gitaly_duration_s":0.01229,"redis_calls":16,"redis_duration_s":0.004158,"redis_read_bytes":52,"redis_write_bytes":2047,"redis_queues_calls":1,"redis_queues_duration_s":0.000326,"redis_queues_read_bytes":1,"redis_queues_write_bytes":978,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001222,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001883,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000727,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048815,"completed_at":"2026-08-16T17:29:56.145Z","load_balancing_strategy":"primary","db_duration_s":0.003044,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 238.846774] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:56.148Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4a2166c69102bc235cb60d0b","created_at":"2026-08-16T17:29:54.864Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d7cbcc99e894711032fe394dab9407d81c12e26a7bc2cd53bc23cd30342ef365","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.870Z","job_size_bytes":467,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4a2166c69102bc235cb60d0b: start","job_status":"start","queue_duration_s":1.277078,"scheduling_latency_s":1.277115} gitlab # [ 238.893767] gitaly[890]: time="2026-08-16T17:29:56.179Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:26.078" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.178" grpc.time_ms=0.493 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.894676] gitaly[890]: time="2026-08-16T17:29:56.185Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:30:06.100" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:56.180" grpc.time_ms=4.591 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.939105] gitaly[890]: time="2026-08-16T17:29:56.254Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:30:26.153" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.253" grpc.time_ms=0.522 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 238.956575] gitaly[890]: time="2026-08-16T17:29:56.271Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=123 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:30:26.168" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.268" grpc.time_ms=2.555 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.037066] gitaly[890]: time="2026-08-16T17:29:56.351Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:06.262" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:56.342" grpc.time_ms=8.491 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.418135] gitaly[890]: time="2026-08-16T17:29:56.733Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=958 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:30:26.615" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.716" grpc.time_ms=16.796 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.437304] gitaly[890]: time="2026-08-16T17:29:56.752Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXBV7Q387WV8ZD0CT55K3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:30:26.634" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.735" grpc.time_ms=16.803 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.456717] sidekiq-cluster[2514]: {"severity":"WARN","time":"2026-08-16T17:29:56.771Z","class":"CreatePipelineWorker","correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"cd19ba45625c2443430fbf2ce9fde9139567aa3d","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"cd19ba45625c2443430fbf2ce9fde9139567aa3d","ref":"refs/heads/master"},"retry":0} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 239.461724] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:56.776Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"4a2166c69102bc235cb60d0b","created_at":"2026-08-16T17:29:54.864Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d7cbcc99e894711032fe394dab9407d81c12e26a7bc2cd53bc23cd30342ef365","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.870Z","job_size_bytes":467,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-4a2166c69102bc235cb60d0b: done: 0.628644 sec","job_status":"done","queue_duration_s":1.277078,"scheduling_latency_s":1.277115,"gitaly_calls":7,"gitaly_duration_s":0.074888,"redis_calls":51,"redis_duration_s":0.009842,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.00072,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004213,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001304,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00259,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.500496,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000320431,"duration_s":0.628644,"completed_at":"2026-08-16T17:29:56.776Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041789,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 239.484424] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:56.777Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"43e1ab72-171e-4571-a850-812b5fecba93\"}"],"class":"WebHookWorker","jid":"7bf31ed44ed3dba6a5df189f","created_at":"2026-08-16T17:29:54.978Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4142ce0e19bef55e2cec2539711d7cca3fa7cbd7d600bd7db7f586447284470d","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.982Z","job_size_bytes":1751,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7bf31ed44ed3dba6a5df189f: start","job_status":"start","queue_duration_s":1.795433,"scheduling_latency_s":1.795448} gitlab # [ 239.561274] nixbot[2562]: INFO: ::ffff:127.0.0.1:33018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.05 seconds) gitlab # [ 239.567764] nixbot[2562]: INFO: ::ffff:127.0.0.1:33014 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 239.589530] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:56.904Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"43e1ab72-171e-4571-a850-812b5fecba93\"}"],"class":"WebHookWorker","jid":"7bf31ed44ed3dba6a5df189f","created_at":"2026-08-16T17:29:54.978Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c3f748d4b3134d36","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4142ce0e19bef55e2cec2539711d7cca3fa7cbd7d600bd7db7f586447284470d","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:54.982Z","job_size_bytes":1751,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7bf31ed44ed3dba6a5df189f: done: 0.126149 sec","job_status":"done","queue_duration_s":1.795433,"scheduling_latency_s":1.795448,"redis_calls":19,"redis_duration_s":0.004027,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000929,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000336,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001685,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03278265800000213,"cpu_s":0.079245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000455644,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.126149,"completed_at":"2026-08-16T17:29:56.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003075,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.629918] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:56.944Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"acd5435bacdd4a54b8ed2474","created_at":"2026-08-16T17:29:55.126Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-fe506b90af384d27","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ded35d2119fec93421d93296","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.129Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-acd5435bacdd4a54b8ed2474: start","job_status":"start","queue_duration_s":1.81501,"scheduling_latency_s":1.81505} gitlab # [ 239.653027] gitaly[890]: time="2026-08-16T17:29:56.968Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05SYZD1XP1WKNYPM7EBMEYA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:56.958" grpc.time_ms=9.036 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 239.656241] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 70 gitlab # [ 239.680704] gitaly[890]: time="2026-08-16T17:29:56.995Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS diskcache=13d57915-6fb3-4eae-a574-c9a9c1772d7e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:29:56.979" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.980" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.681732] gitaly[890]: time="2026-08-16T17:29:56.995Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:29:56.979" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:56.980" grpc.time_ms=15.43 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.704916] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.019Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"acd5435bacdd4a54b8ed2474","created_at":"2026-08-16T17:29:55.126Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-fe506b90af384d27","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ded35d2119fec93421d93296","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.129Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-acd5435bacdd4a54b8ed2474: done: 0.074695 sec","job_status":"done","queue_duration_s":1.81501,"scheduling_latency_s":1.81505,"gitaly_calls":1,"gitaly_duration_s":0.017971,"redis_calls":12,"redis_duration_s":0.004104,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001481,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000623,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.035357567,"duration_s":0.074695,"completed_at":"2026-08-16T17:29:57.019Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.707731] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.022Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f96be1194d6cee0fd3e312c5","created_at":"2026-08-16T17:29:55.224Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-fe506b90af384d27","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8da2c7c7bc6b46b1415c92de5eaabd74cc904e3d9944bf08727101be71fdb461","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.226Z","job_size_bytes":467,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f96be1194d6cee0fd3e312c5: start","job_status":"start","queue_duration_s":1.796098,"scheduling_latency_s":1.796144} gitlab # [ 239.722138] gitaly[890]: time="2026-08-16T17:29:57.037Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SYZFNFSQCQAKD0B6G9THW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:57.022" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 239.757798] gitaly[890]: time="2026-08-16T17:29:57.037Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05SYZFNFSQCQAKD0B6G9THW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:57.022" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 239.758543] gitlab-workhorse[825]: time="2026-08-16T17:29:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 239.758955] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 58 gitlab # [ 239.759517] gitaly[890]: time="2026-08-16T17:29:57.039Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05SYZFNFSQCQAKD0B6G9THW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:57.022" grpc.time_ms=16.14 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 239.760112] gitaly[890]: time="2026-08-16T17:29:57.052Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:27.051" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:57.051" grpc.time_ms=0.512 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.761923] gitaly[890]: time="2026-08-16T17:29:57.061Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:30:07.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:57.054" grpc.time_ms=7.105 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.796880] gitaly[890]: time="2026-08-16T17:29:57.082Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:30:27.082" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:57.082" grpc.time_ms=0.457 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.797503] gitaly[890]: time="2026-08-16T17:29:57.086Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=19 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:30:27.084" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:57.084" grpc.time_ms=1.52 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.798086] gitaly[890]: time="2026-08-16T17:29:57.108Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:07.052" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:57.102" grpc.time_ms=5.628 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.865591] nixbot[2562]: {"ts": "2026-08-16T17:29:57.180Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 239.915590] gitaly[890]: time="2026-08-16T17:29:57.230Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SYZPBT4Y1C43MBVJGSRG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:27.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:57.230" grpc.time_ms=0.427 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 239.975059] gitaly[890]: time="2026-08-16T17:29:57.290Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SYZPBT4Y1C43MBVJGSRG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:07.180" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:57.280" grpc.time_ms=9.404 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.044596] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 163 gitlab # [ 240.051311] nixbot[2562]: {"ts": "2026-08-16T17:29:57.366Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d \"HTTP/1.1 201 Created\""} gitlab # [ 240.108730] gitaly[890]: time="2026-08-16T17:29:57.423Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SYZVV77W82CYZPHY9KES7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:27.222" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:57.422" grpc.time_ms=0.744 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.148115] gitaly[890]: time="2026-08-16T17:29:57.463Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SYZVV77W82CYZPHY9KES7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:07.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:57.457" grpc.time_ms=5.905 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.152838] gitaly[890]: time="2026-08-16T17:29:57.467Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:30:27.354" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:57.454" grpc.time_ms=13.335 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.205389] gitaly[890]: time="2026-08-16T17:29:57.520Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXF64TGK17AHTY3PS68PS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:30:27.409" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:57.509" grpc.time_ms=10.936 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.217570] sidekiq-cluster[2514]: {"severity":"WARN","time":"2026-08-16T17:29:57.529Z","class":"CreatePipelineWorker","correlation_id":"01M05SXF64TGK17AHTY3PS68PS","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"cd19ba45625c2443430fbf2ce9fde9139567aa3d","after":"55b03671163490acf063b77d0c1e7e7cc4e90ae6","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"55b03671163490acf063b77d0c1e7e7cc4e90ae6","ref":"refs/heads/master"},"retry":0} gitlab # [ 240.223442] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.536Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f96be1194d6cee0fd3e312c5","created_at":"2026-08-16T17:29:55.224Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-fe506b90af384d27","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8da2c7c7bc6b46b1415c92de5eaabd74cc904e3d9944bf08727101be71fdb461","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.226Z","job_size_bytes":467,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f96be1194d6cee0fd3e312c5: done: 0.513611 sec","job_status":"done","queue_duration_s":1.796098,"scheduling_latency_s":1.796144,"gitaly_calls":7,"gitaly_duration_s":0.089738,"redis_calls":33,"redis_duration_s":0.004975,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000613,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001292,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002137,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.390218,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.513611,"completed_at":"2026-08-16T17:29:57.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016573,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 240.242572] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.538Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"fc67bd0f-9799-46da-be24-496955309817\"}"],"class":"WebHookWorker","jid":"dd8d609e1e4b04cec9fc1721","created_at":"2026-08-16T17:29:55.236Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-fe506b90af384d27","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fbe1d0a504714be7bea4336aed67c0792c7c814f8c8f00a6cedcef12f37d44eb","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.237Z","job_size_bytes":1749,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dd8d609e1e4b04cec9fc1721: start","job_status":"start","queue_duration_s":2.300708,"scheduling_latency_s":2.300739} gitlab # [ 240.243198] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 172 gitlab # [ 240.243819] nixbot[2562]: {"ts": "2026-08-16T17:29:57.545Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d \"HTTP/1.1 201 Created\""} gitlab # [ 240.264879] gitaly[890]: time="2026-08-16T17:29:57.580Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ01CJ203BCRDPPVYMW51 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:27.379" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:57.579" grpc.time_ms=0.476 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.297864] gitaly[890]: time="2026-08-16T17:29:57.613Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ01CJ203BCRDPPVYMW51 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:07.157" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:57.607" grpc.time_ms=4.948 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.309479] nixbot[2562]: INFO: ::ffff:127.0.0.1:33030 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 240.319404] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.634Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"fc67bd0f-9799-46da-be24-496955309817\"}"],"class":"WebHookWorker","jid":"dd8d609e1e4b04cec9fc1721","created_at":"2026-08-16T17:29:55.236Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-fe506b90af384d27","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fbe1d0a504714be7bea4336aed67c0792c7c814f8c8f00a6cedcef12f37d44eb","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.237Z","job_size_bytes":1749,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dd8d609e1e4b04cec9fc1721: done: 0.09613 sec","job_status":"done","queue_duration_s":2.300708,"scheduling_latency_s":2.300739,"redis_calls":14,"redis_duration_s":0.002267,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000337,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001249,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000681,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.017524015000020654,"cpu_s":0.023561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.09613,"completed_at":"2026-08-16T17:29:57.634Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.323224] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.638Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"72640c6739420982fbc15796","created_at":"2026-08-16T17:29:55.551Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.554Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-72640c6739420982fbc15796: start","job_status":"start","queue_duration_s":2.083268,"scheduling_latency_s":2.083287} gitlab # [ 240.384611] nixbot[2562]: {"ts": "2026-08-16T17:29:57.699Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d \"HTTP/1.1 201 Created\""} gitlab # [ 240.385417] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/cd19ba45625c2443430fbf2ce9fde9139567aa3d HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 151 gitlab # [ 240.385809] gitaly[890]: time="2026-08-16T17:29:57.700Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ04G5ZCW7C82GKM7X28E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:57.694" grpc.time_ms=5.739 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 240.386444] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 52 gitlab # [ 240.403386] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.718Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"72640c6739420982fbc15796","created_at":"2026-08-16T17:29:55.551Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.554Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-72640c6739420982fbc15796: done: 0.080246 sec","job_status":"done","queue_duration_s":2.083268,"scheduling_latency_s":2.083287,"redis_calls":10,"redis_duration_s":0.002245,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000394464,"duration_s":0.080246,"completed_at":"2026-08-16T17:29:57.718Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017082,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 240.406760] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.720Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6e3925e70752f6ae2b66abf9","created_at":"2026-08-16T17:29:55.704Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.708Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6e3925e70752f6ae2b66abf9: start","job_status":"start","queue_duration_s":2.012236,"scheduling_latency_s":2.012257} gitlab # [ 240.435127] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.749Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"6e3925e70752f6ae2b66abf9","created_at":"2026-08-16T17:29:55.704Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.708Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-6e3925e70752f6ae2b66abf9: done: 0.029291 sec","job_status":"done","queue_duration_s":2.012236,"scheduling_latency_s":2.012257,"redis_calls":10,"redis_duration_s":0.003831,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222933,"duration_s":0.029291,"completed_at":"2026-08-16T17:29:57.749Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.451867] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"66e983fea00763aa8e808bd9","created_at":"2026-08-16T17:29:55.716Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.726Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-66e983fea00763aa8e808bd9: start","job_status":"start","queue_duration_s":2.024997,"scheduling_latency_s":2.025011} gitlab # [ 240.491494] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.771Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"66e983fea00763aa8e808bd9","created_at":"2026-08-16T17:29:55.716Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.726Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-66e983fea00763aa8e808bd9: done: 0.020922 sec","job_status":"done","queue_duration_s":2.024997,"scheduling_latency_s":2.025011,"redis_calls":10,"redis_duration_s":0.001254,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000246,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201702,"duration_s":0.020922,"completed_at":"2026-08-16T17:29:57.771Z","load_balancing_strategy":"primary","db_duration_s":0.003335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.526590] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.772Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e114c74780a01c0400c97fda","created_at":"2026-08-16T17:29:55.737Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.741Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e114c74780a01c0400c97fda: start","job_status":"start","queue_duration_s":2.031586,"scheduling_latency_s":2.031599} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 240.527632] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.793Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e114c74780a01c0400c97fda","created_at":"2026-08-16T17:29:55.737Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.741Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e114c74780a01c0400c97fda: done: 0.020886 sec","job_status":"done","queue_duration_s":2.031586,"scheduling_latency_s":2.031599,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000346,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199188,"duration_s":0.020886,"completed_at":"2026-08-16T17:29:57.793Z","load_balancing_strategy":"primary","db_duration_s":0.00273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.548533] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.794Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3405fb9f165342d963b42593","created_at":"2026-08-16T17:29:55.741Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.744Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3405fb9f165342d963b42593: start","job_status":"start","queue_duration_s":2.050286,"scheduling_latency_s":2.050299} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.05 seconds) gitlab # [ 240.582996] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.820Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3405fb9f165342d963b42593","created_at":"2026-08-16T17:29:55.741Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.744Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3405fb9f165342d963b42593: done: 0.025485 sec","job_status":"done","queue_duration_s":2.050286,"scheduling_latency_s":2.050299,"redis_calls":10,"redis_duration_s":0.002257,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000368,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000290819,"duration_s":0.025485,"completed_at":"2026-08-16T17:29:57.820Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.596113] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.821Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"b0200322bf039149a5bb22bf","created_at":"2026-08-16T17:29:55.744Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.748Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-b0200322bf039149a5bb22bf: start","job_status":"start","queue_duration_s":2.072945,"scheduling_latency_s":2.072957} gitlab # [ 240.633285] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.841Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"b0200322bf039149a5bb22bf","created_at":"2026-08-16T17:29:55.744Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.748Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-b0200322bf039149a5bb22bf: done: 0.019797 sec","job_status":"done","queue_duration_s":2.072945,"scheduling_latency_s":2.072957,"redis_calls":11,"redis_duration_s":0.002318,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000436,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001464,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000275454,"duration_s":0.019797,"completed_at":"2026-08-16T17:29:57.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003624,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.672945] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.842Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"17d72595b007739ca3f26bd8","created_at":"2026-08-16T17:29:55.750Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.752Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-17d72595b007739ca3f26bd8: start","job_status":"start","queue_duration_s":2.089414,"scheduling_latency_s":2.089427} gitlab # [ 240.673849] nixbot[2562]: INFO: ::ffff:127.0.0.1:33046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab # [ 240.674400] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.864Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"17d72595b007739ca3f26bd8","created_at":"2026-08-16T17:29:55.750Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.752Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-17d72595b007739ca3f26bd8: done: 0.022482 sec","job_status":"done","queue_duration_s":2.089414,"scheduling_latency_s":2.089427,"redis_calls":10,"redis_duration_s":0.002119,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000434,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000419,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000291657,"duration_s":0.022482,"completed_at":"2026-08-16T17:29:57.864Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.727691] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.866Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a100e85b3bed134ceafaea0b","created_at":"2026-08-16T17:29:55.753Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.756Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a100e85b3bed134ceafaea0b: start","job_status":"start","queue_duration_s":2.10988,"scheduling_latency_s":2.109893} gitlab # [ 240.728483] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a100e85b3bed134ceafaea0b","created_at":"2026-08-16T17:29:55.753Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.756Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a100e85b3bed134ceafaea0b: done: 0.026334 sec","job_status":"done","queue_duration_s":2.10988,"scheduling_latency_s":2.109893,"redis_calls":10,"redis_duration_s":0.002209,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000407,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000456,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000324343,"duration_s":0.026334,"completed_at":"2026-08-16T17:29:57.892Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005466,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.743370] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.893Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6085d112ce78748f2a6d854e","created_at":"2026-08-16T17:29:55.760Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.763Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6085d112ce78748f2a6d854e: start","job_status":"start","queue_duration_s":2.130416,"scheduling_latency_s":2.130429} gitlab # [ 240.756747] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.929Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6085d112ce78748f2a6d854e","created_at":"2026-08-16T17:29:55.760Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.763Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6085d112ce78748f2a6d854e: done: 0.03561 sec","job_status":"done","queue_duration_s":2.130416,"scheduling_latency_s":2.130429,"redis_calls":10,"redis_duration_s":0.0054789999999999995,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000693,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004208,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000578,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367645,"duration_s":0.03561,"completed_at":"2026-08-16T17:29:57.929Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.796919] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.930Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ce3895ba1b18c867ab7665c2","created_at":"2026-08-16T17:29:55.763Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.766Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ce3895ba1b18c867ab7665c2: start","job_status":"start","queue_duration_s":2.164601,"scheduling_latency_s":2.164614} gitlab # [ 240.805382] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.946Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ce3895ba1b18c867ab7665c2","created_at":"2026-08-16T17:29:55.763Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.766Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ce3895ba1b18c867ab7665c2: done: 0.016012 sec","job_status":"done","queue_duration_s":2.164601,"scheduling_latency_s":2.164614,"redis_calls":10,"redis_duration_s":0.002077,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000407,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029082,"duration_s":0.016012,"completed_at":"2026-08-16T17:29:57.946Z","load_balancing_strategy":"primary","db_duration_s":0.002523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.866664] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.947Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"fd8a1ead66b8d052212e1cf1","created_at":"2026-08-16T17:29:55.766Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.768Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-fd8a1ead66b8d052212e1cf1: start","job_status":"start","queue_duration_s":2.178819,"scheduling_latency_s":2.178832} gitlab # [ 240.867496] gitaly[890]: time="2026-08-16T17:29:58.094Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:58.093" grpc.time_ms=0.731 pid=890 span.kind=server system=grpc gitlab # [ 240.868146] gitaly[890]: time="2026-08-16T17:29:58.117Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:58.116" grpc.time_ms=0.41 pid=890 span.kind=server system=grpc gitlab # [ 240.869069] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.971Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"fd8a1ead66b8d052212e1cf1","created_at":"2026-08-16T17:29:55.766Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.768Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-fd8a1ead66b8d052212e1cf1: done: 0.02417 sec","job_status":"done","queue_duration_s":2.178819,"scheduling_latency_s":2.178832,"redis_calls":10,"redis_duration_s":0.002061,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000397,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000408,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000298641,"duration_s":0.02417,"completed_at":"2026-08-16T17:29:57.971Z","load_balancing_strategy":"primary","db_duration_s":0.006823,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.931705] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:57.973Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"3490cee6453e61bda18699b0","created_at":"2026-08-16T17:29:55.776Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.783Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-3490cee6453e61bda18699b0: start","job_status":"start","queue_duration_s":2.189705,"scheduling_latency_s":2.189718} gitlab # [ 240.932493] gitaly[890]: time="2026-08-16T17:29:58.138Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:58.137" grpc.time_ms=1.482 pid=890 span.kind=server system=grpc gitlab # [ 240.933034] gitaly[890]: time="2026-08-16T17:29:58.149Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 diskcache=94da44ba-5109-4b37-a4f7-49205bd7a4f4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:28.068" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:58.069" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 240.933647] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.020Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"3490cee6453e61bda18699b0","created_at":"2026-08-16T17:29:55.776Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.783Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-3490cee6453e61bda18699b0: done: 0.04775 sec","job_status":"done","queue_duration_s":2.189705,"scheduling_latency_s":2.189718,"redis_calls":14,"redis_duration_s":0.0032489999999999997,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001504,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001315,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000406197,"duration_s":0.04775,"completed_at":"2026-08-16T17:29:58.020Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.972578] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.022Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"429111ccaa33eb524e64c7d6","created_at":"2026-08-16T17:29:55.844Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.846Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-429111ccaa33eb524e64c7d6: start","job_status":"start","queue_duration_s":2.17533,"scheduling_latency_s":2.175343} gitlab # [ 240.979403] gitaly[890]: time="2026-08-16T17:29:58.150Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=80 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7415 command.oublock=0 command.real_time_ms=70 command.spawn_token_fork_ms=1 command.system_time_ms=52 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:28.068" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:58.069" grpc.time_ms=79.965 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.019749] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.207Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"429111ccaa33eb524e64c7d6","created_at":"2026-08-16T17:29:55.844Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.846Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2514,"job_status":"rescheduled","message":"PipelineProcessWorker JID-429111ccaa33eb524e64c7d6: rescheduled"} gitlab # [ 241.020524] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.211Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"429111ccaa33eb524e64c7d6","created_at":"2026-08-16T17:29:55.844Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-44aa4d8a990c41ab","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.846Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-429111ccaa33eb524e64c7d6: done: 0.189443 sec","job_status":"done","queue_duration_s":2.17533,"scheduling_latency_s":2.175343,"gitaly_calls":3,"gitaly_duration_s":0.086915,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008918,"redis_read_bytes":149,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000514,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000667,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002346,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003071,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000219,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00034,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001247,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0727,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.165649545,"duration_s":0.189443,"completed_at":"2026-08-16T17:29:58.211Z","load_balancing_strategy":"primary","db_duration_s":0.025568,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.042187] gitaly[890]: time="2026-08-16T17:29:58.181Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:30:28.080" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:58.181" grpc.time_ms=0.633 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.052571] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.212Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"34c7ccfb34a779f19e7705a3","created_at":"2026-08-16T17:29:55.929Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-4720598d61624722","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.932Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-34c7ccfb34a779f19e7705a3: start","job_status":"start","queue_duration_s":2.279544,"scheduling_latency_s":2.279558} gitlab # [ 241.092193] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"34c7ccfb34a779f19e7705a3","created_at":"2026-08-16T17:29:55.929Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-4720598d61624722","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:55.932Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-34c7ccfb34a779f19e7705a3: done: 0.027487 sec","job_status":"done","queue_duration_s":2.279544,"scheduling_latency_s":2.279558,"redis_calls":19,"redis_duration_s":0.0026000000000000003,"redis_read_bytes":22,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000331,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000476,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004410336,"duration_s":0.027487,"completed_at":"2026-08-16T17:29:58.239Z","load_balancing_strategy":"primary","db_duration_s":0.004479,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.101216] gitaly[890]: time="2026-08-16T17:29:58.202Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SXFWP0DSR3PJCZZAZQNH8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:28.101" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:58.201" grpc.time_ms=0.386 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 241.111186] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.240Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7bf31ed44ed3dba6a5df189f"],"class":"WebHooks::LogExecutionWorker","jid":"edd8bf582f0a4d6f8ee40e78","created_at":"2026-08-16T17:29:56.886Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c4f1d77b9f6e4f88","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3b07e9ec9c7d1e8e05b45a1547eb9a1998ed8f48abea6f741944dc841f7d88ed","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:56.893Z","job_size_bytes":2593,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-edd8bf582f0a4d6f8ee40e78: start","job_status":"start","queue_duration_s":1.346873,"scheduling_latency_s":1.346886} gitlab # [ 241.124901] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.267Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7bf31ed44ed3dba6a5df189f"],"class":"WebHooks::LogExecutionWorker","jid":"edd8bf582f0a4d6f8ee40e78","created_at":"2026-08-16T17:29:56.886Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c4f1d77b9f6e4f88","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3b07e9ec9c7d1e8e05b45a1547eb9a1998ed8f48abea6f741944dc841f7d88ed","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:56.893Z","job_size_bytes":2593,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-edd8bf582f0a4d6f8ee40e78: done: 0.026571 sec","job_status":"done","queue_duration_s":1.346873,"scheduling_latency_s":1.346886,"redis_calls":10,"redis_duration_s":0.001373,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213714,"duration_s":0.026571,"completed_at":"2026-08-16T17:29:58.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.163501] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.268Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dd8d609e1e4b04cec9fc1721"],"class":"WebHooks::LogExecutionWorker","jid":"44e10a1f2ce0967bb6540de8","created_at":"2026-08-16T17:29:57.627Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-98bf920ff3f84316","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aa032eba196c76daf7163673558ae0dc0bcb34878224b0ba00195572974247f1","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:57.629Z","job_size_bytes":2591,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-44e10a1f2ce0967bb6540de8: start","job_status":"start","queue_duration_s":0.638798,"scheduling_latency_s":0.638811} gitlab # [ 241.200232] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.283Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dd8d609e1e4b04cec9fc1721"],"class":"WebHooks::LogExecutionWorker","jid":"44e10a1f2ce0967bb6540de8","created_at":"2026-08-16T17:29:57.627Z","trace_propagation_headers":{"sentry-trace":"1587d43f470c469e94d0a2614807f253-98bf920ff3f84316","baggage":"sentry-trace_id=1587d43f470c469e94d0a2614807f253,sentry-release=Unknown"},"correlation_id":"01M05SXF64TGK17AHTY3PS68PS","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aa032eba196c76daf7163673558ae0dc0bcb34878224b0ba00195572974247f1","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:57.629Z","job_size_bytes":2591,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-44e10a1f2ce0967bb6540de8: done: 0.014459 sec","job_status":"done","queue_duration_s":0.638798,"scheduling_latency_s":0.638811,"redis_calls":7,"redis_duration_s":0.0009,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014459,"completed_at":"2026-08-16T17:29:58.283Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.237826] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.283Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"affe2cd0c46fa25872b07172","created_at":"2026-08-16T17:29:58.063Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.065Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-affe2cd0c46fa25872b07172: start","job_status":"start","queue_duration_s":0.218771,"scheduling_latency_s":0.218785} gitlab # [ 241.238359] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"affe2cd0c46fa25872b07172","created_at":"2026-08-16T17:29:58.063Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.065Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-affe2cd0c46fa25872b07172: done: 0.025863 sec","job_status":"done","queue_duration_s":0.218771,"scheduling_latency_s":0.218785,"redis_calls":7,"redis_duration_s":0.00094,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025863,"completed_at":"2026-08-16T17:29:58.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006622,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.272766] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.310Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"965859ff38a9d816d90c3819","created_at":"2026-08-16T17:29:58.154Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.155Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-965859ff38a9d816d90c3819: start","job_status":"start","queue_duration_s":0.154932,"scheduling_latency_s":0.154945} gitlab # [ 241.273549] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.325Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"965859ff38a9d816d90c3819","created_at":"2026-08-16T17:29:58.154Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.155Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-965859ff38a9d816d90c3819: done: 0.015079 sec","job_status":"done","queue_duration_s":0.154932,"scheduling_latency_s":0.154945,"redis_calls":7,"redis_duration_s":0.000931,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015079,"completed_at":"2026-08-16T17:29:58.325Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.308669] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.326Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7d11e3701da62fa9803d6d10","created_at":"2026-08-16T17:29:58.160Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.161Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7d11e3701da62fa9803d6d10: start","job_status":"start","queue_duration_s":0.165152,"scheduling_latency_s":0.165165} gitlab # [ 241.313198] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.342Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7d11e3701da62fa9803d6d10","created_at":"2026-08-16T17:29:58.160Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.161Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7d11e3701da62fa9803d6d10: done: 0.015392 sec","job_status":"done","queue_duration_s":0.165152,"scheduling_latency_s":0.165165,"redis_calls":7,"redis_duration_s":0.0009270000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015392,"completed_at":"2026-08-16T17:29:58.341Z","load_balancing_strategy":"primary","db_duration_s":0.002501,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.362943] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.342Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"77a005284896ea18b66d4373","created_at":"2026-08-16T17:29:58.166Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.167Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-77a005284896ea18b66d4373: start","job_status":"start","queue_duration_s":0.17563,"scheduling_latency_s":0.175644} gitlab # [ 241.363494] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.371Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"77a005284896ea18b66d4373","created_at":"2026-08-16T17:29:58.166Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.167Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-77a005284896ea18b66d4373: done: 0.028298 sec","job_status":"done","queue_duration_s":0.17563,"scheduling_latency_s":0.175644,"redis_calls":10,"redis_duration_s":0.00345,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002473,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000394,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028298,"completed_at":"2026-08-16T17:29:58.371Z","load_balancing_strategy":"primary","db_duration_s":0.00774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.393616] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.372Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e03cf4ed1657bee3b0c6209a","created_at":"2026-08-16T17:29:58.167Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.168Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e03cf4ed1657bee3b0c6209a: start","job_status":"start","queue_duration_s":0.203446,"scheduling_latency_s":0.203461} gitlab # [ 241.406883] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.386Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e03cf4ed1657bee3b0c6209a","created_at":"2026-08-16T17:29:58.167Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.168Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e03cf4ed1657bee3b0c6209a: done: 0.014386 sec","job_status":"done","queue_duration_s":0.203446,"scheduling_latency_s":0.203461,"redis_calls":7,"redis_duration_s":0.000889,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000242,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014386,"completed_at":"2026-08-16T17:29:58.386Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002173,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.447208] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.387Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0773e4a06b7529e7ca6bfbbb","created_at":"2026-08-16T17:29:58.168Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.170Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0773e4a06b7529e7ca6bfbbb: start","job_status":"start","queue_duration_s":0.217158,"scheduling_latency_s":0.217171} gitlab # [ 241.453494] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.400Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0773e4a06b7529e7ca6bfbbb","created_at":"2026-08-16T17:29:58.168Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.170Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0773e4a06b7529e7ca6bfbbb: done: 0.013474 sec","job_status":"done","queue_duration_s":0.217158,"scheduling_latency_s":0.217171,"redis_calls":8,"redis_duration_s":0.001007,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013474,"completed_at":"2026-08-16T17:29:58.400Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.519708] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.401Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"212c1a97676d771d35d3ba51","created_at":"2026-08-16T17:29:58.170Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.171Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-212c1a97676d771d35d3ba51: start","job_status":"start","queue_duration_s":0.229988,"scheduling_latency_s":0.230002} gitlab # [ 241.520490] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.413Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"212c1a97676d771d35d3ba51","created_at":"2026-08-16T17:29:58.170Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.171Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-212c1a97676d771d35d3ba51: done: 0.012355 sec","job_status":"done","queue_duration_s":0.229988,"scheduling_latency_s":0.230002,"redis_calls":7,"redis_duration_s":0.000961,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012355,"completed_at":"2026-08-16T17:29:58.413Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.554854] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.414Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4bd2716adc4b202a0cd0768b","created_at":"2026-08-16T17:29:58.171Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.172Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4bd2716adc4b202a0cd0768b: start","job_status":"start","queue_duration_s":0.24206,"scheduling_latency_s":0.242073} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 241.555718] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.430Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4bd2716adc4b202a0cd0768b","created_at":"2026-08-16T17:29:58.171Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.172Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4bd2716adc4b202a0cd0768b: done: 0.016068 sec","job_status":"done","queue_duration_s":0.24206,"scheduling_latency_s":0.242073,"redis_calls":7,"redis_duration_s":0.000937,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000679,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016068,"completed_at":"2026-08-16T17:29:58.430Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.598732] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.431Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"dea0d2fb9e4c11ce7eea01f0","created_at":"2026-08-16T17:29:58.173Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.173Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-dea0d2fb9e4c11ce7eea01f0: start","job_status":"start","queue_duration_s":0.257874,"scheduling_latency_s":0.257888} gitlab # [ 241.599666] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"dea0d2fb9e4c11ce7eea01f0","created_at":"2026-08-16T17:29:58.173Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.173Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-dea0d2fb9e4c11ce7eea01f0: done: 0.008034 sec","job_status":"done","queue_duration_s":0.257874,"scheduling_latency_s":0.257888,"redis_calls":7,"redis_duration_s":0.000879,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000629,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008034,"completed_at":"2026-08-16T17:29:58.439Z","load_balancing_strategy":"primary","db_duration_s":0.000232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.641580] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.440Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"c1831209fe5a33cf1146c2f5","created_at":"2026-08-16T17:29:58.174Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.174Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-c1831209fe5a33cf1146c2f5: start","job_status":"start","queue_duration_s":0.265656,"scheduling_latency_s":0.26567} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.06 seconds) gitlab # [ 241.642579] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.453Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"c1831209fe5a33cf1146c2f5","created_at":"2026-08-16T17:29:58.174Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.174Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-c1831209fe5a33cf1146c2f5: done: 0.012968 sec","job_status":"done","queue_duration_s":0.265656,"scheduling_latency_s":0.26567,"redis_calls":7,"redis_duration_s":0.001076,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012968,"completed_at":"2026-08-16T17:29:58.453Z","load_balancing_strategy":"primary","db_duration_s":0.00187,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.680321] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.454Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"a1ebeb4b29810332bc820686","created_at":"2026-08-16T17:29:58.207Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.208Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a1ebeb4b29810332bc820686: start","job_status":"start","queue_duration_s":0.245976,"scheduling_latency_s":0.245989} gitlab # [ 241.715380] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.468Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"a1ebeb4b29810332bc820686","created_at":"2026-08-16T17:29:58.207Z","trace_propagation_headers":{"sentry-trace":"6c28f951bf764047bb75d7a4494e4d41-204bac9a5e4b4e5d","baggage":"sentry-trace_id=6c28f951bf764047bb75d7a4494e4d41,sentry-release=Unknown"},"correlation_id":"01M05SXFWP0DSR3PJCZZAZQNH8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.208Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a1ebeb4b29810332bc820686: done: 0.014208 sec","job_status":"done","queue_duration_s":0.245976,"scheduling_latency_s":0.245989,"redis_calls":8,"redis_duration_s":0.000985,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000751,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000234,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014208,"completed_at":"2026-08-16T17:29:58.468Z","load_balancing_strategy":"primary","db_duration_s":0.001981,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 241.719811] nixbot[2562]: INFO: ::ffff:127.0.0.1:33054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab # [ 241.720869] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0a71461e00f8ef848ec21033","created_at":"2026-08-16T17:29:58.232Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c96ac8598c914219","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.235Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0a71461e00f8ef848ec21033: start","job_status":"start","queue_duration_s":0.234425,"scheduling_latency_s":0.234437} gitlab # [ 241.758900] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:58.527Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"0a71461e00f8ef848ec21033","created_at":"2026-08-16T17:29:58.232Z","trace_propagation_headers":{"sentry-trace":"ec4100527e454f15bb81559ccf7ab5a8-c96ac8598c914219","baggage":"sentry-trace_id=ec4100527e454f15bb81559ccf7ab5a8,sentry-release=Unknown"},"correlation_id":"01M05SXBV7Q387WV8ZD0CT55K3","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:58.235Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-0a71461e00f8ef848ec21033: done: 0.058088 sec","job_status":"done","queue_duration_s":0.234425,"scheduling_latency_s":0.234437,"redis_calls":11,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203378,"duration_s":0.058088,"completed_at":"2026-08-16T17:29:58.527Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 241.832056] gitaly[890]: time="2026-08-16T17:29:59.146Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ066QA5ZD1PHCD10211Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.135" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 241.840402] gitaly[890]: time="2026-08-16T17:29:59.146Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ066QA5ZD1PHCD10211Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.135" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 241.851429] gitlab-workhorse[825]: time="2026-08-16T17:29:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 241.853097] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1444 gitlab # [ 241.854725] gitaly[890]: time="2026-08-16T17:29:59.147Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ066QA5ZD1PHCD10211Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.135" grpc.time_ms=11.671 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 241.928658] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 55 gitlab # [ 241.929619] nix-daemon[2783]: accepted connection from pid 3288, user nixbot gitlab # [ 241.930102] gitaly[890]: time="2026-08-16T17:29:59.243Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ1MKR53RT5YGEW204YGF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.233" grpc.time_ms=9.265 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 241.982249] gitaly[890]: time="2026-08-16T17:29:59.297Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ1PS0D345BYET49Q230F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.291" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 241.982923] gitaly[890]: time="2026-08-16T17:29:59.297Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ1PS0D345BYET49Q230F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.291" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 241.983493] gitlab-workhorse[825]: time="2026-08-16T17:29:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 241.983880] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 40 gitlab # [ 241.984489] gitaly[890]: time="2026-08-16T17:29:59.297Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ1PS0D345BYET49Q230F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.291" grpc.time_ms=5.817 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.097780] gitaly[890]: time="2026-08-16T17:29:59.412Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ1T7DFZX6PA9K7SXQ640 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.401" grpc.time_ms=11.486 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.099418] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 45 gitlab # [ 242.162116] gitaly[890]: time="2026-08-16T17:29:59.477Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ1VQ7FPZK14Z1TCWE0PT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.465" pid=890 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 242.180897] gitaly[890]: time="2026-08-16T17:29:59.477Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ1VQ7FPZK14Z1TCWE0PT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.465" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.182387] gitaly[890]: time="2026-08-16T17:29:59.496Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ1VQ7FPZK14Z1TCWE0PT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:29:59.465" grpc.time_ms=30.316 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 242.210455] gitlab-workhorse[825]: time="2026-08-16T17:29:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 242.211142] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 109 gitlab # [ 242.293786] gitaly[890]: time="2026-08-16T17:29:59.608Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:29.307" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:59.607" grpc.time_ms=0.817 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.314204] gitaly[890]: time="2026-08-16T17:29:59.629Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:30:29.320" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:59.620" grpc.time_ms=8.355 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.357276] gitaly[890]: time="2026-08-16T17:29:59.672Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:09.073" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:59.663" grpc.time_ms=8.109 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.396755] gitaly[890]: time="2026-08-16T17:29:59.711Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:30:09.120" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:59.711" grpc.time_ms=0.322 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.431264] gitaly[890]: time="2026-08-16T17:29:59.746Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:30:09.145" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:29:59.735" grpc.time_ms=10.207 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.484536] gitaly[890]: time="2026-08-16T17:29:59.799Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:59.798" grpc.time_ms=0.529 pid=890 span.kind=server system=grpc gitlab # [ 242.535485] gitaly[890]: time="2026-08-16T17:29:59.850Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:29:59.849" grpc.time_ms=0.56 pid=890 span.kind=server system=grpc gitlab # [ 242.560727] gitaly[890]: time="2026-08-16T17:29:59.875Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 diskcache=506d71c4-17d3-4a04-a6ae-2f43f14a11b4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:30:09.159" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:59.749" pid=890 ref=refs/keep-around/55b03671163490acf063b77d0c1e7e7cc4e90ae6 remote_ip="2001:db8:1::1" revision=55b03671163490acf063b77d0c1e7e7cc4e90ae6 span.kind=server system=grpc username=root gitlab # [ 242.561624] gitaly[890]: time="2026-08-16T17:29:59.876Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=103 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5554 command.oublock=8 command.real_time_ms=117 command.spawn_token_fork_ms=0 command.system_time_ms=69 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:30:09.159" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:29:59.749" grpc.time_ms=126.288 pid=890 ref=refs/keep-around/55b03671163490acf063b77d0c1e7e7cc4e90ae6 remote_ip="2001:db8:1::1" revision=55b03671163490acf063b77d0c1e7e7cc4e90ae6 span.kind=server system=grpc username=root gitlab # [ 242.566342] gitaly[890]: time="2026-08-16T17:29:59.881Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:29.580" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:29:59.880" grpc.time_ms=0.41 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.578342] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:59.892Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"43cbdc0d7b0f34f4de506444","created_at":"2026-08-16T17:29:59.885Z","trace_propagation_headers":{"sentry-trace":"c1b65e1ce70c41d39af4df207a70dd4f-f2cd4a19f93a4d04","baggage":"sentry-trace_id=c1b65e1ce70c41d39af4df207a70dd4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SZ20HDRYNTK686D182247","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:59.890Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-43cbdc0d7b0f34f4de506444: start","job_status":"start","queue_duration_s":0.001949,"scheduling_latency_s":0.001991} gitlab # [ 242.606220] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:59.921Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"43cbdc0d7b0f34f4de506444","created_at":"2026-08-16T17:29:59.885Z","trace_propagation_headers":{"sentry-trace":"c1b65e1ce70c41d39af4df207a70dd4f-f2cd4a19f93a4d04","baggage":"sentry-trace_id=c1b65e1ce70c41d39af4df207a70dd4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SZ20HDRYNTK686D182247","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:59.890Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-43cbdc0d7b0f34f4de506444: done: 0.028918 sec","job_status":"done","queue_duration_s":0.001949,"scheduling_latency_s":0.001991,"redis_calls":7,"redis_duration_s":0.0016719999999999999,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028918,"completed_at":"2026-08-16T17:29:59.921Z","load_balancing_strategy":"primary","db_duration_s":0.007275,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.625200] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:29:59.922Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8d6541232ce6fca9299f6fea","created_at":"2026-08-16T17:29:59.892Z","trace_propagation_headers":{"sentry-trace":"c1b65e1ce70c41d39af4df207a70dd4f-f2cd4a19f93a4d04","baggage":"sentry-trace_id=c1b65e1ce70c41d39af4df207a70dd4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SZ20HDRYNTK686D182247","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:59.897Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8d6541232ce6fca9299f6fea: start","job_status":"start","queue_duration_s":0.024884,"scheduling_latency_s":0.024899} gitlab # [ 242.674073] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:29:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 419 gitlab # [ 242.675086] nixbot[2562]: {"ts": "2026-08-16T17:29:59.990Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/55b03671163490acf063b77d0c1e7e7cc4e90ae6 \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6' gitlab # [ 242.680716] nixbot[2562]: {"ts": "2026-08-16T17:29:59.995Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-55b036711634-4"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6', in 0.03 seconds) (finished: subtest: push delivers the webhook, in 52.73 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/55b03671163490acf063b77d0c1e7e7cc4e90ae6/statuses gitlab # [ 242.685280] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:00.000Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8d6541232ce6fca9299f6fea","created_at":"2026-08-16T17:29:59.892Z","trace_propagation_headers":{"sentry-trace":"c1b65e1ce70c41d39af4df207a70dd4f-f2cd4a19f93a4d04","baggage":"sentry-trace_id=c1b65e1ce70c41d39af4df207a70dd4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SZ20HDRYNTK686D182247","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:59.897Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8d6541232ce6fca9299f6fea: done: 0.077886 sec","job_status":"done","queue_duration_s":0.024884,"scheduling_latency_s":0.024899,"redis_calls":10,"redis_duration_s":0.003024,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002047,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.077886,"completed_at":"2026-08-16T17:30:00.000Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.694347] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:00.008Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5e9cd1894ac0afaefdd7b5d2","created_at":"2026-08-16T17:29:59.977Z","trace_propagation_headers":{"sentry-trace":"c1b65e1ce70c41d39af4df207a70dd4f-f2cd4a19f93a4d04","baggage":"sentry-trace_id=c1b65e1ce70c41d39af4df207a70dd4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SZ20HDRYNTK686D182247","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:59.980Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5e9cd1894ac0afaefdd7b5d2: start","job_status":"start","queue_duration_s":0.027955,"scheduling_latency_s":0.02798} gitlab # [ 242.703475] nixbot[2562]: INFO: ::ffff:127.0.0.1:33064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 200 OK gitlab # [ 242.723282] nix-daemon[2783]: accepted connection from pid 3345, user nixbot gitlab # [ 242.762340] gitaly[890]: time="2026-08-16T17:30:00.077Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:30:30.073" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:30:00.074" grpc.time_ms=3.015 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.773627] gitaly[890]: time="2026-08-16T17:30:00.088Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ2FBYT5Y4P6D3AG5RZNK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:30.088" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:30:00.088" grpc.time_ms=0.303 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.791539] nix-daemon[2783]: accepted connection from pid 3362, user nixbot gitlab # [ 242.800325] gitaly[890]: time="2026-08-16T17:30:00.115Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ20HDRYNTK686D182247 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:30.013" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:30:00.113" grpc.time_ms=1.544 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 242.810541] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:30:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/55b03671163490acf063b77d0c1e7e7cc4e90ae6/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 78 gitlab # [ 242.811186] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:00.123Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5e9cd1894ac0afaefdd7b5d2","created_at":"2026-08-16T17:29:59.977Z","trace_propagation_headers":{"sentry-trace":"c1b65e1ce70c41d39af4df207a70dd4f-f2cd4a19f93a4d04","baggage":"sentry-trace_id=c1b65e1ce70c41d39af4df207a70dd4f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SZ20HDRYNTK686D182247","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:29:59.980Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5e9cd1894ac0afaefdd7b5d2: done: 0.115238 sec","job_status":"done","queue_duration_s":0.027955,"scheduling_latency_s":0.02798,"gitaly_calls":2,"gitaly_duration_s":0.009311,"redis_calls":35,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004508,"redis_read_bytes":80,"redis_write_bytes":5206,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00059,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000869,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00018,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000351,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000367,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05709,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.081333242,"duration_s":0.115238,"completed_at":"2026-08-16T17:30:00.123Z","load_balancing_strategy":"primary","db_duration_s":0.037511,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 242.818517] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:00.124Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8f66b8e2a3e2eb01938cc969","created_at":"2026-08-16T17:30:00.064Z","trace_propagation_headers":{"sentry-trace":"c1b65e1ce70c41d39af4df207a70dd4f-d247696122654cc4","baggage":"sentry-trace_id=c1b65e1ce70c41d39af4df207a70dd4f,sentry-release=Unknown"},"correlation_id":"01M05SZ20HDRYNTK686D182247","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.065Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8f66b8e2a3e2eb01938cc969: start","job_status":"start","queue_duration_s":0.059003,"scheduling_latency_s":0.059017} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/55b03671163490acf063b77d0c1e7e7cc4e90ae6/statuses, in 0.17 seconds) gitlab # [ 242.863843] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:00.150Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8f66b8e2a3e2eb01938cc969","created_at":"2026-08-16T17:30:00.064Z","trace_propagation_headers":{"sentry-trace":"c1b65e1ce70c41d39af4df207a70dd4f-d247696122654cc4","baggage":"sentry-trace_id=c1b65e1ce70c41d39af4df207a70dd4f,sentry-release=Unknown"},"correlation_id":"01M05SZ20HDRYNTK686D182247","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.065Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8f66b8e2a3e2eb01938cc969: done: 0.025666 sec","job_status":"done","queue_duration_s":0.059003,"scheduling_latency_s":0.059017,"redis_calls":7,"redis_duration_s":0.005314,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025666,"completed_at":"2026-08-16T17:30:00.150Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 242.902056] nixbot[2562]: {"ts": "2026-08-16T17:30:00.216Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-55b036711634-4", "argv0": "bwrap"} gitlab # [ 242.963080] nix-daemon[2783]: accepted connection from pid 3373, user nixbot gitlab # [ 243.031749] nix-daemon[2783]: accepted connection from pid 3383, user nixbot gitlab # [ 243.047852] nix-daemon[2783]: accepted connection from pid 3373, user nixbot gitlab # [ 243.167923] gitaly[890]: time="2026-08-16T17:30:00.482Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:30.280" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:30:00.481" grpc.time_ms=0.941 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.225415] gitaly[890]: time="2026-08-16T17:30:00.540Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:10.077" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:30:00.528" grpc.time_ms=11.98 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.304108] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:00.618Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"1a3191f26ccefb5f47464933","created_at":"2026-08-16T17:30:00.611Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e2cd0f019d00458e","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.616Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1a3191f26ccefb5f47464933: start","job_status":"start","queue_duration_s":0.002269,"scheduling_latency_s":0.002316} gitlab # [ 243.354423] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:30:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 260 gitlab # [ 243.356329] nixbot[2562]: {"ts": "2026-08-16T17:30:00.670Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/55b03671163490acf063b77d0c1e7e7cc4e90ae6 \"HTTP/1.1 201 Created\""} gitlab # [ 243.438175] gitaly[890]: time="2026-08-16T17:30:00.752Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ332VRSH70QRYT4P1RFK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:30.751" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:30:00.751" grpc.time_ms=0.862 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.476951] gitaly[890]: time="2026-08-16T17:30:00.791Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:30:00.790" grpc.time_ms=0.543 pid=890 span.kind=server system=grpc gitlab # [ 243.511074] gitaly[890]: time="2026-08-16T17:30:00.826Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:30:00.825" grpc.time_ms=0.297 pid=890 span.kind=server system=grpc gitlab # [ 243.522485] gitaly[890]: time="2026-08-16T17:30:00.837Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=9 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ332VRSH70QRYT4P1RFK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:10.233" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:30:00.824" grpc.time_ms=12.863 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.538209] gitaly[890]: time="2026-08-16T17:30:00.853Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:30:00.852" grpc.time_ms=0.567 pid=890 span.kind=server system=grpc gitlab # [ 243.548902] gitaly[890]: time="2026-08-16T17:30:00.863Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:30.648" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:30:00.749" operations="[repack_refs]" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.550038] gitaly[890]: time="2026-08-16T17:30:00.865Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:30.648" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:30:00.749" pid=890 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 17:29:02.487058949 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 243.559902] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:30:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 199 gitlab # [ 243.560801] nixbot[2562]: {"ts": "2026-08-16T17:30:00.875Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/55b03671163490acf063b77d0c1e7e7cc4e90ae6 \"HTTP/1.1 201 Created\""} gitlab # [ 243.563136] gitaly[890]: time="2026-08-16T17:30:00.878Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:30.648" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:30:00.749" pid=890 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 243.563707] gitaly[890]: time="2026-08-16T17:30:00.878Z" level=info msg="optimized repository" clean_stale_data_time=12.775087ms clean_work_trees_time="68.445µs" commit_graph_time="3.632µs" correlation_id=01M05SZ2TQG5865QW37G1HDZ6J gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.631µs" pid=890 prune_time="3.353µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=12.960586ms gitlab # [ 243.564448] gitaly[890]: time="2026-08-16T17:30:00.878Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:30.648" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:30:00.749" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.598225] gitaly[890]: time="2026-08-16T17:30:00.913Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J diskcache=68a6393b-9269-41fb-9ff6-827628fbc595 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:30.648" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:30:00.749" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.606365] gitaly[890]: time="2026-08-16T17:30:00.913Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=132 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=8589 command.oublock=0 command.real_time_ms=122 command.spawn_token_fork_ms=0 command.system_time_ms=87 command.user_time_ms=45 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:30:30.648" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:30:00.749" grpc.time_ms=164.442 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.606948] gitaly[890]: time="2026-08-16T17:30:00.920Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ39P8F1PEX14Z543MEEK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:30.619" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:30:00.919" grpc.time_ms=0.39 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.627921] gitaly[890]: time="2026-08-16T17:30:00.943Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ39P8F1PEX14Z543MEEK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:30:10.058" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:30:00.938" grpc.time_ms=4.545 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.659254] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:30:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/55b03671163490acf063b77d0c1e7e7cc4e90ae6 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 87 gitlab # [ 243.661635] nixbot[2562]: {"ts": "2026-08-16T17:30:00.975Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/55b03671163490acf063b77d0c1e7e7cc4e90ae6 \"HTTP/1.1 201 Created\""} gitlab # [ 243.664182] gitaly[890]: time="2026-08-16T17:30:00.975Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:30:30.873" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:30:00.973" grpc.time_ms=0.888 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.690384] gitaly[890]: time="2026-08-16T17:30:01.005Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ2TQG5865QW37G1HDZ6J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:31.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:30:01.005" grpc.time_ms=0.435 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 243.697194] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.011Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"50e4bc49fac095e7766bc572","created_at":"2026-08-16T17:30:01.010Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"1a3191f26ccefb5f47464933","job_size_bytes":3,"pid":2514,"job_status":"deduplicated","message":"PipelineProcessWorker JID-50e4bc49fac095e7766bc572: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 243.697934] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.013Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"1a3191f26ccefb5f47464933","created_at":"2026-08-16T17:30:00.611Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e2cd0f019d00458e","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.616Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2514,"job_status":"rescheduled","message":"PipelineProcessWorker JID-1a3191f26ccefb5f47464933: rescheduled"} gitlab # [ 243.702253] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.017Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"1a3191f26ccefb5f47464933","created_at":"2026-08-16T17:30:00.611Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e2cd0f019d00458e","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.616Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-1a3191f26ccefb5f47464933: done: 0.398712 sec","job_status":"done","queue_duration_s":0.002269,"scheduling_latency_s":0.002316,"gitaly_calls":3,"gitaly_duration_s":0.172172,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014737,"redis_read_bytes":239,"redis_write_bytes":21784,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001824,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001094,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003533,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14469,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.004167,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000401,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000338,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001556,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.073,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.016,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.139699,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.353429277,"duration_s":0.398712,"completed_at":"2026-08-16T17:30:01.017Z","load_balancing_strategy":"primary","db_duration_s":0.088059,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.730718] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.018Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7c64cc643ac3df818d5d1ae0","created_at":"2026-08-16T17:30:00.736Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.739Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7c64cc643ac3df818d5d1ae0: start","job_status":"start","queue_duration_s":0.278233,"scheduling_latency_s":0.278248} gitlab # [ 243.773104] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.043Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7c64cc643ac3df818d5d1ae0","created_at":"2026-08-16T17:30:00.736Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.739Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7c64cc643ac3df818d5d1ae0: done: 0.024932 sec","job_status":"done","queue_duration_s":0.278233,"scheduling_latency_s":0.278248,"redis_calls":7,"redis_duration_s":0.000951,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024932,"completed_at":"2026-08-16T17:30:01.043Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004766,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 243.777579] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.043Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2d02671bab438b57b39b3c02","created_at":"2026-08-16T17:30:00.917Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.919Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2d02671bab438b57b39b3c02: start","job_status":"start","queue_duration_s":0.124631,"scheduling_latency_s":0.124645} gitlab # [ 243.790853] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.059Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2d02671bab438b57b39b3c02","created_at":"2026-08-16T17:30:00.917Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.919Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2d02671bab438b57b39b3c02: done: 0.015437 sec","job_status":"done","queue_duration_s":0.124631,"scheduling_latency_s":0.124645,"redis_calls":7,"redis_duration_s":0.0009060000000000001,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015437,"completed_at":"2026-08-16T17:30:01.059Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.835970] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.060Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"81b9c65c8147dedb0b5839c8","created_at":"2026-08-16T17:30:00.946Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.947Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-81b9c65c8147dedb0b5839c8: start","job_status":"start","queue_duration_s":0.112395,"scheduling_latency_s":0.112409} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/55b03671163490acf063b77d0c1e7e7cc4e90ae6/statuses gitlab # [ 243.870572] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.076Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"81b9c65c8147dedb0b5839c8","created_at":"2026-08-16T17:30:00.946Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.947Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-81b9c65c8147dedb0b5839c8: done: 0.015848 sec","job_status":"done","queue_duration_s":0.112395,"scheduling_latency_s":0.112409,"redis_calls":7,"redis_duration_s":0.000944,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015848,"completed_at":"2026-08-16T17:30:01.076Z","load_balancing_strategy":"primary","db_duration_s":0.002996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.871658] nix-daemon[2783]: accepted connection from pid 3432, user nixbot gitlab # [ 243.872208] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.077Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"957c720372ec4af24e597fef","created_at":"2026-08-16T17:30:00.953Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.955Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-957c720372ec4af24e597fef: start","job_status":"start","queue_duration_s":0.121426,"scheduling_latency_s":0.121439} gitlab # [ 243.884422] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.100Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"957c720372ec4af24e597fef","created_at":"2026-08-16T17:30:00.953Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.955Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-957c720372ec4af24e597fef: done: 0.023014 sec","job_status":"done","queue_duration_s":0.121426,"scheduling_latency_s":0.121439,"redis_calls":10,"redis_duration_s":0.001445,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000501,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023014,"completed_at":"2026-08-16T17:30:01.100Z","load_balancing_strategy":"primary","db_duration_s":0.005279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.929655] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.101Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a2f274acf10f3c0f456f6295","created_at":"2026-08-16T17:30:00.956Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.957Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a2f274acf10f3c0f456f6295: start","job_status":"start","queue_duration_s":0.144102,"scheduling_latency_s":0.14412} gitlab # [ 243.931550] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.116Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a2f274acf10f3c0f456f6295","created_at":"2026-08-16T17:30:00.956Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.957Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a2f274acf10f3c0f456f6295: done: 0.015648 sec","job_status":"done","queue_duration_s":0.144102,"scheduling_latency_s":0.14412,"redis_calls":7,"redis_duration_s":0.00098,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015648,"completed_at":"2026-08-16T17:30:01.116Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 243.972771] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.117Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"354d5cd611bcac014413c3fb","created_at":"2026-08-16T17:30:00.957Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.958Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-354d5cd611bcac014413c3fb: start","job_status":"start","queue_duration_s":0.158983,"scheduling_latency_s":0.158997} gitlab # [ 243.978589] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.132Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"354d5cd611bcac014413c3fb","created_at":"2026-08-16T17:30:00.957Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.958Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-354d5cd611bcac014413c3fb: done: 0.014987 sec","job_status":"done","queue_duration_s":0.158983,"scheduling_latency_s":0.158997,"redis_calls":8,"redis_duration_s":0.0011489999999999998,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014987,"completed_at":"2026-08-16T17:30:01.132Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/55b03671163490acf063b77d0c1e7e7cc4e90ae6/statuses, in 0.17 seconds) gitlab # [ 244.015532] gitaly[890]: time="2026-08-16T17:30:01.268Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05SZ3MHAW4BGD3PE14K05T7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:30:31.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:30:01.267" grpc.time_ms=0.423 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root (finished: subtest: eval and build post commit statuses, in 1.35 seconds) gitlab # [ 244.022531] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:30:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 93 (finished: run the VM test script, in 293.00 seconds) gitlab # [ 244.024083] gitlab-workhorse[825]: time="2026-08-16T17:30:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 244.025574] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:30:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 39 gitlab # [ 244.027339] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.133Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5adc736d6ca977a0b2932457","created_at":"2026-08-16T17:30:00.959Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.960Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5adc736d6ca977a0b2932457: start","job_status":"start","queue_duration_s":0.17346,"scheduling_latency_s":0.173478} test script finished in 293.03s cleanup kill QemuMachine (pid 46) gitlab # [ 244.070927] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-08-16T17:30:01.146Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5adc736d6ca977a0b2932457","created_at":"2026-08-16T17:30:00.959Z","trace_propagation_headers":{"sentry-trace":"4ecc4d55a6dc40f4af73e996fa3e1689-e71829f42c8b4d03","baggage":"sentry-trace_id=4ecc4d55a6dc40f4af73e996fa3e1689,sentry-release=Unknown"},"correlation_id":"01M05SZ2TQG5865QW37G1HDZ6J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:00.960Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7wm","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5adc736d6ca977a0b2932457: done: 0.013251 sec","job_status":"done","queue_duration_s":0.17346,"scheduling_latency_s":0.173478,"redis_calls":7,"redis_duration_s":0.000879,"redis_read_bqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) gitlab # y (finished: cleanup, in 1.35 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T17:29:07.177Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '55b03671163490acf063b77d0c1e7e7cc4e90ae6', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T17:29:59.558227Z', 'started_at': '2026-08-16T17:29:59.991438Z', 'finished_at': None}] [{'id': 5, 'sha': '55b03671163490acf063b77d0c1e7e7cc4e90ae6', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:29:59.971Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '55b03671163490acf063b77d0c1e7e7cc4e90ae6', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-16T17:29:59.971Z', 'started_at': None, 'finished_at': '2026-08-16T17:30:00.599Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '55b03671163490acf063b77d0c1e7e7cc4e90ae6', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-16T17:30:00.858Z', 'started_at': None, 'finished_at': '2026-08-16T17:30:00.958Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]