vm-test-run-nixbot-gitlab
default.checks.x86_64-linux.nixbot-gitlab
· build #234
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.e1FYFiPSVb', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 10882c1f-d19a-414d-bab8-6c52fec2d85f16gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20gitlab # Writing inode tables: 0/8 done21gitlab # Creating journal (8192 blocks): done22gitlab # Writing superblocks and filesystem accounting information: 0/8 done23gitlab # 24gitlab # Virtualisation disk image created.25gitlab # Creating Nix store image...26gitlab # Created Nix store image.27(finished: start all VMs, in 68.37 seconds)28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/y7c8gk2v0hms0dmaacj4qqb9msxj3wv8-nixos-system-gitlab-test/init regInfo=/nix/store/c6p1qaa7k7cvxx0mxz4kxmp7wqbpqzzm-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 457339933 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000806] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000834] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000837] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002739] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002752] Using GB pages for direct mapping73gitlab # [ 0.002893] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002902] ACPI: Early table checksum verification disabled75gitlab # [ 0.002905] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002909] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002914] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002922] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002924] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002926] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002927] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002929] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002930] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002931] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002932] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002932] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002932] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002933] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003165] No NUMA configuration found90gitlab # [ 0.003166] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003168] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005496] Zone ranges:93gitlab # [ 0.005497] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005498] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005499] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005501] Device empty97gitlab # [ 0.005501] Movable zone start for each node98gitlab # [ 0.005502] Early memory node ranges99gitlab # [ 0.005503] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005504] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005505] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005506] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005527] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005797] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.120522] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.120966] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.120990] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.121029] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.121032] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.121034] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.121036] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.121037] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.121037] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.121040] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.121041] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.121048] TSC deadline timer available117gitlab # [ 0.121053] CPU topo: Max. logical packages: 1118gitlab # [ 0.121054] CPU topo: Max. logical dies: 1119gitlab # [ 0.121054] CPU topo: Max. dies per package: 1120gitlab # [ 0.121058] CPU topo: Max. threads per core: 1121gitlab # [ 0.121058] CPU topo: Num. cores per package: 4122gitlab # [ 0.121059] CPU topo: Num. threads per package: 4123gitlab # [ 0.121059] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.121086] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.121105] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.121108] kvm-guest: setup PV sched yield127gitlab # [ 0.121125] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.121127] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.121128] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.121130] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.121132] Booting paravirtualized kernel on KVM132gitlab # [ 0.121135] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.125623] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.127941] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.128004] kvm-guest: PV spinlocks enabled136gitlab # [ 0.128005] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.128009] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/y7c8gk2v0hms0dmaacj4qqb9msxj3wv8-nixos-system-gitlab-test/init regInfo=/nix/store/c6p1qaa7k7cvxx0mxz4kxmp7wqbpqzzm-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.128112] Unknown kernel command line parameters "regInfo=/nix/store/c6p1qaa7k7cvxx0mxz4kxmp7wqbpqzzm-closure-info/registration", will be passed to user space.139gitlab # [ 0.128127] random: crng init done140gitlab # [ 0.128127] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.137934] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.142577] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.142669] software IO TLB: area num 4.144gitlab # [ 0.223118] Fallback order for Node 0: 0145gitlab # [ 0.223128] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.223130] Policy zone: Normal147gitlab # [ 0.225879] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.236325] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.250615] allocated 12582912 bytes of page_ext150gitlab # [ 0.261656] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.261658] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.262649] Dynamic Preempt: lazy153gitlab # [ 0.262859] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.262860] rcu: RCU event tracing is enabled.155gitlab # [ 0.262861] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.262862] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.262863] Rude variant of Tasks RCU enabled.158gitlab # [ 0.262863] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.262864] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.262865] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.262891] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.262893] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.262894] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.267470] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.267772] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.267781] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.267906] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.271485] Console: colour VGA+ 80x25169gitlab # [ 0.271488] printk: legacy console [tty0] enabled170gitlab # [ 0.302250] printk: legacy console [ttyS0] enabled171gitlab # [ 0.400165] ACPI: Core revision 20250807172gitlab # [ 0.401097] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.402613] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.403562] x2apic enabled175gitlab # [ 0.404328] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.405243] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.406402] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.407818] kvm-guest: setup PV IPIs179gitlab # [ 0.409356] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.410377] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.412094] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.413179] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.415212] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.417090] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.418095] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.420091] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.421091] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.422859] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.423829] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.424888] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.426098] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.427091] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.428092] active return thunk: srso_alias_return_thunk194gitlab # [ 0.429112] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.430091] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.431091] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.432900] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.433910] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.434893] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.436090] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.437092] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.438090] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.439090] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.440091] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.441091] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.442090] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.472014] Freeing SMP alternatives memory: 44K208gitlab # [ 0.472654] pid_max: default: 32768 minimum: 301209gitlab # [ 0.473202] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.474209] landlock: Up and running.211gitlab # [ 0.475581] Yama: becoming mindful.212gitlab # [ 0.476315] LSM support for eBPF active213gitlab # [ 0.477484] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.478256] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.481688] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.482777] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.483096] ... version: 2218gitlab # [ 0.483828] ... bit width: 48219gitlab # [ 0.484093] ... generic counters: 6220gitlab # [ 0.484836] ... generic bitmap: 000000000000003f221gitlab # [ 0.485143] ... fixed-purpose counters: 0222gitlab # [ 0.485910] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.486821] ... value mask: 0000ffffffffffff224gitlab # [ 0.487093] ... max period: 00007fffffffffff225gitlab # [ 0.488002] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.488907] signal: max sigframe size: 3376227gitlab # [ 0.489672] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.490096] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.491166] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.496711] smp: Bringing up secondary CPUs ...231gitlab # [ 0.497514] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.498103] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.501272] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.503095] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.504455] Memory: 6011620K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.507094] devtmpfs: initialized237gitlab # [ 0.508261] x86/mm: Memory block size: 128MB238gitlab # [ 0.511265] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.513137] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.514187] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.515357] PM: RTC time: 17:02:33, date: 2026-08-16242gitlab # [ 0.519314] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.521496] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.522157] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.524933] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.526105] audit: initializing netlink subsys (disabled)247gitlab # [ 0.527156] audit: type=2000 audit(1786899754.702:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.527449] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.529094] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.530093] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.531093] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.532093] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.533109] cpuidle: using governor menu254gitlab # [ 0.535328] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.536338] PCI: Using configuration type 1 for base access256gitlab # [ 0.537094] PCI: Using configuration type 1 for extended access257gitlab # [ 0.538246] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.540408] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.541985] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.542967] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.543985] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.547906] ACPI: Added _OSI(Module Device)263gitlab # [ 0.548619] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.549095] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.552074] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.556351] ACPI: Interpreter enabled267gitlab # [ 0.557112] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.557854] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.558131] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.559094] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.560350] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.565856] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.566957] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.568502] acpiphp: Slot [3] registered275gitlab # [ 0.569136] acpiphp: Slot [4] registered276gitlab # [ 0.569881] acpiphp: Slot [5] registered277gitlab # [ 0.570115] acpiphp: Slot [6] registered278gitlab # [ 0.570805] acpiphp: Slot [7] registered279gitlab # [ 0.572126] acpiphp: Slot [8] registered280gitlab # [ 0.572865] acpiphp: Slot [9] registered281gitlab # [ 0.573115] acpiphp: Slot [10] registered282gitlab # [ 0.573855] acpiphp: Slot [11] registered283gitlab # [ 0.575137] acpiphp: Slot [12] registered284gitlab # [ 0.575863] acpiphp: Slot [13] registered285gitlab # [ 0.576114] acpiphp: Slot [14] registered286gitlab # [ 0.576851] acpiphp: Slot [15] registered287gitlab # [ 0.578116] acpiphp: Slot [16] registered288gitlab # [ 0.578834] acpiphp: Slot [17] registered289gitlab # [ 0.579113] acpiphp: Slot [18] registered290gitlab # [ 0.579855] acpiphp: Slot [19] registered291gitlab # [ 0.581115] acpiphp: Slot [20] registered292gitlab # [ 0.581820] acpiphp: Slot [21] registered293gitlab # [ 0.582114] acpiphp: Slot [22] registered294gitlab # [ 0.582845] acpiphp: Slot [23] registered295gitlab # [ 0.584115] acpiphp: Slot [24] registered296gitlab # [ 0.584823] acpiphp: Slot [25] registered297gitlab # [ 0.585113] acpiphp: Slot [26] registered298gitlab # [ 0.585846] acpiphp: Slot [27] registered299gitlab # [ 0.586114] acpiphp: Slot [28] registered300gitlab # [ 0.586836] acpiphp: Slot [29] registered301gitlab # [ 0.588184] acpiphp: Slot [30] registered302gitlab # [ 0.588932] acpiphp: Slot [31] registered303gitlab # [ 0.589602] PCI host bridge to bus 0000:00304gitlab # [ 0.590100] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.591093] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.592093] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.594094] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.595094] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.596094] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.597327] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.599612] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.601515] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.604122] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.605007] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.605939] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.606840] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.608094] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.609256] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.612123] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.614114] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.615365] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.617100] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.618336] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.633146] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.634106] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.635110] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.636278] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.638887] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.643707] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.645101] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.646082] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.658059] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.660321] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.665126] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.666045] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.666853] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.669335] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.673221] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.674721] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.676116] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.678318] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.681079] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.682699] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.683115] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.686342] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.690127] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.690966] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.691805] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.694399] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.698102] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.699055] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.699893] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.702301] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.706355] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.707740] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.709116] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.710126] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.712318] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.715106] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.716083] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.718333] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.722101] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.722971] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.723894] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.726255] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.728896] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.729771] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.731115] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.735832] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.737247] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.738281] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.739228] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.741170] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.743766] iommu: Default domain type: Translated375gitlab # [ 0.743870] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.746833] ACPI: bus type USB registered377gitlab # [ 0.747995] usbcore: registered new interface driver usbfs378gitlab # [ 0.749112] usbcore: registered new interface driver hub379gitlab # [ 0.751150] usbcore: registered new device driver usb380gitlab # [ 0.754505] NetLabel: Initializing381gitlab # [ 0.755095] NetLabel: domain hash size = 128382gitlab # [ 0.756027] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.757069] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.757941] PCI: Using ACPI for IRQ routing385gitlab # [ 0.760419] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.761089] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.761089] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.764103] vgaarb: loaded389gitlab # [ 0.765047] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.765805] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.770242] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.772383] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.773279] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.775296] pnp: PnP ACPI init395gitlab # [ 0.777088] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.788405] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.790279] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.791567] NET: Registered PF_INET protocol family399gitlab # [ 0.794206] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.814265] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.815710] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.817060] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.820775] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.822049] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.823488] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.824946] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.826302] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.827584] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.828474] NET: Registered PF_XDP protocol family410gitlab # [ 0.829296] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.830260] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.831228] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.832284] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.833391] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.834641] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.835542] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.837903] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.840553] PCI: CLS 0 bytes, default 64419gitlab # [ 0.841336] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.841784] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.842342] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.842468] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.865574] Initialise system trusted keyrings424gitlab # [ 0.866769] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.878390] Key type asymmetric registered426gitlab # [ 0.879087] Asymmetric key parser 'x509' registered427gitlab # [ 0.879990] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.881737] io scheduler mq-deadline registered429gitlab # [ 0.882490] io scheduler kyber registered430gitlab # [ 0.885427] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.886713] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 0.889144] Linux agpgart interface v0.103433gitlab # [ 0.889916] ACPI: bus type drm_connector registered434gitlab # [ 0.893182] usbcore: registered new interface driver usbserial_generic435gitlab # [ 0.894233] usbserial: USB Serial support registered for generic436gitlab # [ 0.895184] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 0.895184] Please enable it if your BIOS has the CPPC option.438gitlab # [ 0.897337] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 0.898667] drop_monitor: Initializing network drop monitor service440gitlab # [ 0.899789] NET: Registered PF_INET6 protocol family441gitlab # [ 0.901570] Segment Routing with IPv6442gitlab # [ 0.902214] In-situ OAM (IOAM) with IPv6443gitlab # [ 0.904900] IPI shorthand broadcast: enabled444gitlab # [ 0.909258] sched_clock: Marking stable (772011009, 136308889)->(928161826, -19841928)445gitlab # [ 0.911102] registered taskstats version 1446gitlab # [ 0.912138] Loading compiled-in X.509 certificates447gitlab # [ 0.922162] Demotion targets for Node 0: null448gitlab # [ 0.923420] Key type .fscrypt registered449gitlab # [ 0.924077] Key type fscrypt-provisioning registered450gitlab # [ 0.925012] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 0.925894] ima: Allocated hash algorithm: sha1452gitlab # [ 0.926648] ima: No architecture policies found453gitlab # [ 0.927672] PM: Magic number: 6:978:36454gitlab # [ 0.929249] RAS: Correctable Errors collector initialized.455gitlab # [ 0.933745] clk: Disabling unused clocks456gitlab # [ 0.934466] PM: genpd: Disabling unused power domains457gitlab # [ 1.138993] Freeing initrd memory: 29392K458gitlab # [ 1.143759] Freeing unused decrypted memory: 2028K459gitlab # [ 1.146496] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.147554] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.149594] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.151217] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.202614] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.203678] Run /init as init process465gitlab # [ 1.218608] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.244923] fuse: init (API version 7.45)467gitlab # [ 1.253198] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.260517] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.264105] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.300377] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.637005] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.678521] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.680623] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.682766] systemd[1]: Running in initrd.475gitlab # [ 1.685203] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.688064] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.801534] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.840294] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.855884] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.857115] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.858530] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.859680] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.860772] systemd[1]: Reached target Path Units.484gitlab # [ 1.861645] systemd[1]: Reached target Slice Units.485gitlab # [ 1.862515] systemd[1]: Reached target Swaps.486gitlab # [ 1.863328] systemd[1]: Reached target Timer Units.487gitlab # [ 1.864279] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.865526] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.866668] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.867677] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.868676] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.869608] systemd[1]: Reached target Socket Units.493gitlab # [ 1.871545] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.873543] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.875506] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 1.878914] systemd[1]: Starting Journal Service...497gitlab # [ 1.892407] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 1.893411] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 1.902427] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 1.907328] systemd-journald[91]: Collecting audit messages is disabled.501gitlab # [ 1.909825] systemd[1]: Finished Create List of Static Device Nodes.502gitlab # [ 1.917433] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 1.927544] systemd[1]: Finished Load Kernel Module configfs.504gitlab # [ 1.936190] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 1.944687] netfs: FS-Cache loaded506gitlab # [ 1.947546] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...507gitlab # [ 1.956255] 9pnet: Installing 9P2000 support508gitlab # [ 1.961350] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.509gitlab # [ 1.964644] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev510gitlab # [ 1.972682] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.511gitlab # [ 1.974609] systemd[1]: Finished Load Kernel Module 9pnet_virtio.512gitlab # [ 1.976641] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 1.978287] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.514gitlab # [ 1.981537] systemd[1]: Starting Apply Kernel Variables...515gitlab # [ 1.845350] systemd-modules-load[93]: Using 4 probe threads516gitlab # [ 1.847282] systemd-modules-load[93]: Inserted module 'virtio_balloon'517gitlab # [ 1.848420] systemd-modules-load[93]: Inserted module 'dm_mod'518gitlab # [ 1.849395] systemd-modules-load[93]: Inserted module 'virtio_gpu'519gitlab # [ 1.989718] systemd[1]: Starting Create Static Device Nodes in /dev...520gitlab # [ 1.990934] systemd[1]: Started Journal Service.521gitlab # [ 1.860523] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 1.865535] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.868112] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.869112] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.869872] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.872266] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.883664] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.894139] systemd-udevd[112]: Using default interface naming scheme 'v261'.529gitlab # [ 1.904601] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 1.925637] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 1.926995] systemd[1]: Reached target System Initialization.532gitlab # [ 1.928254] systemd[1]: Reached target Basic System.533gitlab # [ 2.151245] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.152118] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.153762] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.155891] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140537gitlab # [ 2.158076] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18538gitlab # [ 2.159280] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1539gitlab # [ 2.160392] usb usb1: Product: UHCI Host Controller540gitlab # [ 2.161061] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd541gitlab # [ 2.161824] usb usb1: SerialNumber: 0000:00:01.2542gitlab # [ 2.163460] virtio_blk virtio4: 4/0/0 default/read/poll queues543gitlab # [ 2.163531] hub 1-0:1.0: USB hub found544gitlab # [ 2.165042] hub 1-0:1.0: 2 ports detected545gitlab # [ 2.167627] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)546gitlab # [ 2.171296] virtio_blk virtio5: 4/0/0 default/read/poll queues547gitlab # [ 2.175203] virtio_blk virtio5: [vdb] 11830728 512-byte logical blocks (6.06 GB/5.64 GiB)548gitlab # [ 2.182513] SCSI subsystem initialized549gitlab # [ 2.210635] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12550gitlab # [ 2.215034] serio: i8042 KBD port at 0x60,0x64 irq 1551gitlab # [ 2.215903] serio: i8042 AUX port at 0x60,0x64 irq 12552gitlab # [ 2.087807] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line.553gitlab # [ 2.089690] (udev-worker)[124]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.554gitlab # [ 2.225909] scsi host0: ata_piix555gitlab # [ 2.091785] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line.556gitlab # [ 2.234537] scsi host1: ata_piix557gitlab # [ 2.235453] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0558gitlab # [ 2.236569] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0559gitlab # [ 2.102021] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 2.247237] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0561gitlab # [ 2.118056] systemd[1]: Found device /dev/disk/by-label/nix-store.562gitlab # [ 2.120615] systemd[1]: Found device /dev/disk/by-label/nixos.563gitlab # [ 2.121542] systemd[1]: Reached target Initrd Root Device.564gitlab # [ 2.122315] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...565gitlab # [ 2.123892] systemd-vconsole-setup[151]: Configuration of first virtual console was skipped, ignoring remaining ones.566gitlab # [ 2.131663] systemd[1]: Finished Virtual Console Setup.567gitlab # [ 2.147811] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.152525] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.387509] usb 1-1: new full-speed USB device number 2 using uhci_hcd570gitlab # [ 2.403630] ata2: found unknown device (class 0)571gitlab # [ 2.406222] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100572gitlab # [ 2.410290] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5573gitlab # [ 2.462833] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.489944] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.556234] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.557450] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.558438] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.559025] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.559583] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.575153] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.582762] usbcore: registered new interface driver usbhid582gitlab # [ 2.583902] usbhid: USB HID core driver583gitlab # [ 2.589833] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.592336] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.770917] systemd[1]: Mounting /sysroot...586gitlab # [ 3.053792] EXT4-fs (vda): mounted filesystem 10882c1f-d19a-414d-bab8-6c52fec2d85f r/w with ordered data mode. Quota mode: none.587gitlab # [ 2.920634] systemd[1]: Mounted /sysroot.588gitlab # [ 2.921351] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 2.923312] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 2.925115] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 2.926668] systemd[1]: Mounting /sysroot/run...592gitlab # [ 2.927947] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 2.934106] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 2.935792] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 2.942096] systemd[1]: Mounted /sysroot/run.596gitlab # [ 3.082457] 9p: Installing v9fs 9p2000 file system support597gitlab # [ 2.947421] systemd[1]: Mounted /sysroot/nix/.rw-store.598gitlab # [ 2.949338] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.599gitlab # [ 3.088063] erofs (device vdb): mounted with root inode @ nid 128.600gitlab # [ 2.952139] systemd[1]: Mounted /sysroot/tmp/shared.601gitlab # [ 2.954589] systemd[1]: Mounted /sysroot/tmp/xchg.602gitlab # [ 2.955720] systemd[1]: Mounted /sysroot/nix/.ro-store.603gitlab # [ 2.956729] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...604gitlab # [ 2.958158] systemd[1]: Reloading...605gitlab # [ 3.011840] systemd[1]: Reloading finished in 54 ms.606gitlab # [ 3.032290] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...607gitlab # [ 3.034316] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...608gitlab # [ 3.035633] systemd[1]: Starting rw-sysroot-nix-store.service...609gitlab # [ 3.036418] systemd[1]: initrd-parse-etc.service: Deactivated successfully.610gitlab # [ 3.037265] systemd[1]: Finished Mountpoints Configured in the Real Root.611gitlab # [ 3.038119] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.612gitlab # [ 3.049655] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.613gitlab # [ 3.050739] systemd[1]: Finished rw-sysroot-nix-store.service.614gitlab # [ 3.770776] systemd[1]: Mounting /sysroot/nix/store...615gitlab # [ 3.814619] systemd[1]: Mounted /sysroot/nix/store.616gitlab # [ 3.816927] systemd[1]: Reached target Initrd File Systems.617gitlab # [ 3.820360] systemd[1]: Starting Find NixOS closure...618gitlab # [ 3.823303] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...619gitlab # [ 3.837726] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.620gitlab # [ 3.839675] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.621gitlab # [ 3.850969] systemd[1]: Finished Find NixOS closure.622gitlab # [ 3.852120] systemd[1]: Reached target Initrd Default Target.623gitlab # [ 3.853533] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...624gitlab # [ 3.885681] systemd[1]: Stopped target Initrd Default Target.625gitlab # [ 3.886716] systemd[1]: Stopped target Basic System.626gitlab # [ 3.887559] systemd[1]: Stopped target Initrd Root Device.627gitlab # [ 3.888398] systemd[1]: Stopped target Path Units.628gitlab # [ 3.889208] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.629gitlab # [ 3.890428] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.630gitlab # [ 3.891642] systemd[1]: Stopped target Slice Units.631gitlab # [ 3.893383] systemd[1]: Stopped target Socket Units.632gitlab # [ 3.894755] systemd[1]: Stopped target System Initialization.633gitlab # [ 3.896403] systemd[1]: Stopped target Swaps.634gitlab # [ 3.897268] systemd[1]: Stopped target Timer Units.635gitlab # [ 3.898210] systemd[1]: dbus.socket: Deactivated successfully.636gitlab # [ 3.899097] systemd[1]: Closed D-Bus System Message Bus Socket.637gitlab # [ 3.899897] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.638gitlab # [ 3.900974] systemd[1]: Stopped Find NixOS closure.639gitlab # [ 3.901765] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio640gitlab # [ 3.903261] systemd[1]: Starting rw-sysroot-nix-store.service...641gitlab # [ 3.904090] systemd[1]: systemd-sysctl.service: Deactivated successfully.642gitlab # [ 3.904942] systemd[1]: Stopped Apply Kernel Variables.643gitlab # [ 3.905684] systemd[1]: systemd-modules-load.service: Deactivated successfully.644gitlab # [ 3.906645] systemd[1]: Stopped Load Kernel Modules.645gitlab # [ 3.907349] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.646gitlab # [ 3.908431] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.647gitlab # [ 3.909592] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.648gitlab # [ 3.910564] systemd[1]: Stopped Create System Files and Directories.649gitlab # [ 3.911376] systemd[1]: Stopped target Local File Systems.650gitlab # [ 3.912196] systemd[1]: Stopped target Preparation for Local File Systems.651gitlab # [ 3.913163] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.652gitlab # [ 3.914112] systemd[1]: Stopped Coldplug All udev Devices.653gitlab # [ 3.914845] systemd[1]: Stopping Rule-based Manager for Device Events and Files...654gitlab # [ 3.915812] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.655gitlab # [ 3.916793] systemd[1]: Stopped Virtual Console Setup.656gitlab # [ 3.917512] systemd[1]: initrd-cleanup.service: Deactivated successfully.657gitlab # [ 3.918403] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.658gitlab # [ 3.919266] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.659gitlab # [ 3.920218] systemd[1]: Finished rw-sysroot-nix-store.service.660gitlab # [ 3.921279] systemd[1]: systemd-udevd.service: Deactivated successfully.661gitlab # [ 3.922171] systemd[1]: Stopped Rule-based Manager for Device Events and Files.662gitlab # [ 3.923167] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.663gitlab # [ 3.924139] systemd[1]: Closed udev Control Socket.664gitlab # [ 3.924856] systemd[1]: Starting Cleanup udev Database...665gitlab # [ 3.925761] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.666gitlab # [ 3.926838] systemd[1]: Stopped Create Static Device Nodes in /dev.667gitlab # [ 3.927733] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.668gitlab # [ 3.928764] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.669gitlab # [ 3.929701] systemd[1]: kmod-static-nodes.service: Deactivated successfully.670gitlab # [ 3.930629] systemd[1]: Stopped Create List of Static Device Nodes.671gitlab # [ 3.935209] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.672gitlab # [ 3.936359] systemd[1]: Finished Cleanup udev Database.673gitlab # [ 3.937132] systemd[1]: Reached target Switch Root.674gitlab # [ 3.937960] systemd[1]: Starting NixOS Activation...675gitlab # [ 4.041658] initrd-nixos-activation-start[225]: booting system configuration /nix/store/y7c8gk2v0hms0dmaacj4qqb9msxj3wv8-nixos-system-gitlab-test676gitlab # [ 4.081121] initrd-nixos-activation-start[225]: running activation script...677gitlab # [ 4.252192] initrd-nixos-activation-start[248]: setting up /etc...678gitlab # [ 4.324110] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.679gitlab # [ 4.325988] systemd[1]: Finished NixOS Activation.680gitlab # [ 4.327324] systemd[1]: Starting Switch Root...681gitlab # [ 4.344518] systemd[1]: Switching root.682gitlab # [ 4.528143] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).683gitlab # [ 4.612785] NET: Registered PF_VSOCK protocol family684gitlab # [ 4.980852] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)685gitlab # [ 4.989604] systemd[1]: Detected virtualization kvm.686gitlab # [ 4.991368] systemd[1]: Detected architecture x86-64.687gitlab # [ 4.993220] systemd[1]: Detected first boot.688gitlab # [ 4.995618] systemd[1]: Initializing machine ID from random generator.689gitlab # [ 5.116024] systemd[1]: bpf-restrict-fs: LSM BPF program attached690gitlab # [ 5.171378] systemd[1]: Applying preset policy.691gitlab # [ 5.273697] systemd[1]: Populated /etc with preset unit settings.692gitlab # [ 5.382877] systemd[1]: initrd-switch-root.service: Deactivated successfully.693gitlab # [ 5.384199] systemd[1]: Stopped initrd-switch-root.service.694gitlab # [ 5.386161] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.695gitlab # [ 5.388580] systemd[1]: Created slice Slice /system/getty.696gitlab # [ 5.389886] systemd[1]: Created slice GitLab DevOps Platform Slice.697gitlab # [ 5.391269] systemd[1]: Created slice User and Session Slice.698gitlab # [ 5.392161] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.699gitlab # [ 5.393439] systemd[1]: Started Forward Password Requests to Wall Directory Watch.700gitlab # [ 5.394481] systemd[1]: Expecting device /dev/hvc0...701gitlab # [ 5.395158] systemd[1]: Expecting device /dev/ttyS0...702gitlab # [ 5.395883] systemd[1]: Reached target Local Encrypted Volumes.703gitlab # [ 5.396693] systemd[1]: Stopped target initrd-fs.target.704gitlab # [ 5.397427] systemd[1]: Stopped target initrd-root-fs.target.705gitlab # [ 5.398191] systemd[1]: Stopped target initrd-switch-root.target.706gitlab # [ 5.399026] systemd[1]: Reached target Virtual Machines and Containers.707gitlab # [ 5.399924] systemd[1]: Reached target Path Units.708gitlab # [ 5.400642] systemd[1]: Reached target Remote File Systems.709gitlab # [ 5.401406] systemd[1]: Reached target Slice Units.710gitlab # [ 5.402077] systemd[1]: Reached target Swaps.711gitlab # [ 5.403550] systemd[1]: Listening on Query the User Interactively for a Password.712gitlab # [ 5.405483] systemd[1]: Listening on Process Core Dump Socket.713gitlab # [ 5.406900] systemd[1]: Listening on Credential Encryption/Decryption.714gitlab # [ 5.408505] systemd[1]: Listening on Factory Reset Management.715gitlab # [ 5.409421] systemd[1]: Listening on Hostname Service Socket.716gitlab # [ 5.411875] systemd[1]: Starting Journal Log Access Socket...717gitlab # [ 5.413328] systemd[1]: Listening on Journal Audit Socket.718gitlab # [ 5.415347] systemd[1]: Listening on Console Output Muting Service Socket.719gitlab # [ 5.416448] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.720gitlab # [ 5.417549] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os721gitlab # [ 5.418830] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki722gitlab # [ 5.421701] systemd[1]: Listening on Disk Repartitioning Service Socket.723gitlab # [ 5.422933] systemd[1]: Listening on udev Control Socket.724gitlab # [ 5.423797] systemd[1]: Listening on udev Varlink Socket.725gitlab # [ 5.426146] systemd[1]: Mounting Huge Pages File System...726gitlab # [ 5.427962] systemd[1]: Mounting POSIX Message Queue File System...727gitlab # [ 5.429945] systemd[1]: Mounting Kernel Debug File System...728gitlab # [ 5.432285] systemd[1]: Mounting Kernel Trace File System...729gitlab # [ 5.434924] systemd[1]: Starting Create List of Static Device Nodes...730gitlab # [ 5.436275] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio731gitlab # [ 5.443481] systemd[1]: Starting Load Kernel Module configfs...732gitlab # [ 5.444599] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm733gitlab # [ 5.446397] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore734gitlab # [ 5.448395] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse735gitlab # [ 5.466073] systemd[1]: Mounting FUSE Control File System...736gitlab # [ 5.467044] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67737gitlab # [ 5.470897] systemd[1]: Starting Journal Service...738gitlab # [ 5.473268] systemd[1]: Starting Load Kernel Modules...739gitlab # [ 5.478395] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...740gitlab # [ 5.483401] systemd[1]: Starting Remount Root and Kernel File Systems...741gitlab # [ 5.484624] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os742gitlab # [ 5.487526] systemd[1]: Starting Coldplug All udev Devices...743gitlab # [ 5.490933] systemd[1]: Listening on Journal Log Access Socket.744gitlab # [ 5.492204] systemd[1]: Mounted Huge Pages File System.745gitlab # [ 5.493435] systemd[1]: Mounted POSIX Message Queue File System.746gitlab # [ 5.495468] systemd[1]: Mounted Kernel Debug File System.747gitlab # [ 5.496858] systemd[1]: Mounted Kernel Trace File System.748gitlab # [ 5.496971] systemd-journald[318]: Collecting audit messages is enabled.749gitlab # [ 5.499089] systemd[1]: Finished Create List of Static Device Nodes.750gitlab # [ 5.500697] systemd[1]: modprobe@configfs.service: Deactivated successfully.751gitlab # [ 5.504366] systemd[1]: Finished Load Kernel Module configfs.752gitlab # [ 5.505533] systemd[1]: Mounted FUSE Control File System.753gitlab # [ 5.508369] EXT4-fs (vda): re-mounted 10882c1f-d19a-414d-bab8-6c52fec2d85f.754gitlab # [ 5.513455] systemd[1]: Mounting Kernel Configuration File System...755gitlab # [ 5.379712] systemd[1]: Queued start job for default target Multi-User System.756gitlab # [ 5.381837] systemd[1]: Unnecessary job was removed for /dev/vdb.757gitlab # [ 5.518900] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...758gitlab # [ 5.384308] systemd[1]: systemd-journald.service: Deactivated successfully.759gitlab # [ 5.385614] systemd-modules-load[319]: Using 3 probe threads[ 5.522073] systemd[1]: Started Journal Service.760gitlab # 761gitlab # [ 5.387067] systemd-modules-load[319]: Inserted module 'tls'762gitlab # [ 5.388092] systemd[1]: Finished Remount Root and Kernel File Systems.763gitlab # [ 5.530567] loop: module loaded764gitlab # [ 5.395080] systemd[1]: Mounted Kernel Configuration File System.765gitlab # [ 5.396252] systemd-modules-load[319]: Inserted module 'loop'766gitlab # [ 5.398924] systemd[1]: Listening on Disk Image Download Service Socket.767gitlab # [ 5.400556] systemd[1]: Starting Flush Journal to Persistent Storage...768gitlab # [ 5.401398] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore769gitlab # [ 5.402887] systemd[1]: Starting Load/Save OS Random Seed...770gitlab # [ 5.403663] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os771gitlab # [ 5.404951] systemd-oomd[321]: No swap; memory pressure usage will be degraded772gitlab # [ 5.407837] systemd[1]: Finished Load Kernel Modules.773gitlab # [ 5.409227] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.774gitlab # [ 5.410052] systemd[1]: Starting Firewall...775gitlab # [ 5.410966] systemd[1]: Starting Apply Kernel Variables...776gitlab # [ 5.415078] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.777gitlab # [ 5.553454] systemd-journald[318]: Received client request to flush runtime journal.778gitlab # [ 5.463387] systemd[1]: Starting Create Static Device Nodes in /dev...779gitlab # [ 5.464540] systemd[1]: Finished Apply Kernel Variables.780gitlab # [ 5.465396] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 5.466223] systemd[1]: Reached target First Boot Complete.782gitlab # [ 5.466979] systemd[1]: Finished Create Static Device Nodes in /dev.783gitlab # [ 5.467889] systemd[1]: Reached target Preparation for Local File Systems.784gitlab # [ 5.468854] systemd[1]: Starting Rule-based Manager for Device Events and Files...785gitlab # [ 5.470031] systemd-udevd[350]: Using default interface naming scheme 'v261'.786gitlab # [ 5.470951] systemd[1]: Finished Flush Journal to Persistent Storage.787gitlab # [ 5.499700] systemd[1]: Started Rule-based Manager for Device Events and Files.788gitlab # [ 5.516663] systemd[1]: Finished Coldplug All udev Devices.789gitlab # [ 5.569627] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse790gitlab # [ 5.589362] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.791gitlab # [ 5.651183] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.792gitlab # [ 5.653053] (udev-worker)[422]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.793gitlab # [ 5.655410] (udev-worker)[422]: Network interface NamePolicy= disabled on kernel command line.794gitlab # [ 5.657626] (udev-worker)[431]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 5.830244] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3796gitlab # [ 5.843745] ACPI: button: Power Button [PWRF]797gitlab # [ 5.853033] rtc_cmos 00:05: RTC can wake from S4798gitlab # [ 5.853495] parport_pc 00:03: reported by Plug and Play ACPI799gitlab # [ 5.855620] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]800gitlab # [ 5.858478] rtc_cmos 00:05: registered as rtc0801gitlab # [ 5.859252] rtc_cmos 00:05: setting system clock to 2026-08-16T17:02:39 UTC (1786899759)802gitlab # [ 5.863252] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs803gitlab # [ 5.873357] Floppy drive(s): fd0 is 2.88M AMI BIOS804gitlab # [ 5.876776] systemd-journald[318]: Time jumped backwards, rotating.805gitlab # [ 5.881201] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console806gitlab # [ 5.890459] FDC 0 is a S82078B807gitlab # [ 5.893250] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0808gitlab # [ 5.893993] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD809gitlab # [ 5.894448] Console: switching to colour dummy device 80x25810gitlab # [ 5.896992] [drm] Found bochs VGA, ID 0xb0c5.811gitlab # [ 5.896994] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.812gitlab # [ 5.898890] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic813gitlab # [ 5.899749] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0814gitlab # [ 5.772388] systemd[1]: Condition check resulted in Virtio network device being skipped.815gitlab # [ 5.773874] systemd[1]: Finished Firewall.816gitlab # [ 5.910779] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5817gitlab # [ 5.911066] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4818gitlab # [ 5.912010] Console: switching to colour frame buffer device 160x50819gitlab # [ 5.916679] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device820gitlab # [ 5.782354] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore821gitlab # [ 5.787429] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67822gitlab # [ 5.790466] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore823gitlab # [ 5.791953] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os824gitlab # [ 5.793800] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os825gitlab # [ 5.931686] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6826gitlab # [ 5.947617] mousedev: PS/2 mouse device common for all mice827gitlab # [ 5.850406] systemd[1]: Starting Virtual Console Setup...828gitlab # [ 5.867447] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.829gitlab # [ 5.868837] systemd[1]: Stopped Virtual Console Setup.830gitlab # [ 5.873450] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 5.885098] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 5.886734] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 5.893413] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.055323] ppdev: user-space parallel port driver835gitlab # [ 6.076824] kvm_amd: TSC scaling supported836gitlab # [ 6.077471] kvm_amd: Nested Virtualization enabled837gitlab # [ 6.078042] kvm_amd: Nested Paging enabled838gitlab # [ 6.078583] kvm_amd: LBR virtualization supported839gitlab # [ 6.079232] kvm_amd: Virtual VMLOAD VMSAVE supported840gitlab # [ 6.079853] kvm_amd: Virtual GIF supported841gitlab # [ 6.080450] kvm_amd: Virtual NMI enabled842gitlab # [ 5.978350] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones.843gitlab # [ 5.980881] systemd[1]: Finished Virtual Console Setup.844gitlab # [ 6.189064] EDAC MC: Ver: 3.0.0845gitlab # [ 6.248704] systemd[1]: Mounting /run/wrappers...846gitlab # [ 6.267843] systemd[1]: Mounted /run/wrappers.847gitlab # [ 6.268669] systemd[1]: Reached target Local File Systems.848gitlab # [ 6.269428] systemd[1]: Listening on Boot Loader Control Service Socket.849gitlab # [ 6.270521] systemd[1]: Starting register-nix-paths.service...850gitlab # [ 6.271506] systemd[1]: Starting Create SUID/SGID Wrappers...851gitlab # [ 6.272295] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852gitlab # [ 6.273442] systemd[1]: Starting Save Transient machine-id to Disk...853gitlab # [ 6.277734] systemd[1]: Starting Create System Files and Directories...854gitlab # [ 6.295842] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.855gitlab # [ 6.296886] systemd[1]: Finished Save Transient machine-id to Disk.856gitlab # [ 6.297968] systemd[1]: Finished Create System Files and Directories.857gitlab # [ 6.302091] systemd[1]: Starting Rebuild Journal Catalog...858gitlab # [ 6.303717] systemd[1]: Starting Record System Boot/Shutdown in UTMP...859gitlab # [ 6.317573] systemd[1]: Finished Record System Boot/Shutdown in UTMP.860gitlab # [ 6.328735] systemd[1]: Finished Rebuild Journal Catalog.861gitlab # [ 6.330176] systemd[1]: Starting Update is Completed...862gitlab # [ 6.344219] systemd[1]: Finished Update is Completed.863gitlab # [ 6.365419] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.864gitlab # [ 6.366589] systemd[1]: Finished Create SUID/SGID Wrappers.865gitlab # [ 6.592512] systemd[1]: Finished register-nix-paths.service.866gitlab # [ 6.595856] systemd[1]: Reached target System Initialization.867gitlab # [ 6.598524] systemd[1]: Started Discard unused filesystem blocks once a week.868gitlab # [ 6.601418] systemd[1]: Started logrotate.timer.869gitlab # [ 6.603340] systemd[1]: Started Daily Cleanup of Temporary Directories.870gitlab # [ 6.605847] systemd[1]: Reached target Timer Units.871gitlab # [ 6.607766] systemd[1]: Listening on D-Bus System Message Bus Socket.872gitlab # [ 6.610234] systemd[1]: Listening on Nix Daemon Socket.873gitlab # [ 6.620469] systemd[1]: Starting nixbot CI service socket...874gitlab # [ 6.622654] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.875gitlab # [ 6.625690] systemd[1]: Starting D-Bus System Message Bus...876gitlab # [ 6.628749] systemd[1]: Listening on nixbot CI service socket.877gitlab # [ 6.630956] systemd[1]: Reached target Socket Units.878gitlab # [ 6.674479] dbus-broker-launch[576]: Looking up NSS user entry for 'systemd-timesync'...879gitlab # [ 6.677486] dbus-broker-launch[576]: NSS returned no entry for 'systemd-timesync'880gitlab # [ 6.680035] dbus-broker-launch[576]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"881gitlab # [ 6.685547] systemd[1]: Started D-Bus System Message Bus.882gitlab # [ 6.695876] dbus-broker-launch[576]: Ready883gitlab # [ 6.698938] systemd[1]: Reached target Basic System.884gitlab # [ 6.701409] systemd[1]: Started backdoor.service.885gitlab # [ 6.704299] systemd[1]: Starting gitlab-config.service...886gitlab # [ 6.717197] systemd[1]: Starting Import lastlog data into lastlog2 database...887gitlab # [ 6.719576] systemd[1]: Starting Logrotate configuration check...888gitlab # [ 6.721648] systemd[1]: Starting Name Service Cache Daemon (nsncd)...889gitlab # [ 6.729228] systemd[1]: Starting Post-Boot Actions...890gitlab # [ 6.731510] systemd[1]: Started Reset console on configuration changes.891gitlab # [ 6.736543] logrotate[581]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.892gitlab # [ 6.741123] logrotate[581]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf893gitlab # [ 6.744070] logrotate[581]: note: 'monthly' overrides previously specified 'weekly'894gitlab # connecting to host...895gitlab # [ 6.747652] logrotate[581]: Reading state from file: /var/lib/logrotate.status896gitlab # [ 6.748678] logrotate[581]: state file /var/lib/logrotate.status does not exist897gitlab # [ 6.749522] logrotate[581]: Allocating hash table for state file, size 64 entries898gitlab # [ 6.749833] logrotate[581]: Handling 4 logs899gitlab # [ 6.750637] logrotate[581]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed900gitlab # [ 6.751488] logrotate[581]: considering log /var/log/btmp901gitlab # [ 6.752333] logrotate[581]: Creating new state902gitlab # [ 6.752944] logrotate[581]: Now: 2026-08-16 17:02903gitlab # [ 6.753771] logrotate[581]: Last rotated at 2026-08-16 17:00904gitlab # [ 6.755109] logrotate[581]: log does not need rotating (log has already been rotated)905gitlab # [ 6.755696] logrotate[581]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed906gitlab # [ 6.756056] logrotate[581]: considering log /var/log/wtmp907gitlab # [ 6.756580] logrotate[581]: Creating new state908gitlab # [ 6.757180] logrotate[581]: Now: 2026-08-16 17:02909gitlab # [ 6.757739] logrotate[581]: Last rotated at 2026-08-16 17:00910gitlab # [ 6.758405] logrotate[581]: log does not need rotating (log has already been rotated)911gitlab # [ 6.758893] logrotate[581]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed912gitlab # [ 6.759724] logrotate[581]: switching euid from 0 to 165 and egid from 0 to 165 (pid 581)913gitlab # [ 6.760571] logrotate[581]: considering log /var/gitlab/state/log/*.log914gitlab # [ 6.761391] logrotate[581]: log /var/gitlab/state/log/*.log does not exist -- skipping915gitlab # [ 6.761953] logrotate[581]: Creating new state916gitlab # [ 6.762779] logrotate[581]: switching euid from 165 to 0 and egid from 165 to 0 (pid 581)917gitlab # [ 6.763668] logrotate[581]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed918gitlab # [ 6.764480] logrotate[581]: switching euid from 0 to 60 and egid from 0 to 60 (pid 581)919gitlab # [ 6.765041] logrotate[581]: considering log /var/log/nginx/*.log920gitlab # [ 6.765852] logrotate[581]: log /var/log/nginx/*.log does not exist -- skipping921gitlab # [ 6.766667] logrotate[581]: Creating new state922gitlab # [ 6.767747] logrotate[581]: not running postrotate script, since no logs were rotated923gitlab # [ 6.768430] logrotate[581]: switching euid from 60 to 0 and egid from 60 to 0 (pid 581)924gitlab # [ 6.768915] systemd[1]: Starting resolvconf update...925gitlab # [ 6.769580] systemd[1]: Finished Logrotate configuration check.926gitlab # [ 6.770145] systemd[1]: Finished Post-Boot Actions.927gitlab: Guest shell says: b'Spawning backdoor root shell...\n'928gitlab: connected to guest root shell929gitlab # [ 6.800391] nsncd[582]: Aug 16 17:02:40.576 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"930gitlab: (connecting took 7.39 seconds)931gitlab: (finished: waiting for the VM to finish booting, in 7.39 seconds)932gitlab # [ 6.801149] systemd[1]: Started Name Service Cache Daemon (nsncd).933gitlab # [ 6.803941] systemd[1]: Reached target Host and Network Name Lookups.934gitlab # [ 6.804608] systemd[1]: Reached target User and Group Name Lookups.935gitlab # [ 6.809095] systemd[1]: Starting User Login Management...936gitlab # [ 6.810894] systemd[1]: Finished Import lastlog data into lastlog2 database.937gitlab # [ 6.835453] systemd[1]: Stopped target Host and Network Name Lookups.938gitlab # [ 6.836420] systemd[1]: Stopping Host and Network Name Lookups...939gitlab # [ 6.837220] systemd[1]: Stopped target User and Group Name Lookups.940gitlab # [ 6.838076] systemd[1]: Stopping User and Group Name Lookups...941gitlab # [ 6.838901] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...942gitlab # [ 6.839995] systemd[1]: nscd.service: Deactivated successfully.943gitlab # [ 6.840782] systemd[1]: Stopped Name Service Cache Daemon (nsncd).944gitlab # [ 6.841839] systemd[1]: nscd.service: Consumed 16ms CPU time over 121ms wall clock time, 7.1M memory peak, 5.5M read from disk.945gitlab # [ 6.843740] systemd[1]: Starting Name Service Cache Daemon (nsncd)...946gitlab # [ 6.847359] systemd-logind[629]: New seat seat0.947gitlab # [ 6.851551] systemd-logind[629]: Watching system buttons on /dev/input/event2 (Power Button)948gitlab # [ 6.852194] systemd-logind[629]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)949gitlab # [ 6.852714] systemd-logind[629]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)950gitlab # [ 6.853162] systemd[1]: Started User Login Management.951gitlab # [ 6.856299] systemd[1]: Starting linger-users.service...952gitlab # [ 6.863609] nsncd[670]: Aug 16 17:02:40.639 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"953gitlab # [ 6.865942] systemd[1]: Started Name Service Cache Daemon (nsncd).954gitlab # [ 6.867172] systemd[1]: Reached target Host and Network Name Lookups.955gitlab # [ 6.868370] systemd[1]: Reached target User and Group Name Lookups.956gitlab # [ 6.872483] systemd[1]: linger-users.service: Deactivated successfully.957gitlab # [ 6.873349] systemd[1]: Finished linger-users.service.958gitlab # [ 6.876589] systemd[1]: Finished resolvconf update.959gitlab # [ 6.877414] systemd[1]: Reached target Preparation for Network.960gitlab # [ 6.880161] systemd[1]: Starting DHCP Client...961gitlab # [ 6.882263] systemd[1]: Starting Address configuration of eth1...962gitlab # [ 6.885297] systemd[1]: Starting Extra networking commands....963gitlab # [ 6.916314] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done964gitlab # [ 6.918190] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done965gitlab # [ 6.922394] systemd[1]: Finished Address configuration of eth1.966gitlab # [ 6.942992] systemd[1]: Finished Extra networking commands..967gitlab # [ 6.945090] systemd[1]: Reached target Network.968gitlab # [ 6.946463] systemd[1]: Starting gitlab-workhorse.service...969gitlab # [ 6.949256] systemd[1]: Starting Nginx Web Server...970gitlab # [ 6.952294] dhcpcd[705]: dhcpcd-10.3.2 starting971gitlab # [ 6.953365] systemd[1]: Starting PostgreSQL Server...972gitlab # [ 6.954964] dhcpcd[767]: dev: loaded udev973gitlab # [ 6.957070] systemd[1]: Starting Redis Server - redis-gitlab...974gitlab # [ 6.958178] systemd[1]: Starting Permit User Sessions...975gitlab # [ 7.097951] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.098640] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 6.973395] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.978gitlab # [ 6.975789] systemd[1]: Finished Permit User Sessions.979gitlab # [ 6.979351] systemd[1]: Started Getty on tty1.980gitlab # [ 6.980961] systemd[1]: Reached target Login Prompts.981gitlab # [ 7.185642] cfg80211: Loading compiled-in X.509 certificates for regulatory database982gitlab # [ 7.190207] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'983gitlab # [ 7.191139] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'984gitlab # [ 7.192532] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2985gitlab # [ 7.193566] cfg80211: failed to load regulatory.db986gitlab # [ 7.077762] nginx-pre-start[791]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok987gitlab # [ 7.081192] nginx-pre-start[791]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful988gitlab # [ 7.081795] systemd[1]: Started Nginx Web Server.989gitlab # [ 7.220486] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # [ 7.085301] dhcpcd[767]: eth0: waiting for carrier991gitlab # [ 7.086366] dhcpcd[767]: eth0: carrier acquired992gitlab # [ 7.092869] dhcpcd[767]: DUID 00:01:00:01:32:14:a9:b0:52:54:00:12:34:56993gitlab # [ 7.093931] dhcpcd[767]: eth0: IAID 00:12:34:56994gitlab # [ 7.094962] dhcpcd[767]: eth0: adding address fe80::5054:ff:fe12:3456995gitlab # [ 7.098318] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.996gitlab # [ 7.100328] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo997gitlab # [ 7.101469] systemd[1]: Started Redis Server - redis-gitlab.998gitlab # [ 7.102345] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started999gitlab # [ 7.103705] redis-server[788]: Configuration loaded1000gitlab # [ 7.104566] redis[788]: monotonic clock: POSIX clock_gettime1001gitlab # [ 7.105455] redis[788]: Running mode=standalone, port=0.1002gitlab # [ 7.106402] redis[788]: Server initialized1003gitlab # [ 7.107220] redis[788]: Ready to accept connections unix1004gitlab # [ 7.108085] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1005gitlab # [ 7.110266] postgresql-pre-start[790]: The files belonging to this database system will be owned by user "postgres".1006gitlab # [ 7.110888] postgresql-pre-start[790]: This user must also own the server process.1007gitlab # [ 7.116636] postgresql-pre-start[790]: The database cluster will be initialized with locale "en_US.UTF-8".1008gitlab # [ 7.117542] postgresql-pre-start[790]: The default database encoding has accordingly been set to "UTF8".1009gitlab # [ 7.120308] postgresql-pre-start[790]: The default text search configuration will be set to "english".1010gitlab # [ 7.121692] postgresql-pre-start[790]: Data page checksums are enabled.1011gitlab # [ 7.123617] postgresql-pre-start[790]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1012gitlab # [ 7.125066] postgresql-pre-start[790]: creating subdirectories ... ok1013gitlab # [ 7.125924] postgresql-pre-start[790]: selecting dynamic shared memory implementation ... posix1014gitlab # [ 7.145238] postgresql-pre-start[790]: selecting default "max_connections" ... 1001015gitlab # [ 7.194666] postgresql-pre-start[790]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 7.403071] systemd[1]: Started gitlab-workhorse.service.1017gitlab # [ 7.542105] postgresql-pre-start[790]: selecting default time zone ... UTC1018gitlab # [ 7.543816] postgresql-pre-start[790]: creating configuration files ... ok1019gitlab # [ 7.575987] gitlab-workhorse[824]: time="2026-08-16T17:02:41Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41020gitlab # [ 7.577969] gitlab-workhorse[824]: time="2026-08-16T17:02:41Z" level=info msg="Using redis/go-redis"1021gitlab # [ 7.581295] gitlab-workhorse[824]: time="2026-08-16T17:02:41Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1022gitlab # [ 7.711618] postgresql-pre-start[790]: running bootstrap script ... ok1023gitlab # [ 8.118847] postgresql-pre-start[790]: performing post-bootstrap initialization ... ok1024gitlab # [ 8.275771] dhcpcd[767]: eth0: soliciting an IPv6 router1025gitlab # [ 8.277426] dhcpcd[767]: eth0: Router Advertisement from fe80::21026gitlab # [ 8.278113] dhcpcd[767]: eth0: adding address fec0::5054:ff:fe12:3456/641027gitlab # [ 8.278589] dhcpcd[767]: eth0: adding route to fec0::/641028gitlab # [ 8.279184] dhcpcd[767]: eth0: adding default route via fe80::21029gitlab # [ 8.325921] postgresql-pre-start[790]: syncing data to disk ... ok1030gitlab # [ 8.327955] postgresql-pre-start[790]: initdb: warning: enabling "trust" authentication for local connections1031gitlab # [ 8.330839] postgresql-pre-start[790]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1032gitlab # [ 8.335691] postgresql-pre-start[790]: Success. You can now start the database server using:1033gitlab # [ 8.338318] postgresql-pre-start[790]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1034gitlab # [ 8.407870] postgres[848]: [848] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1035gitlab # [ 8.412526] postgres[848]: [848] LOG: listening on IPv6 address "::1", port 54321036gitlab # [ 8.415151] postgres[848]: [848] LOG: listening on IPv4 address "127.0.0.1", port 54321037gitlab # [ 8.417934] postgres[848]: [848] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1038gitlab # [ 8.423200] postgres[858]: [858] LOG: database system was shut down at 2026-08-16 17:02:41 GMT1039gitlab # [ 8.431729] postgres[848]: [848] LOG: database system is ready to accept connections1040gitlab # [ 8.435688] systemd[1]: Started PostgreSQL Server.1041gitlab # [ 8.439261] systemd[1]: Starting PostgreSQL Setup Scripts...1042gitlab # [ 8.589686] postgresql-setup-start[869]: CREATE DATABASE1043gitlab # [ 8.616269] postgresql-setup-start[879]: CREATE ROLE1044gitlab # [ 8.619624] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[874]: mkdir -p /var/gitlab/state/home/.ssh: OK1045gitlab # [ 8.620785] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[874]: chmod 700 /var/gitlab/state/home/.ssh: OK1046gitlab # [ 8.624578] postgresql-setup-start[881]: ALTER DATABASE1047gitlab # [ 8.639925] postgresql-setup-start[891]: CREATE ROLE1048gitlab # [ 8.641506] systemd[1]: Finished PostgreSQL Setup Scripts.1049gitlab # [ 8.642241] systemd[1]: Reached target PostgreSQL.1050gitlab # [ 8.643366] systemd[1]: Starting gitlab-postgresql.service...1051gitlab # [ 8.658270] systemd[1]: Finished gitlab-config.service.1052gitlab # [ 8.661360] systemd[1]: Started gitaly.service.1053gitlab # [ 8.663798] systemd[1]: Starting gitlab-db-config.service...1054gitlab # [ 8.716506] dhcpcd[767]: eth0: soliciting a DHCP lease1055gitlab # [ 8.857781] NET: Registered PF_PACKET protocol family1056gitlab # [ 8.728428] dhcpcd[767]: eth0: offered 10.0.2.15 from 10.0.2.21057gitlab # [ 8.734637] dhcpcd[767]: eth0: probing address 10.0.2.15/241058gitlab # [ 8.737118] gitlab-postgresql-start[909]: CREATE DATABASE1059gitlab # [ 8.770103] gitlab-postgresql-start[916]: CREATE EXTENSION1060gitlab # [ 8.855907] gitlab-postgresql-start[919]: CREATE EXTENSION1061gitlab # [ 8.859309] systemd[1]: Finished gitlab-postgresql.service.1062gitlab # [ 9.147352] gitaly[902]: time="2026-08-16T17:02:42.923Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9021063gitlab # [ 9.148110] gitaly[902]: time="2026-08-16T17:02:42.924Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9021064gitlab # [ 9.148621] gitaly[902]: time="2026-08-16T17:02:42.924Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9021065gitlab # [ 9.149194] gitaly[902]: time="2026-08-16T17:02:42.924Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9021066gitlab # [ 9.149561] gitaly[902]: time="2026-08-16T17:02:42.924Z" level=info msg="Starting Gitaly" pid=902 version=1067gitlab # [ 9.339522] gitaly[902]: time="2026-08-16T17:02:43.116Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=179 pid=9021068gitlab # [ 9.341046] gitaly[902]: time="2026-08-16T17:02:43.117Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9021069gitlab # [ 9.341725] gitaly[902]: time="2026-08-16T17:02:43.118Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9021070gitlab # [ 9.342297] gitaly[902]: time="2026-08-16T17:02:43.118Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-902/git-exec-1375085874.d/git pid=9021071gitlab # [ 9.347576] gitaly[902]: time="2026-08-16T17:02:43.124Z" level=info msg="finished detecting git version" duration_ms=6 pid=9021072gitlab # [ 9.348104] gitaly[902]: time="2026-08-16T17:02:43.124Z" level=info msg="using Git version" pid=902 version=2.53.g1073gitlab # [ 9.348588] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="clearing disk cache object folder" pid=902 storage=default1074gitlab # [ 9.349052] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1612199132 pid=902 storage=default1075gitlab # [ 9.349555] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1612199132 pid=902 storage=default1076gitlab # [ 9.350375] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9021077gitlab # [ 9.351128] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9021078gitlab # [ 9.351844] gitaly[902]: time="2026-08-16T17:02:43.127Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1612199132 clear_duration_ms=0 pid=902 storage=default1079gitlab # [ 9.395591] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9021080gitlab # [ 9.396222] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="counting repositories" pid=9021081gitlab # [ 9.396588] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=902 schema=unix1082gitlab # [ 9.396989] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="starting to count repositories" pid=902 storage_path=/var/gitlab/state/repositories1083gitlab # [ 9.397549] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="listening at address" address=/run/gitaly/gitaly-902/sock.d/intern pid=902 schema=unix1084gitlab # [ 9.399094] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="finished tempdir cleaner walk" pid=902 storage=default time_ms=01085gitlab # [ 9.405263] gitaly[902]: time="2026-08-16T17:02:43.182Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=902 storage_path=/var/gitlab/state/repositories1086gitlab # [ 9.407590] gitaly[902]: time="2026-08-16T17:02:43.182Z" level=info msg="completed counting all repositories" counting_duration=9 pid=9021087gitlab # [ 9.409361] gitaly[902]: time="2026-08-16T17:02:43.183Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9021088gitlab # [ 9.411124] gitaly[902]: time="2026-08-16T17:02:43.183Z" level=info msg="Started Gitaly" duration_ms=259 pid=9021089gitlab # [ 9.412536] gitaly[902]: time="2026-08-16T17:02:43.184Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9021090gitlab # [ 9.414178] gitaly[902]: time="2026-08-16T17:02:43.184Z" level=info msg="maintenance: daily scheduled" pid=902 scheduled="2026-08-17 12:00:00 +0000 UTC"1091gitlab # [ 9.709856] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 9.710579] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 9.728648] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[910]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 11.532531] gitaly[902]: time="2026-08-16T17:02:45.309Z" level=info msg="License database preloaded" duration_ms=2384 pid=9021095gitlab # [ 14.137679] dhcpcd[767]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 14.139150] dhcpcd[767]: eth0: adding route to 10.0.2.0/241097gitlab # [ 14.140185] dhcpcd[767]: eth0: adding default route via 10.0.2.21098gitlab # [ 14.247057] systemd[1]: Started DHCP Client.1099gitlab # [ 14.249125] systemd[1]: Reached target Network is Online.1100gitlab # [ 43.014743] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[910]: W, [2026-08-16T17:03:16.791105 #910] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1101gitlab # [ 45.144985] postgres[1335]: [1335] ERROR: relation "feature_gates" does not exist at character 5231102gitlab # [ 45.145515] postgres[1335]: [1335] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1103gitlab # [ 45.146852] postgres[1335]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1104gitlab # [ 45.148622] postgres[1335]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1105gitlab # [ 45.150446] postgres[1335]: attidentity AS identity,1106gitlab # [ 45.151530] postgres[1335]: attgenerated as attgenerated1107gitlab # [ 45.153401] postgres[1335]: FROM pg_attribute a1108gitlab # [ 45.155281] postgres[1335]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1109gitlab # [ 45.155652] postgres[1335]: LEFT JOIN pg_type t ON a.atttypid = t.oid1110gitlab # [ 45.157412] postgres[1335]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1111gitlab # [ 45.159154] postgres[1335]: WHERE a.attrelid = '"feature_gates"'::regclass1112gitlab # [ 45.160533] postgres[1335]: AND a.attnum > 0 AND NOT a.attisdropped1113gitlab # [ 45.162306] postgres[1335]: ORDER BY a.attnum1114gitlab # [ 45.164065] postgres[1335]:1115gitlab # [ 47.634594] gitlab-workhorse[824]: time="2026-08-16T17:03:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1116gitlab # [ 48.715687] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1377]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1117gitlab # [ 48.716232] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1377]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1118gitlab # [ 57.645200] gitlab-workhorse[824]: time="2026-08-16T17:03:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 63.552550] postgres[1443]: [1443] ERROR: relation "table_without_models" does not exist1120gitlab # [ 63.553858] postgres[1443]: [1443] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 67.654344] gitlab-workhorse[824]: time="2026-08-16T17:03:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 75.095079] systemd[1]: Finished gitlab-db-config.service.1123gitlab # [ 75.100623] systemd[1]: Started gitlab-sidekiq.service.1124gitlab # [ 75.105649] systemd[1]: Starting gitlab.service...1125gitlab # [ 75.456648] bundle[1610]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1126gitlab # [ 75.461243] bundle[1610]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1127gitlab # [ 75.465587] bundle[1610]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1128gitlab # [ 77.666911] gitlab-workhorse[824]: time="2026-08-16T17:03:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1129gitlab # [ 78.249514] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-08-16T17:03:52.008Z","message":"Starting cluster with 1 processes"}1130gitlab # [ 78.380169] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.131Z","pid":1610,"message":"* Enabling systemd notification integration"}1131gitlab # [ 78.383813] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"Puma starting in cluster mode..."}1132gitlab # [ 78.387378] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1133gitlab # [ 78.390881] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1134gitlab # [ 78.395068] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Min threads: 0"}1135gitlab # [ 78.397864] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Max threads: 4"}1136gitlab # [ 78.400723] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Environment: production"}1137gitlab # [ 78.403691] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Master PID: 1610"}1138gitlab # [ 78.406579] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Workers: 2"}1139gitlab # [ 78.409342] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1140gitlab # [ 78.412888] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Preloading application"}1141gitlab # [ 87.666741] gitlab-workhorse[824]: time="2026-08-16T17:04:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 97.667534] gitlab-workhorse[824]: time="2026-08-16T17:04:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 103.234946] bundle[1610]: W, [2026-08-16T17:04:17.011277 #1610] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 105.499399] sidekiq-cluster[1640]: 2026-08-16T17:04:19.275Z pid=1640 tid=wjk INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1640, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433160192}1145gitlab # [ 105.675174] sidekiq-cluster[1640]: W, [2026-08-16T17:04:19.451895 #1640] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 105.715797] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:19.492Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1147gitlab # [ 107.677868] gitlab-workhorse[824]: time="2026-08-16T17:04:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1148gitlab # [ 107.781612] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.557Z","message":"GitLab reliable fetch activated!"}1149gitlab # [ 107.785288] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.557Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1150gitlab # [ 107.805633] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.582Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1151gitlab # [ 107.810646] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.586Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1152gitlab # [ 107.814149] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.591Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1153gitlab # [ 107.818208] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.595Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1154gitlab # [ 107.822697] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.599Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1155gitlab # [ 107.828223] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.605Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1156gitlab # [ 107.831764] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.608Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1157gitlab # [ 107.835515] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.612Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1158gitlab # [ 107.839233] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.616Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1159gitlab # [ 107.842638] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.619Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1160gitlab # [ 107.846405] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.623Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1161gitlab # [ 107.851274] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.628Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1162gitlab # [ 107.855044] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.631Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1163gitlab # [ 107.858669] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.635Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1164gitlab # [ 107.862600] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.639Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1165gitlab # [ 107.866564] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.643Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1166gitlab # [ 107.870425] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.647Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1167gitlab # [ 107.874726] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.651Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1168gitlab # [ 107.879034] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.655Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1169gitlab # [ 107.883045] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.659Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1170gitlab # [ 107.887231] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.664Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1171gitlab # [ 107.890493] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.667Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1172gitlab # [ 107.892790] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.669Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1173gitlab # [ 107.895366] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.672Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1174gitlab # [ 107.897751] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.674Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1175gitlab # [ 107.900512] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.677Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1176gitlab # [ 107.903050] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.680Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1177gitlab # [ 107.905539] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.682Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1178gitlab # [ 107.907931] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.684Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1179gitlab # [ 107.910475] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.687Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1180gitlab # [ 107.912726] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.689Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1181gitlab # [ 107.915111] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.692Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1182gitlab # [ 107.917547] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.694Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1183gitlab # [ 107.920102] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.697Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1184gitlab # [ 107.922485] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.699Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1185gitlab # [ 107.924782] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.701Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1186gitlab # [ 107.926840] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.703Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1187gitlab # [ 107.929163] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.706Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1188gitlab # [ 107.931235] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.708Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1189gitlab # [ 107.933289] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.710Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1190gitlab # [ 107.935523] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.712Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1191gitlab # [ 107.937344] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.714Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1192gitlab # [ 107.939559] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.716Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1193gitlab # [ 107.941820] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.718Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1194gitlab # [ 107.944411] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.721Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1195gitlab # [ 107.946467] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.723Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1196gitlab # [ 107.948452] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.725Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1197gitlab # [ 107.950712] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.727Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1198gitlab # [ 107.953225] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.730Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1199gitlab # [ 107.955453] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.732Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1200gitlab # [ 107.957771] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.734Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1201gitlab # [ 107.960295] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.737Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1202gitlab # [ 107.968515] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.745Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1203gitlab # [ 107.971370] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.748Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1204gitlab # [ 107.975404] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.752Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1205gitlab # [ 107.980659] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.757Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1206gitlab # [ 107.986802] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.763Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1207gitlab # [ 107.989961] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.766Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1208gitlab # [ 107.991880] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.768Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1209gitlab # [ 107.994642] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.771Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1210gitlab # [ 107.998294] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.775Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1211gitlab # [ 108.003929] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.780Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1212gitlab # [ 108.008073] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.784Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1213gitlab # [ 108.012654] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.789Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1214gitlab # [ 108.017128] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.794Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1215gitlab # [ 108.021189] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.798Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1216gitlab # [ 108.025615] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.802Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1217gitlab # [ 108.027669] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.804Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1218gitlab # [ 108.073273] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.850Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1219gitlab # [ 108.075847] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.851Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1220gitlab # [ 108.076868] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.853Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1221gitlab # [ 108.079158] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.856Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1222gitlab # [ 108.081967] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.858Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1223gitlab # [ 108.084250] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.861Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1224gitlab # [ 108.087360] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.863Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1225gitlab # [ 108.089951] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.866Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1226gitlab # [ 108.092574] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.869Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1227gitlab # [ 108.095802] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.872Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1228gitlab # [ 108.098321] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.875Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1229gitlab # [ 108.101324] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.878Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1230gitlab # [ 108.103841] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.880Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1231gitlab # [ 108.106657] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.883Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1232gitlab # [ 108.109306] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.886Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1233gitlab # [ 108.111853] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.888Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1234gitlab # [ 108.113979] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.890Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1235gitlab # [ 108.116466] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.893Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1236gitlab # [ 108.118847] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.895Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1237gitlab # [ 108.121391] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.898Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1238gitlab # [ 108.123401] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.900Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1239gitlab # [ 108.126040] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.903Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1240gitlab # [ 108.128048] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.905Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1241gitlab # [ 108.130021] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.906Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1242gitlab # [ 108.132350] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.909Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1243gitlab # [ 108.134378] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.911Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1244gitlab # [ 108.137206] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.914Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1245gitlab # [ 108.139681] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.916Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1246gitlab # [ 108.142046] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.919Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1247gitlab # [ 108.143979] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.920Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1248gitlab # [ 108.152718] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.929Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1249gitlab # [ 108.154900] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.931Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1250gitlab # [ 108.156878] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.933Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1251gitlab # [ 108.160149] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.937Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1252gitlab # [ 108.163116] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.940Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1253gitlab # [ 108.165489] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.942Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1254gitlab # [ 108.169391] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.946Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1255gitlab # [ 108.171448] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.948Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1256gitlab # [ 108.173957] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.950Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1257gitlab # [ 108.176761] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.953Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1258gitlab # [ 108.179400] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.956Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1259gitlab # [ 117.678540] gitlab-workhorse[824]: time="2026-08-16T17:04:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 127.688881] gitlab-workhorse[824]: time="2026-08-16T17:04:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1261gitlab # [ 130.112183] postgres[2123]: [2123] ERROR: relation "table_without_models" does not exist1262gitlab # [ 130.113316] postgres[2123]: [2123] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1263gitlab # [ 132.104356] postgres[2144]: [2144] ERROR: relation "table_without_models" does not exist1264gitlab # [ 132.105560] postgres[2144]: [2144] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 132.616909] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.393Z","message":"Booted Rails 7.2.3.1 application in production environment"}1266gitlab # [ 132.622987] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.399Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1267gitlab # [ 132.623670] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.399Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1268gitlab # [ 132.624782] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.399Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1269gitlab # [ 132.636580] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.413Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1270gitlab # [ 134.225283] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:48.001Z","message":"Cleaning working queues"}1271gitlab # [ 134.228921] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:48.002Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"34997d9b6c386f7b7cb19bad","created_at":"2026-08-16T17:03:48.472Z","trace_propagation_headers":{"sentry-trace":"e243c2a7f2454993b4428cf7fd7c3983-dd55058a4af140f1","baggage":"sentry-trace_id=e243c2a7f2454993b4428cf7fd7c3983,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1475b34960df00b9762a856de3597b5d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:03:48.480Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-34997d9b6c386f7b7cb19bad: start","job_status":"start","queue_duration_s":59.521828,"scheduling_latency_s":59.521888}1272gitlab # [ 134.385885] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:48.162Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"34997d9b6c386f7b7cb19bad","created_at":"2026-08-16T17:03:48.472Z","trace_propagation_headers":{"sentry-trace":"e243c2a7f2454993b4428cf7fd7c3983-dd55058a4af140f1","baggage":"sentry-trace_id=e243c2a7f2454993b4428cf7fd7c3983,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1475b34960df00b9762a856de3597b5d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:03:48.480Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-34997d9b6c386f7b7cb19bad: done: 0.159831 sec","job_status":"done","queue_duration_s":59.521828,"scheduling_latency_s":59.521888,"redis_calls":31,"redis_duration_s":0.006943,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.004014,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001761,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.078867566,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.159831,"completed_at":"2026-08-16T17:04:48.162Z","load_balancing_strategy":"primary","db_duration_s":0.042564,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1273gitlab # [ 134.974069] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1274gitlab # [ 134.975533] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1275gitlab # [ 134.976850] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"! #\u003cThread:0x00007ca6d1bdd428 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1276gitlab # [ 134.978238] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"! #\u003cThread:0x00007ca6d1e42768 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1277gitlab # [ 134.979361] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"Use Ctrl-C to stop"}1278gitlab # [ 134.980349] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"Sending status to systemd every 1.0 sec"}1279gitlab # [ 135.319756] bundle[1610]: {"timestamp":"2026-08-16T17:04:49.096Z","pid":1610,"message":"- Worker 0 (PID: 2198) booted in 0.29s, phase: 0"}1280gitlab # [ 135.351623] bundle[1610]: {"timestamp":"2026-08-16T17:04:49.128Z","pid":1610,"message":"- Worker 1 (PID: 2206) booted in 0.3s, phase: 0"}1281gitlab # [ 135.357729] systemd[1]: Started gitlab.service.1282gitlab # [ 135.359454] systemd[1]: Reached target Common target for all GitLab services..1283gitlab # [ 135.361662] systemd[1]: Starting setup-gitlab.service...1284gitlab # [ 135.380866] setup-gitlab-start[2235]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1285gitlab # [ 137.858755] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:04:51 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 24481286gitlab # [ 137.864672] setup-gitlab-start[2235]: + TOKEN=nixbot-test-token-of-20-chars1287gitlab # [ 137.865803] setup-gitlab-start[2235]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1288gitlab # [ 137.875518] runuser[2257]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1289gitlab # [ 138.240967] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1290gitlab # [ 138.242662] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1291gitlab # [ 138.243933] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1292gitlab # [ 138.819693] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 138.821232] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 138.822277] setup-gitlab-start[2258]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 150.557301] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.333Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"512f902900fb9ca02c90aacc","created_at":"2026-08-16T17:05:04.314Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"575a09390e667567c577c542a221c6ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.331Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-512f902900fb9ca02c90aacc: start","job_status":"start","queue_duration_s":0.001555,"scheduling_latency_s":0.001585}1296gitlab # [ 150.706692] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"512f902900fb9ca02c90aacc","created_at":"2026-08-16T17:05:04.314Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"575a09390e667567c577c542a221c6ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.331Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-512f902900fb9ca02c90aacc: done: 0.150008 sec","job_status":"done","queue_duration_s":0.001555,"scheduling_latency_s":0.001585,"redis_calls":14,"redis_duration_s":0.011193999999999999,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002762,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00418,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001030578,"exclusive_lock_hold_duration_s":0.104411594,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.150008,"completed_at":"2026-08-16T17:05:04.483Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 150.745986] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"83d1353c984ae550b8a0d56f","created_at":"2026-08-16T17:05:04.338Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25c16584acd38cb222bb6bb029397e59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.351Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-83d1353c984ae550b8a0d56f: start","job_status":"start","queue_duration_s":0.171522,"scheduling_latency_s":0.17155}1298gitlab # [ 150.769573] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.546Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1299gitlab # [ 150.778869] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"83d1353c984ae550b8a0d56f","created_at":"2026-08-16T17:05:04.338Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25c16584acd38cb222bb6bb029397e59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.351Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-83d1353c984ae550b8a0d56f: done: 0.032874 sec","job_status":"done","queue_duration_s":0.171522,"scheduling_latency_s":0.17155,"redis_calls":10,"redis_duration_s":0.002801,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000825,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001592,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000271264,"duration_s":0.032874,"completed_at":"2026-08-16T17:05:04.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 150.813664] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.590Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f85f7ce45c6a352c900a9abe","created_at":"2026-08-16T17:05:04.362Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a55425ced474b0cc89df57be74ad7aab","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.370Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f85f7ce45c6a352c900a9abe: start","job_status":"start","queue_duration_s":0.22013,"scheduling_latency_s":0.220153}1301gitlab # [ 150.871078] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f85f7ce45c6a352c900a9abe","created_at":"2026-08-16T17:05:04.362Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a55425ced474b0cc89df57be74ad7aab","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.370Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f85f7ce45c6a352c900a9abe: done: 0.05743 sec","job_status":"done","queue_duration_s":0.22013,"scheduling_latency_s":0.220153,"redis_calls":16,"redis_duration_s":0.006491,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003015,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000596724,"duration_s":0.05743,"completed_at":"2026-08-16T17:05:04.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 150.905401] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"260afc92d27b6d4e053a63fc","created_at":"2026-08-16T17:05:04.389Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a7f0600fa1d343b6011c7cdd2f861fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:05:04.396Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-260afc92d27b6d4e053a63fc: start","job_status":"start","queue_duration_s":0.285207,"scheduling_latency_s":0.285232}1303gitlab # [ 150.941472] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.718Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1304gitlab # [ 150.960242] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"260afc92d27b6d4e053a63fc","created_at":"2026-08-16T17:05:04.389Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a7f0600fa1d343b6011c7cdd2f861fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:05:04.396Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-260afc92d27b6d4e053a63fc: done: 0.054836 sec","job_status":"done","queue_duration_s":0.285207,"scheduling_latency_s":0.285232,"redis_calls":10,"redis_duration_s":0.015233,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001167,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00978588,"duration_s":0.054836,"completed_at":"2026-08-16T17:05:04.736Z","load_balancing_strategy":"primary","db_duration_s":0.000499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 150.994848] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.771Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"00df9a196be7c4048d2a4a01","created_at":"2026-08-16T17:05:04.432Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5a523dd6b9a61f2fe13c101cfca4015","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.442Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-00df9a196be7c4048d2a4a01: start","job_status":"start","queue_duration_s":0.328789,"scheduling_latency_s":0.32881}1306gitlab # [ 151.059241] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"00df9a196be7c4048d2a4a01","created_at":"2026-08-16T17:05:04.432Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5a523dd6b9a61f2fe13c101cfca4015","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.442Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-00df9a196be7c4048d2a4a01: done: 0.063713 sec","job_status":"done","queue_duration_s":0.328789,"scheduling_latency_s":0.32881,"redis_calls":12,"redis_duration_s":0.02701,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002884,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.018287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000734451,"duration_s":0.063713,"completed_at":"2026-08-16T17:05:04.835Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 151.099192] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c9472735bf8042681c095d2a","created_at":"2026-08-16T17:05:04.451Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"179685812acddea7723b02802983e1b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.458Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c9472735bf8042681c095d2a: start","job_status":"start","queue_duration_s":0.416884,"scheduling_latency_s":0.416906}1308gitlab # [ 151.134768] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.911Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1309gitlab # [ 151.168068] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c9472735bf8042681c095d2a","created_at":"2026-08-16T17:05:04.451Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"179685812acddea7723b02802983e1b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.458Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c9472735bf8042681c095d2a: done: 0.069034 sec","job_status":"done","queue_duration_s":0.416884,"scheduling_latency_s":0.416906,"redis_calls":10,"redis_duration_s":0.014215,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001861,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005084,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000880838,"duration_s":0.069034,"completed_at":"2026-08-16T17:05:04.944Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000622,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 151.173846] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"309cb67bf6f208ace90d5b1c","created_at":"2026-08-16T17:05:04.470Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3cdc3051a7817ec60cfeaf46729b0fc","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.477Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-309cb67bf6f208ace90d5b1c: start","job_status":"start","queue_duration_s":0.472649,"scheduling_latency_s":0.472669}1311gitlab # [ 151.214334] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"309cb67bf6f208ace90d5b1c","created_at":"2026-08-16T17:05:04.470Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3cdc3051a7817ec60cfeaf46729b0fc","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.477Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-309cb67bf6f208ace90d5b1c: done: 0.032148 sec","job_status":"done","queue_duration_s":0.472649,"scheduling_latency_s":0.472669,"redis_calls":12,"redis_duration_s":0.002602,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000571022,"exclusive_lock_hold_duration_s":0.005081093,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.032148,"completed_at":"2026-08-16T17:05:04.982Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 151.220463] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bc8982b280a38554fcd130f5","created_at":"2026-08-16T17:05:04.520Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d446b724003f308ebf2769e201d5b4dc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.553Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bc8982b280a38554fcd130f5: start","job_status":"start","queue_duration_s":0.43052,"scheduling_latency_s":0.430535}1313gitlab # [ 151.234740] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bc8982b280a38554fcd130f5","created_at":"2026-08-16T17:05:04.520Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d446b724003f308ebf2769e201d5b4dc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.553Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bc8982b280a38554fcd130f5: done: 0.024134 sec","job_status":"done","queue_duration_s":0.43052,"scheduling_latency_s":0.430535,"redis_calls":10,"redis_duration_s":0.00192,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000339,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000433295,"duration_s":0.024134,"completed_at":"2026-08-16T17:05:05.008Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 151.284957] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4dd2b6e9ec8fc1170c3a784c","created_at":"2026-08-16T17:05:04.602Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f5b6f653ef35682596e704e3795a6f7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.610Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4dd2b6e9ec8fc1170c3a784c: start","job_status":"start","queue_duration_s":0.3996,"scheduling_latency_s":0.399615}1315gitlab # [ 151.285583] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.020Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1316gitlab # [ 151.285982] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4dd2b6e9ec8fc1170c3a784c","created_at":"2026-08-16T17:05:04.602Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f5b6f653ef35682596e704e3795a6f7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.610Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4dd2b6e9ec8fc1170c3a784c: done: 0.015484 sec","job_status":"done","queue_duration_s":0.3996,"scheduling_latency_s":0.399615,"redis_calls":10,"redis_duration_s":0.0012590000000000001,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209244,"duration_s":0.015484,"completed_at":"2026-08-16T17:05:05.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 151.332964] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4c73cbdef2ba2b3bd7564cc6","created_at":"2026-08-16T17:05:04.619Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e557a4dafdcfd82745d26310c2bb20ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.624Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4c73cbdef2ba2b3bd7564cc6: start","job_status":"start","queue_duration_s":0.402045,"scheduling_latency_s":0.402057}1318gitlab # [ 151.444166] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.220Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4c73cbdef2ba2b3bd7564cc6","created_at":"2026-08-16T17:05:04.619Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e557a4dafdcfd82745d26310c2bb20ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.624Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4c73cbdef2ba2b3bd7564cc6: done: 0.193949 sec","job_status":"done","queue_duration_s":0.402045,"scheduling_latency_s":0.402057,"redis_calls":12,"redis_duration_s":0.004546,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001567,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000315403,"exclusive_lock_hold_duration_s":0.172884822,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.193949,"completed_at":"2026-08-16T17:05:05.220Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.067559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 151.485099] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b76a768966cc0f853d605bec","created_at":"2026-08-16T17:05:04.631Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"310fd5fb3ad26c0b9cce8a01def71f34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:05:04.635Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b76a768966cc0f853d605bec: start","job_status":"start","queue_duration_s":0.625613,"scheduling_latency_s":0.625667}1320gitlab # [ 151.529084] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.305Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1321gitlab # [ 151.538501] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b76a768966cc0f853d605bec","created_at":"2026-08-16T17:05:04.631Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"310fd5fb3ad26c0b9cce8a01def71f34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:05:04.635Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b76a768966cc0f853d605bec: done: 0.053589 sec","job_status":"done","queue_duration_s":0.625613,"scheduling_latency_s":0.625667,"redis_calls":10,"redis_duration_s":0.008933,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231873,"duration_s":0.053589,"completed_at":"2026-08-16T17:05:05.314Z","load_balancing_strategy":"primary","db_duration_s":0.000483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 151.576133] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"8acd2d0d6f05ff051074582f","created_at":"2026-08-16T17:05:04.640Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d42ff2ee85bf38d7707f9b5dc865fb9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.648Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-8acd2d0d6f05ff051074582f: start","job_status":"start","queue_duration_s":0.703351,"scheduling_latency_s":0.703376}1323gitlab # [ 151.616259] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"8acd2d0d6f05ff051074582f","created_at":"2026-08-16T17:05:04.640Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d42ff2ee85bf38d7707f9b5dc865fb9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.648Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-8acd2d0d6f05ff051074582f: done: 0.040388 sec","job_status":"done","queue_duration_s":0.703351,"scheduling_latency_s":0.703376,"redis_calls":11,"redis_duration_s":0.003113,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000398,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000855,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026847,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.040388,"completed_at":"2026-08-16T17:05:05.392Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 151.637316] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.394Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"57b8ee653a1488ef0d901700","created_at":"2026-08-16T17:05:04.704Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"804e2cc82c6f833c3930bd7eaa22c4bd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.714Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-57b8ee653a1488ef0d901700: start","job_status":"start","queue_duration_s":0.680375,"scheduling_latency_s":0.680412}1325gitlab # [ 151.654414] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.431Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"57b8ee653a1488ef0d901700","created_at":"2026-08-16T17:05:04.704Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"804e2cc82c6f833c3930bd7eaa22c4bd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.714Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-57b8ee653a1488ef0d901700: done: 0.036537 sec","job_status":"done","queue_duration_s":0.680375,"scheduling_latency_s":0.680412,"redis_calls":13,"redis_duration_s":0.003328,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0021,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000853,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011210643,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.036537,"completed_at":"2026-08-16T17:05:05.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003215,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1326gitlab # [ 151.666606] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.432Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"db966181afc1333fed8dc643","created_at":"2026-08-16T17:05:04.732Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ab3e4b579eea31a1a3a6ea999a6ebcb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.770Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-db966181afc1333fed8dc643: start","job_status":"start","queue_duration_s":0.661852,"scheduling_latency_s":0.661924}1327gitlab # [ 151.726414] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"db966181afc1333fed8dc643","created_at":"2026-08-16T17:05:04.732Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ab3e4b579eea31a1a3a6ea999a6ebcb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.770Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-db966181afc1333fed8dc643: done: 0.070264 sec","job_status":"done","queue_duration_s":0.661852,"scheduling_latency_s":0.661924,"redis_calls":10,"redis_duration_s":0.001473,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000232711,"duration_s":0.070264,"completed_at":"2026-08-16T17:05:05.502Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 151.728440] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.505Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"58daca802d05ad7166eb36b5","created_at":"2026-08-16T17:05:04.791Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bff5043ceff16415a6cdbc03e320eef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.802Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-58daca802d05ad7166eb36b5: start","job_status":"start","queue_duration_s":0.702141,"scheduling_latency_s":0.702205}1329gitlab # [ 151.741925] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.518Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1330gitlab # [ 151.753700] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"58daca802d05ad7166eb36b5","created_at":"2026-08-16T17:05:04.791Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bff5043ceff16415a6cdbc03e320eef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.802Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-58daca802d05ad7166eb36b5: done: 0.025281 sec","job_status":"done","queue_duration_s":0.702141,"scheduling_latency_s":0.702205,"redis_calls":10,"redis_duration_s":0.002182,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000396,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000511518,"duration_s":0.025281,"completed_at":"2026-08-16T17:05:05.530Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 151.795019] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"74b9a011c2499cfe4f5f7a58","created_at":"2026-08-16T17:05:04.826Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84821a70173cfd369173c652e818381a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.873Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-74b9a011c2499cfe4f5f7a58: start","job_status":"start","queue_duration_s":0.658099,"scheduling_latency_s":0.658113}1332gitlab # [ 151.896072] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"74b9a011c2499cfe4f5f7a58","created_at":"2026-08-16T17:05:04.826Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84821a70173cfd369173c652e818381a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.873Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-74b9a011c2499cfe4f5f7a58: done: 0.140546 sec","job_status":"done","queue_duration_s":0.658099,"scheduling_latency_s":0.658113,"redis_calls":10,"redis_duration_s":0.002012,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000233829,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.140546,"completed_at":"2026-08-16T17:05:05.672Z","load_balancing_strategy":"primary","db_duration_s":0.014618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 151.898029] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3fdf10e91fdee8bfb25c101e","created_at":"2026-08-16T17:05:04.900Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.916Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3fdf10e91fdee8bfb25c101e: start","job_status":"start","queue_duration_s":0.758038,"scheduling_latency_s":0.758076}1334gitlab # [ 152.030387] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3fdf10e91fdee8bfb25c101e","created_at":"2026-08-16T17:05:04.900Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.916Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3fdf10e91fdee8bfb25c101e: done: 0.131899 sec","job_status":"done","queue_duration_s":0.758038,"scheduling_latency_s":0.758076,"redis_calls":71,"redis_duration_s":0.017447999999999998,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001974,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001312,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013387,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000295289,"duration_s":0.131899,"completed_at":"2026-08-16T17:05:05.806Z","load_balancing_strategy":"primary","db_duration_s":0.002453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 152.032962] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"196d09bc2771788893e0717b","created_at":"2026-08-16T17:05:04.946Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d12abe6fc09d68ce1dbe56b11d894b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.143Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-196d09bc2771788893e0717b: start","job_status":"start","queue_duration_s":0.665088,"scheduling_latency_s":0.665137}1336gitlab # [ 152.583897] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"196d09bc2771788893e0717b","created_at":"2026-08-16T17:05:04.946Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d12abe6fc09d68ce1dbe56b11d894b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.143Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-196d09bc2771788893e0717b: done: 0.550905 sec","job_status":"done","queue_duration_s":0.665088,"scheduling_latency_s":0.665137,"redis_calls":565,"redis_duration_s":0.162889,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000554,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002215,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.16012,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.426407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060287,"duration_s":0.550905,"completed_at":"2026-08-16T17:05:06.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 152.651610] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e055c61439102df6b1773a29","created_at":"2026-08-16T17:05:05.152Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.159Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e055c61439102df6b1773a29: start","job_status":"start","queue_duration_s":1.20341,"scheduling_latency_s":1.203471}1338gitlab # [ 152.663801] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.434Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e055c61439102df6b1773a29","created_at":"2026-08-16T17:05:05.152Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.159Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e055c61439102df6b1773a29: done: 0.071348 sec","job_status":"done","queue_duration_s":1.20341,"scheduling_latency_s":1.203471,"redis_calls":19,"redis_duration_s":0.009213,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002094,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000741,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004726,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000789765,"duration_s":0.071348,"completed_at":"2026-08-16T17:05:06.434Z","load_balancing_strategy":"primary","db_duration_s":0.006451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 152.701886] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"180e7042bdfb60fa8c2b5c18","created_at":"2026-08-16T17:05:05.169Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f06a95560bcca7459caf57d3804d3106","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.176Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-180e7042bdfb60fa8c2b5c18: start","job_status":"start","queue_duration_s":1.260823,"scheduling_latency_s":1.260845}1340gitlab # [ 152.733286] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"180e7042bdfb60fa8c2b5c18","created_at":"2026-08-16T17:05:05.169Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f06a95560bcca7459caf57d3804d3106","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.176Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-180e7042bdfb60fa8c2b5c18: done: 0.072459 sec","job_status":"done","queue_duration_s":1.260823,"scheduling_latency_s":1.260845,"redis_calls":12,"redis_duration_s":0.005711,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000887,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001132546,"exclusive_lock_hold_duration_s":0.014195658,"duration_s":0.072459,"completed_at":"2026-08-16T17:05:06.509Z","load_balancing_strategy":"primary","db_duration_s":0.007053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 152.773132] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c82fa9fc6ba78a0315ebfe43","created_at":"2026-08-16T17:05:05.190Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c55981a86ff57e9f12981479ea6a506","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.198Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c82fa9fc6ba78a0315ebfe43: start","job_status":"start","queue_duration_s":1.313336,"scheduling_latency_s":1.313382}1342gitlab # [ 152.814932] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.591Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c82fa9fc6ba78a0315ebfe43","created_at":"2026-08-16T17:05:05.190Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c55981a86ff57e9f12981479ea6a506","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.198Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c82fa9fc6ba78a0315ebfe43: done: 0.07937 sec","job_status":"done","queue_duration_s":1.313336,"scheduling_latency_s":1.313382,"redis_calls":12,"redis_duration_s":0.004725,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000796,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002038,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000887823,"exclusive_lock_hold_duration_s":0.015294681,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.07937,"completed_at":"2026-08-16T17:05:06.591Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 152.817057] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"0ced940b8bc724e018f44d0c","created_at":"2026-08-16T17:05:05.206Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21e1961302e2230c328fb36cbfe3c29b","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.211Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-0ced940b8bc724e018f44d0c: start","job_status":"start","queue_duration_s":1.381966,"scheduling_latency_s":1.381985}1344gitlab # [ 152.864531] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"0ced940b8bc724e018f44d0c","created_at":"2026-08-16T17:05:05.206Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21e1961302e2230c328fb36cbfe3c29b","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.211Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-0ced940b8bc724e018f44d0c: done: 0.046925 sec","job_status":"done","queue_duration_s":1.381966,"scheduling_latency_s":1.381985,"redis_calls":10,"redis_duration_s":0.003307,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000644,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000648965,"duration_s":0.046925,"completed_at":"2026-08-16T17:05:06.640Z","load_balancing_strategy":"primary","db_duration_s":0.007176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 152.866671] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"51ba5fcbea008c65d4073f6b","created_at":"2026-08-16T17:05:05.275Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72fd2397f98dfd34dd70117d348b497b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:05:05.283Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-51ba5fcbea008c65d4073f6b: start","job_status":"start","queue_duration_s":1.360064,"scheduling_latency_s":1.360103}1346gitlab # [ 152.923212] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"51ba5fcbea008c65d4073f6b","created_at":"2026-08-16T17:05:05.275Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72fd2397f98dfd34dd70117d348b497b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:05:05.283Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-51ba5fcbea008c65d4073f6b: done: 0.056499 sec","job_status":"done","queue_duration_s":1.360064,"scheduling_latency_s":1.360103,"redis_calls":10,"redis_duration_s":0.004031,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00083,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000446984,"duration_s":0.056499,"completed_at":"2026-08-16T17:05:06.699Z","load_balancing_strategy":"primary","db_duration_s":0.010113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 152.925557] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d5d8fc05d2110db37162904","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d5d8fc05d2110db37162904: start","job_status":"start","queue_duration_s":0.909474,"scheduling_latency_s":0.909497}1348gitlab # [ 152.965271] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d5d8fc05d2110db37162904","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d5d8fc05d2110db37162904: done: 0.040333 sec","job_status":"done","queue_duration_s":0.909474,"scheduling_latency_s":0.909497,"redis_calls":16,"redis_duration_s":0.0059640000000000006,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0035,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000645892,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040333,"completed_at":"2026-08-16T17:05:06.741Z","load_balancing_strategy":"primary","db_duration_s":0.001028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 152.974730] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a064face24f8e65eccf994b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a064face24f8e65eccf994b: start","job_status":"start","queue_duration_s":0.951645,"scheduling_latency_s":0.951662}1350gitlab # [ 153.018215] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a064face24f8e65eccf994b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a064face24f8e65eccf994b: done: 0.022458 sec","job_status":"done","queue_duration_s":0.951645,"scheduling_latency_s":0.951662,"redis_calls":13,"redis_duration_s":0.004334,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022458,"completed_at":"2026-08-16T17:05:06.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 153.062263] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dbffd3e31dc40ba046e04db","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dbffd3e31dc40ba046e04db: start","job_status":"start","queue_duration_s":0.975676,"scheduling_latency_s":0.975721}1352gitlab # [ 153.063421] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dbffd3e31dc40ba046e04db","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dbffd3e31dc40ba046e04db: done: 0.024175 sec","job_status":"done","queue_duration_s":0.975676,"scheduling_latency_s":0.975721,"redis_calls":13,"redis_duration_s":0.004521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024175,"completed_at":"2026-08-16T17:05:06.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 153.105867] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39b68ddf2e24fc984405229","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39b68ddf2e24fc984405229: start","job_status":"start","queue_duration_s":1.002549,"scheduling_latency_s":1.002574}1354gitlab # [ 153.107318] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39b68ddf2e24fc984405229","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39b68ddf2e24fc984405229: done: 0.027548 sec","job_status":"done","queue_duration_s":1.002549,"scheduling_latency_s":1.002574,"redis_calls":13,"redis_duration_s":0.005141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027548,"completed_at":"2026-08-16T17:05:06.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 153.120298] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edadcdefbabe25eb11a1f309","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edadcdefbabe25eb11a1f309: start","job_status":"start","queue_duration_s":1.032192,"scheduling_latency_s":1.032232}1356gitlab # [ 153.171890] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edadcdefbabe25eb11a1f309","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edadcdefbabe25eb11a1f309: done: 0.023319 sec","job_status":"done","queue_duration_s":1.032192,"scheduling_latency_s":1.032232,"redis_calls":13,"redis_duration_s":0.004529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023319,"completed_at":"2026-08-16T17:05:06.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 153.173375] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72609a6b327558b29eb722f7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72609a6b327558b29eb722f7: start","job_status":"start","queue_duration_s":1.058111,"scheduling_latency_s":1.058174}1358gitlab # [ 153.212622] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72609a6b327558b29eb722f7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72609a6b327558b29eb722f7: done: 0.021454 sec","job_status":"done","queue_duration_s":1.058111,"scheduling_latency_s":1.058174,"redis_calls":13,"redis_duration_s":0.004056000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021454,"completed_at":"2026-08-16T17:05:06.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 153.213721] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10e770c30cfe2f03b629c431","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10e770c30cfe2f03b629c431: start","job_status":"start","queue_duration_s":1.082353,"scheduling_latency_s":1.082397}1360gitlab # [ 153.224251] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10e770c30cfe2f03b629c431","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10e770c30cfe2f03b629c431: done: 0.021284 sec","job_status":"done","queue_duration_s":1.082353,"scheduling_latency_s":1.082397,"redis_calls":13,"redis_duration_s":0.002591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021284,"completed_at":"2026-08-16T17:05:06.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 153.271816] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa869a9b019097f2abf2627b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa869a9b019097f2abf2627b: start","job_status":"start","queue_duration_s":1.105651,"scheduling_latency_s":1.105686}1362gitlab # [ 153.272768] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa869a9b019097f2abf2627b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa869a9b019097f2abf2627b: done: 0.024078 sec","job_status":"done","queue_duration_s":1.105651,"scheduling_latency_s":1.105686,"redis_calls":13,"redis_duration_s":0.003424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024078,"completed_at":"2026-08-16T17:05:06.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 153.310574] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2502855e7ecba1ff3917ff50","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2502855e7ecba1ff3917ff50: start","job_status":"start","queue_duration_s":1.132247,"scheduling_latency_s":1.132263}1364gitlab # [ 153.361616] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2502855e7ecba1ff3917ff50","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2502855e7ecba1ff3917ff50: done: 0.024588 sec","job_status":"done","queue_duration_s":1.132247,"scheduling_latency_s":1.132263,"redis_calls":13,"redis_duration_s":0.0036950000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001139,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002556,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024588,"completed_at":"2026-08-16T17:05:06.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 153.362668] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"800c087e2bb6525f873366e8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-800c087e2bb6525f873366e8: start","job_status":"start","queue_duration_s":1.159716,"scheduling_latency_s":1.15974}1366gitlab # [ 153.370243] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"800c087e2bb6525f873366e8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-800c087e2bb6525f873366e8: done: 0.023598 sec","job_status":"done","queue_duration_s":1.159716,"scheduling_latency_s":1.15974,"redis_calls":13,"redis_duration_s":0.003062,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023598,"completed_at":"2026-08-16T17:05:06.975Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 153.427401] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6897ed5e52499cb7d4c4687","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6897ed5e52499cb7d4c4687: start","job_status":"start","queue_duration_s":1.185197,"scheduling_latency_s":1.185214}1368gitlab # [ 153.428615] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6897ed5e52499cb7d4c4687","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6897ed5e52499cb7d4c4687: done: 0.072751 sec","job_status":"done","queue_duration_s":1.185197,"scheduling_latency_s":1.185214,"redis_calls":13,"redis_duration_s":0.0027210000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001716,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.072751,"completed_at":"2026-08-16T17:05:07.049Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 153.477054] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eee69683875e3a0688966a7b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eee69683875e3a0688966a7b: start","job_status":"start","queue_duration_s":1.279324,"scheduling_latency_s":1.27939}1370gitlab # [ 153.477884] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eee69683875e3a0688966a7b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eee69683875e3a0688966a7b: done: 0.052643 sec","job_status":"done","queue_duration_s":1.279324,"scheduling_latency_s":1.27939,"redis_calls":13,"redis_duration_s":0.012743,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003735,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.052643,"completed_at":"2026-08-16T17:05:07.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 153.520296] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe196e6f3924994ead5bc48b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe196e6f3924994ead5bc48b: start","job_status":"start","queue_duration_s":1.337713,"scheduling_latency_s":1.337763}1372gitlab # [ 153.521203] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe196e6f3924994ead5bc48b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe196e6f3924994ead5bc48b: done: 0.071962 sec","job_status":"done","queue_duration_s":1.337713,"scheduling_latency_s":1.337763,"redis_calls":13,"redis_duration_s":0.036000000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004423,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.031577,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.071962,"completed_at":"2026-08-16T17:05:07.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 153.575265] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaa841ce90cb47b0461322a3","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaa841ce90cb47b0461322a3: start","job_status":"start","queue_duration_s":1.425611,"scheduling_latency_s":1.425661}1374gitlab # [ 153.575959] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaa841ce90cb47b0461322a3","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaa841ce90cb47b0461322a3: done: 0.049314 sec","job_status":"done","queue_duration_s":1.425611,"scheduling_latency_s":1.425661,"redis_calls":13,"redis_duration_s":0.016538999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012698,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049314,"completed_at":"2026-08-16T17:05:07.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 153.630449] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c9192252d6491de9ae52f1c","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c9192252d6491de9ae52f1c: start","job_status":"start","queue_duration_s":1.481284,"scheduling_latency_s":1.481302}1376gitlab # [ 153.631267] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c9192252d6491de9ae52f1c","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c9192252d6491de9ae52f1c: done: 0.046437 sec","job_status":"done","queue_duration_s":1.481284,"scheduling_latency_s":1.481302,"redis_calls":13,"redis_duration_s":0.016772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046437,"completed_at":"2026-08-16T17:05:07.319Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 153.646231] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"776a346f521168cc3d484d20","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-776a346f521168cc3d484d20: start","job_status":"start","queue_duration_s":1.533791,"scheduling_latency_s":1.533811}1378gitlab # [ 153.657945] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"776a346f521168cc3d484d20","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-776a346f521168cc3d484d20: done: 0.061965 sec","job_status":"done","queue_duration_s":1.533791,"scheduling_latency_s":1.533811,"redis_calls":13,"redis_duration_s":0.008382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003165,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005217,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.061965,"completed_at":"2026-08-16T17:05:07.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 153.717765] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee0b91c15cc7c1ce9517d1b8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee0b91c15cc7c1ce9517d1b8: start","job_status":"start","queue_duration_s":1.6023,"scheduling_latency_s":1.602341}1380gitlab # [ 153.720278] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee0b91c15cc7c1ce9517d1b8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee0b91c15cc7c1ce9517d1b8: done: 0.046865 sec","job_status":"done","queue_duration_s":1.6023,"scheduling_latency_s":1.602341,"redis_calls":13,"redis_duration_s":0.008029000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046865,"completed_at":"2026-08-16T17:05:07.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 153.763114] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6340d34ef69e389a163a0e77","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6340d34ef69e389a163a0e77: start","job_status":"start","queue_duration_s":1.653069,"scheduling_latency_s":1.65309}1382gitlab # [ 153.765052] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6340d34ef69e389a163a0e77","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6340d34ef69e389a163a0e77: done: 0.060939 sec","job_status":"done","queue_duration_s":1.653069,"scheduling_latency_s":1.65309,"redis_calls":13,"redis_duration_s":0.020639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060939,"completed_at":"2026-08-16T17:05:07.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 153.811744] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26833beaf70d159ee49556d0","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26833beaf70d159ee49556d0: start","job_status":"start","queue_duration_s":1.724585,"scheduling_latency_s":1.724634}1384gitlab # [ 153.812988] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26833beaf70d159ee49556d0","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26833beaf70d159ee49556d0: done: 0.064122 sec","job_status":"done","queue_duration_s":1.724585,"scheduling_latency_s":1.724634,"redis_calls":13,"redis_duration_s":0.021628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007377,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.064122,"completed_at":"2026-08-16T17:05:07.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 153.874475] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dec21cb22a8b8a8b037870a","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dec21cb22a8b8a8b037870a: start","job_status":"start","queue_duration_s":1.815293,"scheduling_latency_s":1.815324}1386gitlab # [ 153.882121] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dec21cb22a8b8a8b037870a","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dec21cb22a8b8a8b037870a: done: 0.051343 sec","job_status":"done","queue_duration_s":1.815293,"scheduling_latency_s":1.815324,"redis_calls":13,"redis_duration_s":0.018288,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.051343,"completed_at":"2026-08-16T17:05:07.658Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 153.903895] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f60ff4a97a2d8daead33225b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f60ff4a97a2d8daead33225b: start","job_status":"start","queue_duration_s":1.868329,"scheduling_latency_s":1.868348}1388gitlab # [ 154.007974] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f60ff4a97a2d8daead33225b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f60ff4a97a2d8daead33225b: done: 0.123577 sec","job_status":"done","queue_duration_s":1.868329,"scheduling_latency_s":1.868348,"redis_calls":13,"redis_duration_s":0.017532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005355,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.123577,"completed_at":"2026-08-16T17:05:07.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 154.033988] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8c350be3e016bd79cd6a254","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8c350be3e016bd79cd6a254: start","job_status":"start","queue_duration_s":1.998571,"scheduling_latency_s":1.998613}1390gitlab # [ 154.042707] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8c350be3e016bd79cd6a254","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8c350be3e016bd79cd6a254: done: 0.028932 sec","job_status":"done","queue_duration_s":1.998571,"scheduling_latency_s":1.998613,"redis_calls":13,"redis_duration_s":0.005742000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002399,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003343,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028932,"completed_at":"2026-08-16T17:05:07.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 154.053420] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c255f8be43fb54c4046013f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c255f8be43fb54c4046013f: start","job_status":"start","queue_duration_s":2.028687,"scheduling_latency_s":2.02871}1392gitlab # [ 154.065843] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c255f8be43fb54c4046013f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c255f8be43fb54c4046013f: done: 0.021959 sec","job_status":"done","queue_duration_s":2.028687,"scheduling_latency_s":2.02871,"redis_calls":13,"redis_duration_s":0.003758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021959,"completed_at":"2026-08-16T17:05:07.842Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 154.106816] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccf2c3cfb00ba7b48f101a1b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccf2c3cfb00ba7b48f101a1b: start","job_status":"start","queue_duration_s":2.052757,"scheduling_latency_s":2.052775}1394gitlab # [ 154.134315] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccf2c3cfb00ba7b48f101a1b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccf2c3cfb00ba7b48f101a1b: done: 0.066137 sec","job_status":"done","queue_duration_s":2.052757,"scheduling_latency_s":2.052775,"redis_calls":13,"redis_duration_s":0.010093,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007507,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.066137,"completed_at":"2026-08-16T17:05:07.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 154.140081] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0e8c15d1b32dc662e12d867","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0e8c15d1b32dc662e12d867: start","job_status":"start","queue_duration_s":2.124843,"scheduling_latency_s":2.124866}1396gitlab # [ 154.175650] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0e8c15d1b32dc662e12d867","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0e8c15d1b32dc662e12d867: done: 0.035629 sec","job_status":"done","queue_duration_s":2.124843,"scheduling_latency_s":2.124866,"redis_calls":13,"redis_duration_s":0.012264,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007326,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035629,"completed_at":"2026-08-16T17:05:07.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 154.179630] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"233731c76281eb89f934d9d7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-233731c76281eb89f934d9d7: start","job_status":"start","queue_duration_s":2.161497,"scheduling_latency_s":2.161515}1398gitlab # [ 154.214203] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"233731c76281eb89f934d9d7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-233731c76281eb89f934d9d7: done: 0.017086 sec","job_status":"done","queue_duration_s":2.161497,"scheduling_latency_s":2.161515,"redis_calls":13,"redis_duration_s":0.0025109999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017086,"completed_at":"2026-08-16T17:05:07.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 154.219720] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471a79d462e430253678248d","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471a79d462e430253678248d: start","job_status":"start","queue_duration_s":2.180457,"scheduling_latency_s":2.180473}1400gitlab # [ 154.254979] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471a79d462e430253678248d","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471a79d462e430253678248d: done: 0.017225 sec","job_status":"done","queue_duration_s":2.180457,"scheduling_latency_s":2.180473,"redis_calls":13,"redis_duration_s":0.002422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017225,"completed_at":"2026-08-16T17:05:07.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 154.260224] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"854c24081f3d7a39e4e5524f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-854c24081f3d7a39e4e5524f: start","job_status":"start","queue_duration_s":2.199318,"scheduling_latency_s":2.199332}1402gitlab # [ 154.300991] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"854c24081f3d7a39e4e5524f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-854c24081f3d7a39e4e5524f: done: 0.01341 sec","job_status":"done","queue_duration_s":2.199318,"scheduling_latency_s":2.199332,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01341,"completed_at":"2026-08-16T17:05:08.004Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 154.303404] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec22921b7cc8bb67ed74ff6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec22921b7cc8bb67ed74ff6: start","job_status":"start","queue_duration_s":2.214494,"scheduling_latency_s":2.214513}1404gitlab # [ 154.338095] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec22921b7cc8bb67ed74ff6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec22921b7cc8bb67ed74ff6: done: 0.017001 sec","job_status":"done","queue_duration_s":2.214494,"scheduling_latency_s":2.214513,"redis_calls":13,"redis_duration_s":0.002241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017001,"completed_at":"2026-08-16T17:05:08.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 154.339543] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef3f0778d3705842da0cae2","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef3f0778d3705842da0cae2: start","job_status":"start","queue_duration_s":2.232558,"scheduling_latency_s":2.232571}1406gitlab # [ 154.381126] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef3f0778d3705842da0cae2","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef3f0778d3705842da0cae2: done: 0.036082 sec","job_status":"done","queue_duration_s":2.232558,"scheduling_latency_s":2.232571,"redis_calls":13,"redis_duration_s":0.001759,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036082,"completed_at":"2026-08-16T17:05:08.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 154.382098] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d186d6fcee007fc6aefc16d","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d186d6fcee007fc6aefc16d: start","job_status":"start","queue_duration_s":2.273701,"scheduling_latency_s":2.273721}1408gitlab # [ 154.420973] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d186d6fcee007fc6aefc16d","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d186d6fcee007fc6aefc16d: done: 0.021844 sec","job_status":"done","queue_duration_s":2.273701,"scheduling_latency_s":2.273721,"redis_calls":13,"redis_duration_s":0.005922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021844,"completed_at":"2026-08-16T17:05:08.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 154.421792] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3047d0a4b3386051225eb3f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3047d0a4b3386051225eb3f: start","job_status":"start","queue_duration_s":2.297459,"scheduling_latency_s":2.297474}1410gitlab # [ 154.429545] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3047d0a4b3386051225eb3f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3047d0a4b3386051225eb3f: done: 0.018086 sec","job_status":"done","queue_duration_s":2.297459,"scheduling_latency_s":2.297474,"redis_calls":13,"redis_duration_s":0.002273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018086,"completed_at":"2026-08-16T17:05:08.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 154.471957] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f601f8b0409f838e476de2a","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f601f8b0409f838e476de2a: start","job_status":"start","queue_duration_s":2.317415,"scheduling_latency_s":2.317431}1412gitlab # [ 154.472654] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f601f8b0409f838e476de2a","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f601f8b0409f838e476de2a: done: 0.017203 sec","job_status":"done","queue_duration_s":2.317415,"scheduling_latency_s":2.317431,"redis_calls":13,"redis_duration_s":0.0015409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017203,"completed_at":"2026-08-16T17:05:08.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 154.527755] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"502769b6dcf250e35501274f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-502769b6dcf250e35501274f: start","job_status":"start","queue_duration_s":2.336738,"scheduling_latency_s":2.336762}1414gitlab # [ 154.528612] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"502769b6dcf250e35501274f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-502769b6dcf250e35501274f: done: 0.020342 sec","job_status":"done","queue_duration_s":2.336738,"scheduling_latency_s":2.336762,"redis_calls":13,"redis_duration_s":0.002502,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001757,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020342,"completed_at":"2026-08-16T17:05:08.148Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 154.572911] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"359c6d8d46321ee18f65c848","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-359c6d8d46321ee18f65c848: start","job_status":"start","queue_duration_s":2.358908,"scheduling_latency_s":2.358926}1416gitlab # [ 154.573583] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"359c6d8d46321ee18f65c848","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-359c6d8d46321ee18f65c848: done: 0.020366 sec","job_status":"done","queue_duration_s":2.358908,"scheduling_latency_s":2.358926,"redis_calls":13,"redis_duration_s":0.002623,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001364,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020366,"completed_at":"2026-08-16T17:05:08.171Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 154.583573] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c750459525c68085be2d5fd","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c750459525c68085be2d5fd: start","job_status":"start","queue_duration_s":2.381104,"scheduling_latency_s":2.381143}1418gitlab # [ 154.617867] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c750459525c68085be2d5fd","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c750459525c68085be2d5fd: done: 0.019996 sec","job_status":"done","queue_duration_s":2.381104,"scheduling_latency_s":2.381143,"redis_calls":13,"redis_duration_s":0.005069,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003532,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019996,"completed_at":"2026-08-16T17:05:08.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 154.623296] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9040524bd1b0dce7256c4d28","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9040524bd1b0dce7256c4d28: start","job_status":"start","queue_duration_s":2.402371,"scheduling_latency_s":2.402386}1420gitlab # [ 154.634587] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9040524bd1b0dce7256c4d28","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9040524bd1b0dce7256c4d28: done: 0.028328 sec","job_status":"done","queue_duration_s":2.402371,"scheduling_latency_s":2.402386,"redis_calls":13,"redis_duration_s":0.004431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028328,"completed_at":"2026-08-16T17:05:08.222Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 154.670118] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de08bf8acb5b22e3c28eeccc","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de08bf8acb5b22e3c28eeccc: start","job_status":"start","queue_duration_s":2.443965,"scheduling_latency_s":2.443984}1422gitlab # [ 154.673773] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de08bf8acb5b22e3c28eeccc","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de08bf8acb5b22e3c28eeccc: done: 0.021156 sec","job_status":"done","queue_duration_s":2.443965,"scheduling_latency_s":2.443984,"redis_calls":13,"redis_duration_s":0.007320999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005658,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021156,"completed_at":"2026-08-16T17:05:08.256Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 154.714629] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1124e60ce20ff7bbac1d5fb","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1124e60ce20ff7bbac1d5fb: start","job_status":"start","queue_duration_s":2.466149,"scheduling_latency_s":2.466167}1424gitlab # [ 154.715424] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1124e60ce20ff7bbac1d5fb","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1124e60ce20ff7bbac1d5fb: done: 0.018583 sec","job_status":"done","queue_duration_s":2.466149,"scheduling_latency_s":2.466167,"redis_calls":13,"redis_duration_s":0.00164,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018583,"completed_at":"2026-08-16T17:05:08.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 154.753658] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e203dce5eb0eabd38340575","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e203dce5eb0eabd38340575: start","job_status":"start","queue_duration_s":2.486709,"scheduling_latency_s":2.486731}1426gitlab # [ 154.754257] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e203dce5eb0eabd38340575","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e203dce5eb0eabd38340575: done: 0.021809 sec","job_status":"done","queue_duration_s":2.486709,"scheduling_latency_s":2.486731,"redis_calls":13,"redis_duration_s":0.003329,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021809,"completed_at":"2026-08-16T17:05:08.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 154.789089] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0df266c5ddb992c361383646","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0df266c5ddb992c361383646: start","job_status":"start","queue_duration_s":2.51015,"scheduling_latency_s":2.510171}1428gitlab # [ 154.794774] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0df266c5ddb992c361383646","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0df266c5ddb992c361383646: done: 0.021842 sec","job_status":"done","queue_duration_s":2.51015,"scheduling_latency_s":2.510171,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021842,"completed_at":"2026-08-16T17:05:08.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 154.858625] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5445dd4c24d778a498808fd7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5445dd4c24d778a498808fd7: start","job_status":"start","queue_duration_s":2.535034,"scheduling_latency_s":2.535053}1430gitlab # [ 154.859292] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5445dd4c24d778a498808fd7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5445dd4c24d778a498808fd7: done: 0.018269 sec","job_status":"done","queue_duration_s":2.535034,"scheduling_latency_s":2.535053,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018269,"completed_at":"2026-08-16T17:05:08.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 154.866531] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5da8822e32c7d0adc5eea8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5da8822e32c7d0adc5eea8: start","job_status":"start","queue_duration_s":2.555236,"scheduling_latency_s":2.555253}1432gitlab # [ 154.902899] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5da8822e32c7d0adc5eea8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5da8822e32c7d0adc5eea8: done: 0.14169 sec","job_status":"done","queue_duration_s":2.555236,"scheduling_latency_s":2.555253,"redis_calls":13,"redis_duration_s":0.097153,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.094448,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.14169,"completed_at":"2026-08-16T17:05:08.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 154.940039] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c06aaee0d89cda143bc2744","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c06aaee0d89cda143bc2744: start","job_status":"start","queue_duration_s":2.713418,"scheduling_latency_s":2.713442}1434gitlab # [ 154.940772] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c06aaee0d89cda143bc2744","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c06aaee0d89cda143bc2744: done: 0.024072 sec","job_status":"done","queue_duration_s":2.713418,"scheduling_latency_s":2.713442,"redis_calls":13,"redis_duration_s":0.007176999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00471,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024072,"completed_at":"2026-08-16T17:05:08.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 154.952585] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b70d4b4507a5fdfad4768bd","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b70d4b4507a5fdfad4768bd: start","job_status":"start","queue_duration_s":2.741259,"scheduling_latency_s":2.741277}1436gitlab # [ 154.993586] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b70d4b4507a5fdfad4768bd","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b70d4b4507a5fdfad4768bd: done: 0.026875 sec","job_status":"done","queue_duration_s":2.741259,"scheduling_latency_s":2.741277,"redis_calls":13,"redis_duration_s":0.009600000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026875,"completed_at":"2026-08-16T17:05:08.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 154.994619] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1d39683a9fcc08d3d5c7fd3","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1d39683a9fcc08d3d5c7fd3: start","job_status":"start","queue_duration_s":2.772395,"scheduling_latency_s":2.772415}1438gitlab # [ 155.113974] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1d39683a9fcc08d3d5c7fd3","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1d39683a9fcc08d3d5c7fd3: done: 0.326104 sec","job_status":"done","queue_duration_s":2.772395,"scheduling_latency_s":2.772415,"redis_calls":13,"redis_duration_s":0.190002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.186115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.326104,"completed_at":"2026-08-16T17:05:08.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 155.118075] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98576788d5e1d348533726f6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98576788d5e1d348533726f6: start","job_status":"start","queue_duration_s":3.102061,"scheduling_latency_s":3.102083}1440gitlab # [ 155.141685] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98576788d5e1d348533726f6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98576788d5e1d348533726f6: done: 0.024249 sec","job_status":"done","queue_duration_s":3.102061,"scheduling_latency_s":3.102083,"redis_calls":13,"redis_duration_s":0.005673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004426,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024249,"completed_at":"2026-08-16T17:05:08.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 155.179549] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0de5fbfcc9dec77bac9cb1ea","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0de5fbfcc9dec77bac9cb1ea: start","job_status":"start","queue_duration_s":3.133014,"scheduling_latency_s":3.133031}1442gitlab # [ 155.180166] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0de5fbfcc9dec77bac9cb1ea","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0de5fbfcc9dec77bac9cb1ea: done: 0.024436 sec","job_status":"done","queue_duration_s":3.133014,"scheduling_latency_s":3.133031,"redis_calls":13,"redis_duration_s":0.010583,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024436,"completed_at":"2026-08-16T17:05:08.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 155.221045] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d317a028f3bc57fa0116dd20","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d317a028f3bc57fa0116dd20: start","job_status":"start","queue_duration_s":3.159497,"scheduling_latency_s":3.159512}1444gitlab # [ 155.221524] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d317a028f3bc57fa0116dd20","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d317a028f3bc57fa0116dd20: done: 0.027425 sec","job_status":"done","queue_duration_s":3.159497,"scheduling_latency_s":3.159512,"redis_calls":13,"redis_duration_s":0.015081,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005707,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009374,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027425,"completed_at":"2026-08-16T17:05:08.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 155.232608] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9249f37edb623a8fea2561b6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9249f37edb623a8fea2561b6: start","job_status":"start","queue_duration_s":3.1902,"scheduling_latency_s":3.190217}1446gitlab # [ 155.269368] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9249f37edb623a8fea2561b6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9249f37edb623a8fea2561b6: done: 0.041503 sec","job_status":"done","queue_duration_s":3.1902,"scheduling_latency_s":3.190217,"redis_calls":13,"redis_duration_s":0.025348,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003649,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.021699,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041503,"completed_at":"2026-08-16T17:05:09.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 155.274988] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.026Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b0c58ed06af368500e79f0e9","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b0c58ed06af368500e79f0e9: start","job_status":"start","queue_duration_s":2.608567,"scheduling_latency_s":2.608588}1448gitlab # [ 155.310064] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.057Z","message":"No existing merge request to be cleaned up."}1449gitlab # [ 155.310669] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.075Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b0c58ed06af368500e79f0e9","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b0c58ed06af368500e79f0e9: done: 0.049293 sec","job_status":"done","queue_duration_s":2.608567,"scheduling_latency_s":2.608588,"redis_calls":13,"redis_duration_s":0.010658,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001071,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004483,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001618921,"duration_s":0.049293,"completed_at":"2026-08-16T17:05:09.075Z","load_balancing_strategy":"primary","db_duration_s":0.009598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 155.316155] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.078Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f53428abb429041f48a490ea","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f53428abb429041f48a490ea: start","job_status":"start","queue_duration_s":2.660076,"scheduling_latency_s":2.660096}1451gitlab # [ 155.352542] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.110Z","message":"No existing merge request to be cleaned up."}1452gitlab # [ 155.353083] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.125Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f53428abb429041f48a490ea","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f53428abb429041f48a490ea: done: 0.047115 sec","job_status":"done","queue_duration_s":2.660076,"scheduling_latency_s":2.660096,"redis_calls":10,"redis_duration_s":0.019725,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.01687,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047115,"completed_at":"2026-08-16T17:05:09.125Z","load_balancing_strategy":"primary","db_duration_s":0.008266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 155.390312] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.127Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4175479dbb56610d5cf17ea0","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4175479dbb56610d5cf17ea0: start","job_status":"start","queue_duration_s":2.71,"scheduling_latency_s":2.710018}1454gitlab # [ 155.391055] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.153Z","message":"No existing merge request to be cleaned up."}1455gitlab # [ 155.392935] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.169Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4175479dbb56610d5cf17ea0","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4175479dbb56610d5cf17ea0: done: 0.041787 sec","job_status":"done","queue_duration_s":2.71,"scheduling_latency_s":2.710018,"redis_calls":10,"redis_duration_s":0.007928000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005322,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041787,"completed_at":"2026-08-16T17:05:09.169Z","load_balancing_strategy":"primary","db_duration_s":0.007502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 155.402813] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.178Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0ca181a2be7add9c73c0954","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0ca181a2be7add9c73c0954: start","job_status":"start","queue_duration_s":2.760493,"scheduling_latency_s":2.760514}1457gitlab # [ 155.441812] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.198Z","message":"No existing merge request to be cleaned up."}1458gitlab # [ 155.442664] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.209Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0ca181a2be7add9c73c0954","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0ca181a2be7add9c73c0954: done: 0.031219 sec","job_status":"done","queue_duration_s":2.760493,"scheduling_latency_s":2.760514,"redis_calls":10,"redis_duration_s":0.007346999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004861,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031219,"completed_at":"2026-08-16T17:05:09.209Z","load_balancing_strategy":"primary","db_duration_s":0.005102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 167.859487] setup-gitlab-start[2258]: W, [2026-08-16T17:05:21.635407 #2258] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1460gitlab # [ 190.916397] postgres[2479]: [2479] ERROR: relation "table_without_models" does not exist1461gitlab # [ 190.916902] postgres[2479]: [2479] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1462gitlab # [ 193.966880] runuser[2257]: pam_unix(runuser:session): session closed for user gitlab1463gitlab # [ 193.970281] setup-gitlab-start[2235]: + systemctl restart gitlab-sidekiq.service1464gitlab # [ 193.993131] systemd[1]: Stopping gitlab-sidekiq.service...1465gitlab # [ 193.994204] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:47.769Z","message":"Shutting down"}1466gitlab # [ 193.997529] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:47.774Z","message":"Scheduler exiting..."}1467gitlab # [ 194.000738] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:47.774Z","message":"Terminating quiet threads for default capsule"}1468gitlab # [ 194.004409] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:47.775Z","message":"Scheduler exiting..."}1469gitlab # [ 194.499819] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:48.276Z","message":"Pausing to allow jobs to finish..."}1470gitlab # [ 196.002182] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:49.778Z","message":"Bye!"}1471gitlab # [ 196.021785] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:49.798Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1640,"worker_id":"sidekiq_0","memwd_rss_bytes":947810304,"retry":0}1472gitlab # [ 198.298129] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1473gitlab # [ 198.299700] systemd[1]: Stopped gitlab-sidekiq.service.1474gitlab # [ 198.301626] systemd[1]: gitlab-sidekiq.service: Consumed 1min 2.805s CPU time over 2min 3.197s wall clock time, 955.1M memory peak, 4.4M read from disk.1475gitlab # [ 198.303685] systemd[1]: Started gitlab-sidekiq.service.1476gitlab # [ 198.306961] setup-gitlab-start[2235]: + mkdir -p /var/lib/secrets1477gitlab # [ 198.311344] setup-gitlab-start[2235]: + echo nixbot-test-token-of-20-chars1478gitlab # [ 198.314480] setup-gitlab-start[2235]: + chmod 644 /var/lib/secrets/gitlab-token1479gitlab # [ 198.318352] setup-gitlab-start[2235]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1480gitlab # [ 199.099223] gitaly[902]: time="2026-08-16T17:05:52.875Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:02.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:52.875" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1481gitlab # [ 199.120555] gitaly[902]: time="2026-08-16T17:05:52.875Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:02.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:52.875" grpc.time_ms=0.29 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1482gitlab # [ 199.248438] gitaly[902]: time="2026-08-16T17:05:53.025Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.024" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1483gitlab # [ 199.269760] gitaly[902]: time="2026-08-16T17:05:53.025Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.024" grpc.time_ms=0.443 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1484gitlab # [ 199.313636] gitaly[902]: time="2026-08-16T17:05:53.090Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ diskcache=31f59adb-990d-40ce-9477-1a5c57f6347c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:03.029" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.050" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1485gitlab # [ 199.334523] gitaly[902]: time="2026-08-16T17:05:53.111Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1584 command.oublock=32 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:03.029" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.050" grpc.time_ms=40.181 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1486gitlab # [ 199.371212] gitaly[902]: time="2026-08-16T17:05:53.147Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.126" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.147" pid=902 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1487gitlab # [ 199.372583] gitaly[902]: time="2026-08-16T17:05:53.148Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.126" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.147" grpc.time_ms=0.781 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 199.412539] gitaly[902]: time="2026-08-16T17:05:53.189Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:03.157" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.178" grpc.time_ms=11.118 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 199.511848] gitaly[902]: time="2026-08-16T17:05:53.288Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.267" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.288" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 199.532842] gitaly[902]: time="2026-08-16T17:05:53.288Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.267" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.288" grpc.time_ms=0.451 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 199.572031] gitaly[902]: time="2026-08-16T17:05:53.348Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ diskcache=d0c9dafc-9ba2-4942-bbe9-d143b38bbddf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:03.272" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.293" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1492gitlab # [ 199.572779] gitaly[902]: time="2026-08-16T17:05:53.349Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1584 command.oublock=32 command.real_time_ms=33 command.spawn_token_fork_ms=5 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:03.272" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.293" grpc.time_ms=55.905 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 199.612778] gitaly[902]: time="2026-08-16T17:05:53.389Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.038" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.388" pid=902 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1494gitlab # [ 199.613853] gitaly[902]: time="2026-08-16T17:05:53.389Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.038" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.388" grpc.time_ms=0.808 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 199.630355] gitaly[902]: time="2026-08-16T17:05:53.407Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:03.045" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.396" grpc.time_ms=10.586 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 199.667485] gitaly[902]: time="2026-08-16T17:05:53.444Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.093" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.443" grpc.time_ms=0.282 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 199.686492] gitaly[902]: time="2026-08-16T17:05:53.463Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:03.112" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.462" grpc.time_ms=0.292 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 200.263151] gitaly[902]: time="2026-08-16T17:05:54.039Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:04.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:54.028" grpc.time_ms=10.508 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1499gitlab # [ 200.516217] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:54 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 21731500gitlab # [ 200.520816] setup-gitlab-start[2235]: + mkdir -p /tmp/test-flake1501gitlab # [ 200.522968] setup-gitlab-start[2235]: + cd /tmp/test-flake1502gitlab # [ 200.524866] setup-gitlab-start[2235]: + git init -b master1503gitlab # [ 200.542579] setup-gitlab-start[2574]: Initialized empty Git repository in /tmp/test-flake/.git/1504gitlab # [ 200.545368] setup-gitlab-start[2235]: + git config user.name test1505gitlab # [ 200.547514] setup-gitlab-start[2235]: + git config user.email test@example.com1506gitlab # [ 200.551122] setup-gitlab-start[2235]: + cat1507gitlab # [ 200.554618] setup-gitlab-start[2235]: + git add flake.nix1508gitlab # [ 200.561091] setup-gitlab-start[2235]: + git commit -m 'initial commit'1509gitlab # [ 200.579506] setup-gitlab-start[2579]: [master (root-commit) 0a07b83] initial commit1510gitlab # [ 200.580489] setup-gitlab-start[2579]: 1 file changed, 10 insertions(+)1511gitlab # [ 200.581534] setup-gitlab-start[2579]: create mode 100644 flake.nix1512gitlab # [ 200.585717] setup-gitlab-start[2235]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1513gitlab # [ 200.593418] setup-gitlab-start[2235]: + git push -u origin master1514gitlab # [ 200.644418] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 271515gitlab # [ 201.265392] gitaly[902]: time="2026-08-16T17:05:55.041Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RJYQTDG0026E5922F3QMQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:55.029" grpc.time_ms=11.719 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1516gitlab # [ 201.267269] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 6171517gitlab # [ 201.500607] sidekiq-cluster[2525]: {"severity":"INFO","time":"2026-08-16T17:05:55.259Z","message":"Starting cluster with 1 processes"}1518gitlab # [ 201.577127] gitaly[902]: time="2026-08-16T17:05:55.353Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:05.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:55.348" grpc.time_ms=5.316 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1519gitlab # [ 201.604890] gitaly[902]: time="2026-08-16T17:05:55.381Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:06:25.074" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:05:55.374" grpc.time_ms=6.574 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1520gitlab # [ 201.625790] gitaly[902]: time="2026-08-16T17:05:55.402Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05RJZCD21JKPFK9SA7DGA9C duration_ms=151ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/allowed"1521gitlab # [ 201.656265] gitaly[902]: time="2026-08-16T17:05:55.433Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05RJZCD21JKPFK9SA7DGA9C duration_ms=29ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/pre_receive"1522gitlab # [ 201.659164] gitaly[902]: time="2026-08-16T17:05:55.436Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.250" grpc.time_ms=185.53 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1523gitlab # [ 201.699731] gitaly[902]: time="2026-08-16T17:05:55.476Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.475" grpc.time_ms=1.426 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1524gitlab # [ 201.738800] gitaly[902]: time="2026-08-16T17:05:55.515Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.514" grpc.time_ms=1.051 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1525gitlab # [ 201.777682] gitaly[902]: time="2026-08-16T17:05:55.554Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.554" grpc.time_ms=0.317 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1526gitlab # [ 201.900195] gitaly[902]: time="2026-08-16T17:05:55.677Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:05.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:55.668" grpc.time_ms=8.291 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1527gitlab # [ 201.943713] gitaly[902]: time="2026-08-16T17:05:55.720Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:06:05.038" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:55.698" grpc.time_ms=21.537 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1528gitlab # [ 201.959030] gitaly[902]: time="2026-08-16T17:05:55.735Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05RJZCD21JKPFK9SA7DGA9C duration_ms=151ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/post_receive"1529gitlab # [ 201.962801] gitaly[902]: time="2026-08-16T17:05:55.739Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.584" grpc.time_ms=155.444 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1530gitlab # [ 201.985193] gitaly[902]: time="2026-08-16T17:05:55.762Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C diskcache=8800466a-4a60-4407-b73f-346b833860d9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:55.166" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1531gitlab # [ 201.996231] gitaly[902]: time="2026-08-16T17:05:55.773Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=195 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13688 command.oublock=32 command.real_time_ms=585 command.spawn_token_fork_ms=0 command.system_time_ms=126 command.user_time_ms=69 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:55.166" grpc.time_ms=595.941 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1532gitlab # [ 202.011226] gitlab-workhorse[824]: time="2026-08-16T17:05:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521533gitlab # [ 202.011982] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:55 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7021534gitlab # [ 202.017094] setup-gitlab-start[2583]: To http://gitlab/root/test-flake.git1535gitlab # [ 202.018087] setup-gitlab-start[2583]: * [new branch] master -> master1536gitlab # [ 202.023945] setup-gitlab-start[2583]: branch 'master' set up to track 'origin/master'.1537gitlab # [ 202.028524] systemd[1]: Finished setup-gitlab.service.1538gitlab # [ 202.033965] systemd[1]: Starting nixbot CI service...1539gitlab: (finished: waiting for unit setup-gitlab.service, in 202.81 seconds)1540gitlab: waiting for unit nixbot.service1541gitlab # [ 203.030250] nixbot[2674]: {"ts": "2026-08-16T17:05:56.806Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1542gitlab # [ 203.051794] nixbot[2674]: {"ts": "2026-08-16T17:05:56.828Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1543gitlab # [ 203.068740] nixbot[2674]: {"ts": "2026-08-16T17:05:56.845Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1544gitlab # [ 203.077133] nixbot[2674]: {"ts": "2026-08-16T17:05:56.853Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1545gitlab # [ 203.084569] nixbot[2674]: {"ts": "2026-08-16T17:05:56.861Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1546gitlab # [ 203.093814] nixbot[2674]: {"ts": "2026-08-16T17:05:56.870Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1547gitlab # [ 203.098803] nixbot[2674]: {"ts": "2026-08-16T17:05:56.874Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1548gitlab # [ 203.104223] nixbot[2674]: {"ts": "2026-08-16T17:05:56.876Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1549gitlab # [ 203.108900] nixbot[2674]: {"ts": "2026-08-16T17:05:56.884Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1550gitlab # [ 203.113324] nixbot[2674]: {"ts": "2026-08-16T17:05:56.890Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1551gitlab # [ 203.123571] nixbot[2674]: {"ts": "2026-08-16T17:05:56.900Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1552gitlab # [ 203.135841] nixbot[2674]: {"ts": "2026-08-16T17:05:56.912Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1553gitlab # [ 203.141302] nixbot[2674]: {"ts": "2026-08-16T17:05:56.916Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1554gitlab # [ 203.147679] nixbot[2674]: {"ts": "2026-08-16T17:05:56.924Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1555gitlab # [ 203.157599] nixbot[2674]: {"ts": "2026-08-16T17:05:56.934Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1556gitlab # [ 203.165449] nixbot[2674]: {"ts": "2026-08-16T17:05:56.942Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1557gitlab # [ 203.172580] nixbot[2674]: {"ts": "2026-08-16T17:05:56.949Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1558gitlab # [ 203.179439] nixbot[2674]: {"ts": "2026-08-16T17:05:56.956Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1559gitlab # [ 203.190381] nixbot[2674]: {"ts": "2026-08-16T17:05:56.966Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1560gitlab # [ 203.197968] nixbot[2674]: {"ts": "2026-08-16T17:05:56.974Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1561gitlab # [ 203.205335] nixbot[2674]: {"ts": "2026-08-16T17:05:56.982Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1562gitlab # [ 203.216589] nixbot[2674]: {"ts": "2026-08-16T17:05:56.993Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1563gitlab # [ 203.223694] nixbot[2674]: {"ts": "2026-08-16T17:05:57.000Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1564gitlab # [ 203.232120] nixbot[2674]: {"ts": "2026-08-16T17:05:57.008Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1565gitlab # [ 203.238864] nixbot[2674]: {"ts": "2026-08-16T17:05:57.015Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1566gitlab # [ 203.529547] nixbot[2674]: INFO: Started server process [2674]1567gitlab # [ 203.530320] nixbot[2674]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1568gitlab # [ 203.545715] nixbot[2674]: INFO: ::ffff:127.0.0.1:42846 - "GET /health HTTP/1.1" 200 OK1569gitlab # [ 203.552171] systemd[1]: Started nixbot CI service.1570gitlab # [ 203.556785] systemd[1]: Reached target Multi-User System.1571gitlab # [ 203.559285] systemd[1]: Startup finished in 1.072s (kernel) + 3.374s (initrd) + 3min 19.111s (userspace) = 3min 23.559s.1572gitlab # [ 204.257410] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 7111573gitlab # [ 204.260171] nixbot[2674]: {"ts": "2026-08-16T17:05:58.034Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1574gitlab # [ 204.292474] nixbot[2674]: {"ts": "2026-08-16T17:05:58.069Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1575gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1576gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1577gitlab # [ 204.336594] nixbot[2674]: INFO: ::ffff:127.0.0.1:56032 - "GET /health HTTP/1.1" 200 OK1578gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1579subtest: project discovered and webhook registered1580gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1581gitlab # [ 204.358079] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 501582gitlab # [ 204.361066] nixbot[2674]: {"ts": "2026-08-16T17:05:58.136Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1583gitlab # [ 204.361555] nixbot[2674]: {"ts": "2026-08-16T17:05:58.137Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1584gitlab # [ 204.405576] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 321585gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds)1586gitlab # [ 204.510673] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1391587gitlab # [ 204.511817] nixbot[2674]: {"ts": "2026-08-16T17:05:58.288Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1588gitlab # [ 204.636706] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1191589gitlab # [ 204.642643] nixbot[2674]: {"ts": "2026-08-16T17:05:58.414Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1590gitlab # [ 204.705534] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 581591gitlab # [ 204.710488] nixbot[2674]: {"ts": "2026-08-16T17:05:58.483Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1592gitlab # [ 204.793982] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 821593gitlab # [ 204.799570] nixbot[2674]: {"ts": "2026-08-16T17:05:58.576Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1594gitlab # [ 204.862709] gitaly[902]: time="2026-08-16T17:05:58.638Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK2SW8JZQ7SPMVTZB7H53 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T17:06:28.322" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:58.622" grpc.time_ms=15.816 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 204.905738] gitaly[902]: time="2026-08-16T17:05:58.682Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK2SW8JZQ7SPMVTZB7H53 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:28.381" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:05:58.681" grpc.time_ms=0.709 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 204.939456] gitaly[902]: time="2026-08-16T17:05:58.716Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK2SW8JZQ7SPMVTZB7H53 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T17:06:08.047" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:05:58.707" grpc.time_ms=8.234 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 204.970420] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1581598gitlab # [ 204.972209] nixbot[2674]: {"ts": "2026-08-16T17:05:58.749Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1599gitlab # [ 205.056176] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 811600gitlab # [ 205.062526] nixbot[2674]: {"ts": "2026-08-16T17:05:58.839Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1601gitlab # [ 205.072117] nixbot[2674]: {"ts": "2026-08-16T17:05:58.848Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1602gitlab # [ 205.163572] gitaly[902]: time="2026-08-16T17:05:58.939Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK33DCCPRNR1DP13ABYWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:58.930" grpc.time_ms=8.713 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1603gitlab # [ 205.167312] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 471604gitlab # [ 205.236790] gitaly[902]: time="2026-08-16T17:05:59.013Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK34YAA4S7R1VZ5FVFM54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.003" pid=902 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1605gitlab # [ 205.237968] gitaly[902]: time="2026-08-16T17:05:59.013Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK34YAA4S7R1VZ5FVFM54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.003" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1606gitlab # [ 205.238744] gitlab-workhorse[824]: time="2026-08-16T17:05:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131607gitlab # [ 205.239784] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 711608gitlab # [ 205.240920] gitaly[902]: time="2026-08-16T17:05:59.014Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK34YAA4S7R1VZ5FVFM54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.003" grpc.time_ms=10.231 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1609gitlab # [ 205.329713] gitaly[902]: time="2026-08-16T17:05:59.106Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK38ACG0HX8JC34KA0VCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.088" pid=902 remote_ip="2001:db8:1::1" request_sha=4c9f1d26142e5e809980b04dcf47940777383e54 response_bytes=223 span.kind=server system=grpc1610gitlab # [ 205.330688] gitaly[902]: time="2026-08-16T17:05:59.106Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK38ACG0HX8JC34KA0VCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.088" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1611gitlab # [ 205.331473] gitaly[902]: time="2026-08-16T17:05:59.107Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK38ACG0HX8JC34KA0VCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.088" grpc.time_ms=18.01 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1612gitlab # [ 205.361806] gitlab-workhorse[824]: time="2026-08-16T17:05:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231613gitlab # [ 205.362493] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 871614gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1615gitlab # [ 205.466974] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651616gitlab # [ 205.469403] gitaly[902]: time="2026-08-16T17:05:59.243Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3CA2ZPNN7EZD9N5ZGSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.232" grpc.time_ms=11.155 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1617gitlab # [ 205.499530] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 591618gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds)1619(finished: subtest: project discovered and webhook registered, in 1.16 seconds)1620subtest: push delivers the webhook1621gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1622gitlab # [ 205.528921] gitaly[902]: time="2026-08-16T17:05:59.305Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3ESZQS05GFA0N7D98J6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.299" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1623gitlab # [ 205.537819] gitaly[902]: time="2026-08-16T17:05:59.305Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3ESZQS05GFA0N7D98J6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.299" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1624gitlab # [ 205.549357] gitlab-workhorse[824]: time="2026-08-16T17:05:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671625gitlab # [ 205.551043] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 501626gitlab # [ 205.553169] gitaly[902]: time="2026-08-16T17:05:59.306Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3ESZQS05GFA0N7D98J6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.299" grpc.time_ms=6.321 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1627gitlab # [ 205.574992] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 441628gitlab # [ 205.618292] gitaly[902]: time="2026-08-16T17:05:59.395Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3HNN7JWZC1F3ENN2R3D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.386" grpc.time_ms=8.445 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1629gitlab # [ 205.629232] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 461630gitlab # [ 205.656359] gitaly[902]: time="2026-08-16T17:05:59.433Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3HTWNC0F61554P2CWE0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.423" grpc.time_ms=9.764 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1631gitlab # [ 205.667283] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 801632gitlab # Enumerating objects: 5, done.1633gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1634gitlab # Delta compression using up to 4 threads1635gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1636gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1637gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1638gitlab # [ 205.714885] gitaly[902]: time="2026-08-16T17:05:59.491Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3K5RNA4W90J2TQZ3F7M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.479" pid=902 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1639gitlab # [ 205.723746] gitaly[902]: time="2026-08-16T17:05:59.492Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3K5RNA4W90J2TQZ3F7M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.479" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1640gitlab # [ 205.735194] gitlab-workhorse[824]: time="2026-08-16T17:05:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091641gitlab # [ 205.737420] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 951642gitlab # [ 205.739100] gitaly[902]: time="2026-08-16T17:05:59.492Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3K5RNA4W90J2TQZ3F7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.479" grpc.time_ms=13.198 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1643gitlab # [ 205.832321] gitaly[902]: time="2026-08-16T17:05:59.608Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:29.305" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:05:59.606" grpc.time_ms=2.449 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1644gitlab # [ 205.879772] gitaly[902]: time="2026-08-16T17:05:59.656Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:06:29.349" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:59.649" grpc.time_ms=6.271 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1645gitlab # [ 205.898840] gitaly[902]: time="2026-08-16T17:05:59.675Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:09.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:59.669" grpc.time_ms=5.847 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1646gitlab # [ 205.908648] gitaly[902]: time="2026-08-16T17:05:59.685Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:09.020" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:59.680" grpc.time_ms=4.914 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1647gitlab # [ 205.970861] gitaly[902]: time="2026-08-16T17:05:59.747Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:09.087" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:59.747" grpc.time_ms=0.201 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1648gitlab # [ 205.986402] gitaly[902]: time="2026-08-16T17:05:59.763Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:06:09.097" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:59.757" grpc.time_ms=5.533 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1649gitlab # [ 206.021524] gitaly[902]: time="2026-08-16T17:05:59.798Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:06:29.090" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:05:59.790" grpc.time_ms=7.712 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1650gitlab # [ 206.033886] gitaly[902]: time="2026-08-16T17:05:59.807Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.806" grpc.time_ms=0.332 pid=902 span.kind=server system=grpc1651gitlab # [ 206.041705] gitaly[902]: time="2026-08-16T17:05:59.813Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05RK3N0FWAPYMA73MHP365W duration_ms=93ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/allowed"1652gitlab # [ 206.050220] gitaly[902]: time="2026-08-16T17:05:59.827Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.826" grpc.time_ms=0.332 pid=902 span.kind=server system=grpc1653gitlab # [ 206.065407] gitaly[902]: time="2026-08-16T17:05:59.842Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ diskcache=173ab158-04e3-407b-bc00-05fa5346fda8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:09.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:59.775" pid=902 ref=refs/keep-around/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 remote_ip="2001:db8:1::1" revision=0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 span.kind=server system=grpc username=root1654gitlab # [ 206.066655] gitaly[902]: time="2026-08-16T17:05:59.843Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05RK3N0FWAPYMA73MHP365W duration_ms=29ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/pre_receive"1655gitlab # [ 206.067461] gitaly[902]: time="2026-08-16T17:05:59.843Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.719" grpc.time_ms=123.933 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1656gitlab # [ 206.071081] gitaly[902]: time="2026-08-16T17:05:59.848Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:29.547" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:05:59.847" grpc.time_ms=0.426 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 206.095377] gitaly[902]: time="2026-08-16T17:05:59.872Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=39 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5377 command.oublock=8 command.real_time_ms=58 command.spawn_token_fork_ms=1 command.system_time_ms=25 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:09.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:59.775" grpc.time_ms=66.495 pid=902 ref=refs/keep-around/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 remote_ip="2001:db8:1::1" revision=0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 span.kind=server system=grpc username=root1658gitlab # [ 206.122828] gitaly[902]: time="2026-08-16T17:05:59.899Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.899" grpc.time_ms=0.373 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1659gitlab # [ 206.152593] gitaly[902]: time="2026-08-16T17:05:59.929Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.928" grpc.time_ms=0.95 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1660gitlab # [ 206.177528] gitaly[902]: time="2026-08-16T17:05:59.954Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.953" grpc.time_ms=1.099 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1661gitlab # [ 206.205678] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4251662gitlab # [ 206.207230] nixbot[2674]: {"ts": "2026-08-16T17:05:59.983Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""}1663gitlab # [ 206.213792] nixbot[2674]: {"ts": "2026-08-16T17:05:59.990Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-0a07b83bc5d4-0"}1664gitlab # [ 206.247216] gitaly[902]: time="2026-08-16T17:06:00.024Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05RK3N0FWAPYMA73MHP365W duration_ms=35ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/post_receive"1665gitlab # [ 206.249935] gitaly[902]: time="2026-08-16T17:06:00.026Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.987" grpc.time_ms=38.982 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1666gitlab # [ 206.266518] systemd[1]: Started Nix Daemon.1667gitlab # [ 206.270581] gitaly[902]: time="2026-08-16T17:06:00.047Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W diskcache=32749213-9bbd-4975-8eec-0f0361cc44b7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.631" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1668gitlab # [ 206.272186] gitaly[902]: time="2026-08-16T17:06:00.048Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=126 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13154 command.oublock=32 command.real_time_ms=404 command.spawn_token_fork_ms=1 command.system_time_ms=89 command.user_time_ms=37 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.631" grpc.time_ms=416.368 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1669gitlab # [ 206.273073] gitlab-workhorse[824]: time="2026-08-16T17:06:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521670gitlab # [ 206.273897] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:00 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5921671gitlab # To http://gitlab/root/test-flake.git1672gitlab # 0a07b83..e652aaf master -> master1673gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.81 seconds)1674gitlab: must succeed: git -C /tmp/test-flake rev-parse master1675gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1676gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1677gitlab # [ 206.327538] nix-daemon[2877]: accepted connection from pid 2871, user nixbot1678gitlab # [ 206.368018] nixbot[2674]: INFO: ::ffff:127.0.0.1:56046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1679gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds)1680gitlab # [ 206.403318] nix-daemon[2877]: accepted connection from pid 2890, user nixbot1681gitlab # [ 206.416692] nixbot[2674]: {"ts": "2026-08-16T17:06:00.193Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-0a07b83bc5d4-0", "argv0": "bwrap"}1682gitlab # [ 206.569370] nix-daemon[2877]: accepted connection from pid 2900, user nixbot1683gitlab # [ 206.627838] nix-daemon[2877]: accepted connection from pid 2910, user nixbot1684gitlab # [ 206.642529] nix-daemon[2877]: accepted connection from pid 2900, user nixbot1685gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1686gitlab # [ 207.411264] nixbot[2674]: INFO: ::ffff:127.0.0.1:56056 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1687gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds)1688gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1689gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1690gitlab # [ 208.448444] nixbot[2674]: INFO: ::ffff:127.0.0.1:56058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1691gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1692gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1693gitlab # [ 209.481433] nixbot[2674]: INFO: ::ffff:127.0.0.1:56064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1694gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1695gitlab # [ 210.516544] nixbot[2674]: INFO: ::ffff:127.0.0.1:56068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1696gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1697gitlab # [ 210.872707] nix-daemon[2877]: accepted connection from pid 2935, user nixbot1698gitlab # [ 210.891852] gitaly[902]: time="2026-08-16T17:06:04.668Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK8PE6P23PGZXJJGB4FE0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:34.367" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:04.667" grpc.time_ms=0.512 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699gitlab # [ 210.918782] gitaly[902]: time="2026-08-16T17:06:04.695Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK8PE6P23PGZXJJGB4FE0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:14.027" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:04.687" grpc.time_ms=8.248 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1700gitlab # [ 210.955499] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1081701gitlab # [ 210.958708] nixbot[2674]: {"ts": "2026-08-16T17:06:04.735Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""}1702gitlab # [ 211.018665] gitaly[902]: time="2026-08-16T17:06:04.795Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK8T5HYM4HVT2D5BV92ZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:34.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:04.794" grpc.time_ms=0.896 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703gitlab # [ 211.090943] gitaly[902]: time="2026-08-16T17:06:04.867Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK8T5HYM4HVT2D5BV92ZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:14.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:04.858" grpc.time_ms=8.708 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 211.182567] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2171705gitlab # [ 211.183633] nixbot[2674]: {"ts": "2026-08-16T17:06:04.960Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""}1706gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1707gitlab # [ 211.550529] nixbot[2674]: INFO: ::ffff:127.0.0.1:56082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1708gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1709gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1710gitlab # [ 212.585752] nixbot[2674]: INFO: ::ffff:127.0.0.1:56084 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1711gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1712gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1713gitlab # [ 213.625420] nixbot[2674]: INFO: ::ffff:127.0.0.1:55900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1714gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1715gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1716gitlab # [ 214.665521] nixbot[2674]: INFO: ::ffff:127.0.0.1:55910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1717gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1718gitlab # [ 215.550656] nix-daemon[2877]: accepted connection from pid 2980, user nixbot1719gitlab # [ 215.628938] gitaly[902]: time="2026-08-16T17:06:09.405Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDAAT3D789661BT955BX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:39.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:09.404" grpc.time_ms=0.781 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1721gitlab # [ 215.670602] gitaly[902]: time="2026-08-16T17:06:09.447Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RKDAAT3D789661BT955BX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:19.088" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:09.438" grpc.time_ms=8.571 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1722gitlab # [ 215.697772] nixbot[2674]: INFO: ::ffff:127.0.0.1:55916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1723gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1724gitlab # [ 215.716255] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1371725gitlab # [ 215.716968] nixbot[2674]: {"ts": "2026-08-16T17:06:09.493Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""}1726gitlab # [ 215.786917] nix-daemon[2877]: accepted connection from pid 2997, user nixbot1727gitlab # [ 215.875061] gitaly[902]: time="2026-08-16T17:06:09.651Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RKDJ7C4K985WSEKP8ZCB7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.643" grpc.time_ms=8.314 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1728gitlab # [ 215.875726] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 451729gitlab # [ 215.931231] gitaly[902]: time="2026-08-16T17:06:09.708Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDKPA1TC1C33F9K0G953 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.701" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1730gitlab # [ 215.932089] gitaly[902]: time="2026-08-16T17:06:09.708Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDKPA1TC1C33F9K0G953 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.701" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1731gitlab # [ 215.932765] gitaly[902]: time="2026-08-16T17:06:09.708Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDKPA1TC1C33F9K0G953 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.701" grpc.time_ms=7.216 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1732gitlab # [ 215.962463] gitlab-workhorse[824]: time="2026-08-16T17:06:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671733gitlab # [ 215.963646] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 851734gitlab # [ 216.025740] gitaly[902]: time="2026-08-16T17:06:09.802Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDPFR5G0V1ZYZYH12CE2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.786" pid=902 remote_ip="2001:db8:1::1" request_sha=8c588c7e5c1cdfd3e8806a34b03a3afc2ebff7f3 response_bytes=337 span.kind=server system=grpc1735gitlab # [ 216.026781] gitaly[902]: time="2026-08-16T17:06:09.802Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDPFR5G0V1ZYZYH12CE2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.786" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1736gitlab # [ 216.050544] gitaly[902]: time="2026-08-16T17:06:09.827Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDPFR5G0V1ZYZYH12CE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.786" grpc.time_ms=41.368 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1737gitlab # [ 216.051359] gitlab-workhorse[824]: time="2026-08-16T17:06:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371738gitlab # [ 216.052038] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 841739gitlab # [ 216.159866] nix-daemon[2877]: accepted connection from pid 3027, user nixbot1740gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1741gitlab # [ 216.736147] nixbot[2674]: INFO: ::ffff:127.0.0.1:55932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1742gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1743gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1744gitlab # [ 217.775155] nixbot[2674]: INFO: ::ffff:127.0.0.1:55946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1745gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1746gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1747gitlab # [ 218.810899] nixbot[2674]: INFO: ::ffff:127.0.0.1:55948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1748gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1749gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1750gitlab # [ 219.848254] nixbot[2674]: INFO: ::ffff:127.0.0.1:55952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1751gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1752gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1753gitlab # [ 220.884433] nixbot[2674]: INFO: ::ffff:127.0.0.1:55960 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1754gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1755gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1756gitlab # [ 221.919785] nixbot[2674]: INFO: ::ffff:127.0.0.1:55968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1757gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1758gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1759gitlab # [ 222.956544] nixbot[2674]: INFO: ::ffff:127.0.0.1:55982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1760gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1761gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1762gitlab # [ 223.996388] nixbot[2674]: INFO: ::ffff:127.0.0.1:45010 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1763gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1764gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1765gitlab # [ 225.033220] nixbot[2674]: INFO: ::ffff:127.0.0.1:45026 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1766gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1767gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1768gitlab # [ 226.069141] nixbot[2674]: INFO: ::ffff:127.0.0.1:45040 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1769gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1770gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1771gitlab # [ 227.108657] nixbot[2674]: INFO: ::ffff:127.0.0.1:45050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1772gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1773gitlab # [ 227.264596] sidekiq-cluster[2616]: 2026-08-16T17:06:21.040Z pid=2616 tid=xao INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2616, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>448749568}1774gitlab # [ 227.436935] sidekiq-cluster[2616]: W, [2026-08-16T17:06:21.213552 #2616] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1775gitlab # [ 227.474979] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:21.251Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1776gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1777gitlab # [ 228.145763] nixbot[2674]: INFO: ::ffff:127.0.0.1:45054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1778gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1779gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1780gitlab # [ 229.180863] nixbot[2674]: INFO: ::ffff:127.0.0.1:45062 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1781gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1782gitlab # [ 229.319347] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:23.095Z","message":"GitLab reliable fetch activated!"}1783gitlab # [ 229.322879] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:23.095Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1784gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1785gitlab # [ 230.205843] nixbot[2674]: INFO: ::ffff:127.0.0.1:45070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1786gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.02 seconds)1787gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1788gitlab # [ 231.239163] nixbot[2674]: INFO: ::ffff:127.0.0.1:45082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1789gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1790gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1791gitlab # [ 232.275681] nixbot[2674]: INFO: ::ffff:127.0.0.1:45090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1792gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1793gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1794gitlab # [ 233.310943] nixbot[2674]: INFO: ::ffff:127.0.0.1:53586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1795gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1796gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1797gitlab # [ 234.335034] nixbot[2674]: INFO: ::ffff:127.0.0.1:53594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1798gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.02 seconds)1799gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1800gitlab # [ 235.369443] nixbot[2674]: INFO: ::ffff:127.0.0.1:53610 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1801gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1802gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1803gitlab # [ 236.406169] nixbot[2674]: INFO: ::ffff:127.0.0.1:53620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1804gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1805gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1806gitlab # [ 237.442656] nixbot[2674]: INFO: ::ffff:127.0.0.1:53632 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1807gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1808gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1809gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1810gitlab # [ 238.479351] nixbot[2674]: INFO: ::ffff:127.0.0.1:53638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1811gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1812gitlab # [ 239.503991] nixbot[2674]: INFO: ::ffff:127.0.0.1:53640 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1813gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.02 seconds)1814gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1815gitlab # [ 240.535753] nixbot[2674]: INFO: ::ffff:127.0.0.1:53644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1816gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1817gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1818gitlab # [ 241.569352] nixbot[2674]: INFO: ::ffff:127.0.0.1:53652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1819gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1820gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1821gitlab # [ 242.605405] nixbot[2674]: INFO: ::ffff:127.0.0.1:53660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1823gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1824gitlab # [ 243.641141] nixbot[2674]: INFO: ::ffff:127.0.0.1:50788 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1826gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1827gitlab # [ 244.677559] nixbot[2674]: INFO: ::ffff:127.0.0.1:50792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1829gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1830gitlab # [ 245.714924] nixbot[2674]: INFO: ::ffff:127.0.0.1:50800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1832gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1833gitlab # [ 246.751360] nixbot[2674]: INFO: ::ffff:127.0.0.1:50816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1834gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1835gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1836gitlab # [ 247.779661] nixbot[2674]: INFO: ::ffff:127.0.0.1:50832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1837gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1838gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1839gitlab # [ 248.823148] nixbot[2674]: INFO: ::ffff:127.0.0.1:50844 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1840gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds)1841gitlab # [ 249.814638] postgres[3149]: [3149] ERROR: relation "table_without_models" does not exist1842gitlab # [ 249.817351] postgres[3149]: [3149] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1843gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1844gitlab # [ 249.859646] nixbot[2674]: INFO: ::ffff:127.0.0.1:50852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1845gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1846gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1847gitlab # [ 250.895541] nixbot[2674]: INFO: ::ffff:127.0.0.1:50866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1848gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1849gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1850gitlab # [ 251.932126] nixbot[2674]: INFO: ::ffff:127.0.0.1:50880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1852gitlab # [ 252.238235] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.014Z","message":"Booted Rails 7.2.3.1 application in production environment"}1853gitlab # [ 252.241909] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.016Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1854gitlab # [ 252.246214] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.016Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1855gitlab # [ 252.250052] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.016Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1856gitlab # [ 252.254415] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.017Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1857gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1858gitlab # [ 252.967975] nixbot[2674]: INFO: ::ffff:127.0.0.1:50888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1859gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1860gitlab # [ 253.782451] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.558Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f186cf1d1ef16e9586b4221c","created_at":"2026-08-16T17:05:53.214Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.252Z","job_size_bytes":2,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f186cf1d1ef16e9586b4221c: start","job_status":"start","queue_duration_s":54.305333,"scheduling_latency_s":54.305402}1861gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1862gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.06 seconds)1863gitlab # [ 253.989974] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.766Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f186cf1d1ef16e9586b4221c","created_at":"2026-08-16T17:05:53.214Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.252Z","job_size_bytes":2,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f186cf1d1ef16e9586b4221c: done: 0.208167 sec","job_status":"done","queue_duration_s":54.305333,"scheduling_latency_s":54.305402,"redis_calls":23,"redis_duration_s":0.009236,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.00409,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003464,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001682,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.101462337,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.208167,"completed_at":"2026-08-16T17:06:47.766Z","load_balancing_strategy":"primary","db_duration_s":0.063617,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1864gitlab # [ 254.057926] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.770Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"7ba84f02cc931c7f8497acef","created_at":"2026-08-16T17:05:53.272Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.280Z","job_size_bytes":2,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-7ba84f02cc931c7f8497acef: start","job_status":"start","queue_duration_s":54.489523,"scheduling_latency_s":54.489577}1865gitlab # [ 254.058792] nixbot[2674]: INFO: ::ffff:127.0.0.1:43828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1866gitlab # [ 254.122683] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.898Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"7ba84f02cc931c7f8497acef","created_at":"2026-08-16T17:05:53.272Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.280Z","job_size_bytes":2,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-7ba84f02cc931c7f8497acef: done: 0.128576 sec","job_status":"done","queue_duration_s":54.489523,"scheduling_latency_s":54.489577,"redis_calls":14,"redis_duration_s":0.004178,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00114,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00176,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.090256443,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.128576,"completed_at":"2026-08-16T17:06:47.898Z","load_balancing_strategy":"primary","db_duration_s":0.023656,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1867gitlab # [ 254.125353] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.901Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8f78a4150abc143791c3114c","created_at":"2026-08-16T17:05:53.924Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.929Z","job_size_bytes":5,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8f78a4150abc143791c3114c: start","job_status":"start","queue_duration_s":53.971205,"scheduling_latency_s":53.971237}1868gitlab # [ 254.268134] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.044Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8f78a4150abc143791c3114c","created_at":"2026-08-16T17:05:53.924Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.929Z","job_size_bytes":5,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8f78a4150abc143791c3114c: done: 0.143562 sec","job_status":"done","queue_duration_s":53.971205,"scheduling_latency_s":53.971237,"redis_calls":12,"redis_duration_s":0.003255,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000843,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001895,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000325181,"duration_s":0.143562,"completed_at":"2026-08-16T17:06:48.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02581,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1869gitlab # [ 254.270557] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.046Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"04511173a01a01beb9aa8938","created_at":"2026-08-16T17:05:53.952Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.955Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-04511173a01a01beb9aa8938: start","job_status":"start","queue_duration_s":54.090268,"scheduling_latency_s":54.090284}1870gitlab # [ 254.440294] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.216Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"04511173a01a01beb9aa8938","created_at":"2026-08-16T17:05:53.952Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.955Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-04511173a01a01beb9aa8938: done: 0.170756 sec","job_status":"done","queue_duration_s":54.090268,"scheduling_latency_s":54.090284,"redis_calls":11,"redis_duration_s":0.00248,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000679,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.144,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.144,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029892,"duration_s":0.170756,"completed_at":"2026-08-16T17:06:48.216Z","load_balancing_strategy":"primary","db_duration_s":0.06161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1871gitlab # [ 254.443475] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.218Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"9ecb16d656ebad4d8ab42171","created_at":"2026-08-16T17:05:53.958Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.961Z","job_size_bytes":89,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-9ecb16d656ebad4d8ab42171: start","job_status":"start","queue_duration_s":54.256769,"scheduling_latency_s":54.256783}1872gitlab # [ 254.521339] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.245Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"9ecb16d656ebad4d8ab42171","created_at":"2026-08-16T17:05:53.958Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.961Z","job_size_bytes":89,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-9ecb16d656ebad4d8ab42171: done: 0.027289 sec","job_status":"done","queue_duration_s":54.256769,"scheduling_latency_s":54.256783,"redis_calls":11,"redis_duration_s":0.002463,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000717,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000288863,"duration_s":0.027289,"completed_at":"2026-08-16T17:06:48.245Z","load_balancing_strategy":"primary","db_duration_s":0.005382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1873gitlab # [ 254.529297] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.246Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"42d7c5e669a6dbfe555c9cd5","created_at":"2026-08-16T17:05:55.618Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-12ff30c695fa443f","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:55.641Z","job_size_bytes":185,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-42d7c5e669a6dbfe555c9cd5: start","job_status":"start","queue_duration_s":52.605693,"scheduling_latency_s":52.605708}1874gitlab # [ 254.573803] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.258Z","message":"changes: \"0000000000000000000000000000000000000000 0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 refs/heads/master\\n\""}1875gitlab # [ 254.575044] gitaly[902]: time="2026-08-16T17:06:48.301Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:58.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.293" grpc.time_ms=8.026 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 254.575691] gitaly[902]: time="2026-08-16T17:06:48.313Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:58.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.307" grpc.time_ms=5.728 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 254.584842] gitaly[902]: time="2026-08-16T17:06:48.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:06:58.063" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.354" grpc.time_ms=7.484 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 254.627580] gitaly[902]: time="2026-08-16T17:06:48.404Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:48.403" grpc.time_ms=0.527 pid=902 span.kind=server system=grpc1879gitlab # [ 254.654732] gitaly[902]: time="2026-08-16T17:06:48.431Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:48.431" grpc.time_ms=0.452 pid=902 span.kind=server system=grpc1880gitlab # [ 254.669744] gitaly[902]: time="2026-08-16T17:06:48.446Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C diskcache=5e508166-f710-472f-b403-a27ffbad5dbc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:58.080" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.370" pid=902 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1881gitlab # [ 254.670413] gitaly[902]: time="2026-08-16T17:06:48.446Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=54 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5094 command.oublock=8 command.real_time_ms=70 command.spawn_token_fork_ms=0 command.system_time_ms=27 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:58.080" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.370" grpc.time_ms=76.111 pid=902 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1882gitlab # [ 254.702677] gitaly[902]: time="2026-08-16T17:06:48.479Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:58.188" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.479" grpc.time_ms=0.228 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 254.719819] gitaly[902]: time="2026-08-16T17:06:48.496Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=940 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:06:58.192" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.483" grpc.time_ms=13.396 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884gitlab # [ 254.798534] gitaly[902]: time="2026-08-16T17:06:48.575Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T17:07:18.068" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:48.568" grpc.time_ms=6.47 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885gitlab # [ 254.832206] gitaly[902]: time="2026-08-16T17:06:48.609Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:58.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.608" grpc.time_ms=0.171 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886gitlab # [ 254.848450] gitaly[902]: time="2026-08-16T17:06:48.625Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:06:58.018" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:06:48.618" grpc.time_ms=6.623 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887gitlab # [ 254.873251] gitaly[902]: time="2026-08-16T17:06:48.650Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:58.042" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.642" grpc.time_ms=7.344 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888gitlab # [ 254.890142] gitaly[902]: time="2026-08-16T17:06:48.666Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:58.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.655" grpc.time_ms=11.076 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889gitlab # [ 254.918669] gitaly[902]: time="2026-08-16T17:06:48.695Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:07:18.180" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:48.680" grpc.time_ms=15.023 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1892gitlab # [ 255.076970] nixbot[2674]: INFO: ::ffff:127.0.0.1:43842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1893gitlab # [ 255.269551] gitaly[902]: time="2026-08-16T17:06:49.046Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:06:59.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:49.045" grpc.time_ms=1.038 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894gitlab # [ 255.309610] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.085Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"42d7c5e669a6dbfe555c9cd5","created_at":"2026-08-16T17:05:55.618Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-12ff30c695fa443f","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:55.641Z","job_size_bytes":185,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-42d7c5e669a6dbfe555c9cd5: done: 0.838606 sec","job_status":"done","queue_duration_s":52.605693,"scheduling_latency_s":52.605708,"gitaly_calls":13,"gitaly_duration_s":0.255847,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.04584,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.003804,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006397,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001504,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002841,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.016238,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015056,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.18,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.202,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.473933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000533308,"exclusive_lock_hold_duration_s":0.038041986,"duration_s":0.838606,"completed_at":"2026-08-16T17:06:49.085Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.089089,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1895gitlab # [ 255.351928] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.128Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"905512038a8af718ba18909c","created_at":"2026-08-16T17:05:59.853Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.858Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-905512038a8af718ba18909c: start","job_status":"start","queue_duration_s":49.269927,"scheduling_latency_s":49.269952}1896gitlab # [ 255.470336] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.246Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"905512038a8af718ba18909c","created_at":"2026-08-16T17:05:59.853Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.858Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-905512038a8af718ba18909c: done: 0.118152 sec","job_status":"done","queue_duration_s":49.269927,"scheduling_latency_s":49.269952,"redis_calls":16,"redis_duration_s":0.004665,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002512,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001574,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000461512,"duration_s":0.118152,"completed_at":"2026-08-16T17:06:49.246Z","load_balancing_strategy":"primary","db_duration_s":0.023229,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1897gitlab # [ 255.472057] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.248Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b9a653ab125a8f37890020cf","created_at":"2026-08-16T17:05:59.858Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.874Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b9a653ab125a8f37890020cf: start","job_status":"start","queue_duration_s":49.373781,"scheduling_latency_s":49.373796}1898gitlab # [ 255.620932] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.396Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b9a653ab125a8f37890020cf","created_at":"2026-08-16T17:05:59.858Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.874Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b9a653ab125a8f37890020cf: done: 0.148435 sec","job_status":"done","queue_duration_s":49.373781,"scheduling_latency_s":49.373796,"redis_calls":21,"redis_duration_s":0.004962,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002028,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277409,"duration_s":0.148435,"completed_at":"2026-08-16T17:06:49.396Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1899gitlab # [ 255.622969] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.398Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8abf965ef23ecf012ced8059","created_at":"2026-08-16T17:05:59.965Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.970Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8abf965ef23ecf012ced8059: start","job_status":"start","queue_duration_s":49.427833,"scheduling_latency_s":49.427848}1900gitlab # [ 255.783716] gitaly[902]: time="2026-08-16T17:06:49.559Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:49.559" grpc.time_ms=0.285 pid=902 span.kind=server system=grpc1901gitlab # [ 255.809331] gitaly[902]: time="2026-08-16T17:06:49.586Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:49.585" grpc.time_ms=0.274 pid=902 span.kind=server system=grpc1902gitlab # [ 255.846514] gitaly[902]: time="2026-08-16T17:06:49.623Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:49.623" grpc.time_ms=0.246 pid=902 span.kind=server system=grpc1903gitlab # [ 255.862279] gitaly[902]: time="2026-08-16T17:06:49.639Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ diskcache=875c8aec-dfb8-4495-95d8-9d480f32ffab grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:19.032" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:49.533" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1904gitlab # [ 255.863216] gitaly[902]: time="2026-08-16T17:06:49.639Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=119 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7437 command.oublock=0 command.real_time_ms=99 command.spawn_token_fork_ms=0 command.system_time_ms=76 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:19.032" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:49.533" grpc.time_ms=105.853 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab # [ 255.971951] gitaly[902]: time="2026-08-16T17:06:49.748Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:19.247" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:49.747" grpc.time_ms=1.101 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 256.000838] gitaly[902]: time="2026-08-16T17:06:49.777Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:19.276" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:49.776" grpc.time_ms=0.978 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907gitlab # [ 256.026614] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.803Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8abf965ef23ecf012ced8059","created_at":"2026-08-16T17:05:59.965Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.970Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2616,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8abf965ef23ecf012ced8059: rescheduled"}1908gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1909gitlab # [ 256.051070] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.827Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8abf965ef23ecf012ced8059","created_at":"2026-08-16T17:05:59.965Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.970Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8abf965ef23ecf012ced8059: done: 0.428462 sec","job_status":"done","queue_duration_s":49.427833,"scheduling_latency_s":49.427848,"gitaly_calls":3,"gitaly_duration_s":0.124138,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.036878,"redis_read_bytes":460,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001379,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001086,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009322,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003987,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15579,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.015932,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000693,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000659,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002441,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.024,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.027,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203865,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.361026331,"duration_s":0.428462,"completed_at":"2026-08-16T17:06:49.827Z","load_balancing_strategy":"primary","db_duration_s":0.069258,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1910gitlab # [ 256.096894] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.873Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 e652aafceb871cb9d38ca62ebe5294ea158d1c90 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"506f6ed4588a3362df0234e4","created_at":"2026-08-16T17:06:00.009Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-aa35811c30524c94","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:00.010Z","job_size_bytes":185,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-506f6ed4588a3362df0234e4: start","job_status":"start","queue_duration_s":49.862386,"scheduling_latency_s":49.862429}1911gitlab # [ 256.114207] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.890Z","message":"changes: \"0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 e652aafceb871cb9d38ca62ebe5294ea158d1c90 refs/heads/master\\n\""}1912gitlab # [ 256.116844] nixbot[2674]: INFO: ::ffff:127.0.0.1:43846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)1914gitlab # [ 256.152126] gitaly[902]: time="2026-08-16T17:06:49.929Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:59.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:49.918" grpc.time_ms=10.596 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915gitlab # [ 256.171696] gitaly[902]: time="2026-08-16T17:06:49.948Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:59.030" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:49.940" grpc.time_ms=7.973 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916gitlab # [ 256.183144] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.953Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"cbd439db6ebf73c73481797d","created_at":"2026-08-16T17:06:49.951Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"a876f54a1f8cc6ee8261a35d","job_size_bytes":46,"pid":2616,"job_status":"deduplicated","message":"ProjectCacheWorker JID-cbd439db6ebf73c73481797d: deduplicated: until executing","deduplication.type":"until executing"}1917gitlab # [ 256.202363] gitaly[902]: time="2026-08-16T17:06:49.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:06:59.058" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:49.968" grpc.time_ms=10.367 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918gitlab # [ 256.215905] gitaly[902]: time="2026-08-16T17:06:49.992Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T17:07:19.482" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:49.983" grpc.time_ms=9.316 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 256.235917] gitaly[902]: time="2026-08-16T17:06:50.012Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:07:00.005" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:06:50.005" grpc.time_ms=6.75 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920gitlab # [ 256.253745] gitaly[902]: time="2026-08-16T17:06:50.030Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:00.020" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:50.021" grpc.time_ms=9.476 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921gitlab # [ 256.358949] gitaly[902]: time="2026-08-16T17:06:50.135Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:07:00.133" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.134" grpc.time_ms=1.327 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1922gitlab # [ 256.389115] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.164Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 e652aafceb871cb9d38ca62ebe5294ea158d1c90 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"506f6ed4588a3362df0234e4","created_at":"2026-08-16T17:06:00.009Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-aa35811c30524c94","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:00.010Z","job_size_bytes":185,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-506f6ed4588a3362df0234e4: done: 0.291491 sec","job_status":"done","queue_duration_s":49.862386,"scheduling_latency_s":49.862429,"gitaly_calls":7,"gitaly_duration_s":0.094754,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.023411,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.002428,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001091,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003517,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.008128,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.008247,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.155151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000867708,"exclusive_lock_hold_duration_s":0.022958784,"duration_s":0.291491,"completed_at":"2026-08-16T17:06:50.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031401,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1923gitlab # [ 256.398487] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.166Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a876f54a1f8cc6ee8261a35d","created_at":"2026-08-16T17:06:48.315Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.331Z","job_size_bytes":46,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a876f54a1f8cc6ee8261a35d: start","job_status":"start","queue_duration_s":1.835207,"scheduling_latency_s":1.835238}1924gitlab # [ 256.462367] gitaly[902]: time="2026-08-16T17:06:50.239Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T23:06:50.233" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:50.233" grpc.time_ms=5.047 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925gitlab # [ 256.486513] gitaly[902]: time="2026-08-16T17:06:50.263Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:07:20.050" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.251" grpc.time_ms=11.441 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926gitlab # [ 256.518354] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.294Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a876f54a1f8cc6ee8261a35d","created_at":"2026-08-16T17:06:48.315Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.331Z","job_size_bytes":46,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a876f54a1f8cc6ee8261a35d: done: 0.128138 sec","job_status":"done","queue_duration_s":1.835207,"scheduling_latency_s":1.835238,"gitaly_calls":2,"gitaly_duration_s":0.051942,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007656,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001501,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000672,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001906,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002815,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000425193,"duration_s":0.128138,"completed_at":"2026-08-16T17:06:50.294Z","load_balancing_strategy":"primary","db_duration_s":0.012509,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1927gitlab # [ 256.538187] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.296Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ba6c27110cd7d9ec53e7cc86","created_at":"2026-08-16T17:06:48.346Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.350Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ba6c27110cd7d9ec53e7cc86: start","job_status":"start","queue_duration_s":1.946193,"scheduling_latency_s":1.946209}1928gitlab # [ 256.565702] gitaly[902]: time="2026-08-16T17:06:50.342Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C diskcache=73c1245e-9f91-4814-899a-ea15246eceac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:06:50.315" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.316" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1929gitlab # [ 256.566857] gitaly[902]: time="2026-08-16T17:06:50.342Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1289 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:06:50.315" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.316" grpc.time_ms=26.491 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930gitlab # [ 256.623478] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.400Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ba6c27110cd7d9ec53e7cc86","created_at":"2026-08-16T17:06:48.346Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.350Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ba6c27110cd7d9ec53e7cc86: done: 0.103718 sec","job_status":"done","queue_duration_s":1.946193,"scheduling_latency_s":1.946209,"gitaly_calls":1,"gitaly_duration_s":0.0555,"redis_calls":15,"redis_duration_s":0.003725,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000619,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001216,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08489375,"duration_s":0.103718,"completed_at":"2026-08-16T17:06:50.400Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1931gitlab # [ 256.625966] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.401Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"853633179b9ab57d3f66ae84","created_at":"2026-08-16T17:06:48.474Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.476Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-853633179b9ab57d3f66ae84: start","job_status":"start","queue_duration_s":1.92509,"scheduling_latency_s":1.925105}1932gitlab # [ 256.655601] gitaly[902]: time="2026-08-16T17:06:50.432Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:07:20.220" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.421" grpc.time_ms=10.865 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 256.668104] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.444Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"853633179b9ab57d3f66ae84","created_at":"2026-08-16T17:06:48.474Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.476Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-853633179b9ab57d3f66ae84: done: 0.042353 sec","job_status":"done","queue_duration_s":1.92509,"scheduling_latency_s":1.925105,"gitaly_calls":1,"gitaly_duration_s":0.012889,"redis_calls":16,"redis_duration_s":0.004377,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000392,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001937,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000793,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042353,"completed_at":"2026-08-16T17:06:50.443Z","load_balancing_strategy":"primary","db_duration_s":0.002663,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1934gitlab # [ 256.711527] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.446Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"12574554f6e7b648e4be2e32","created_at":"2026-08-16T17:06:48.925Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:780f8c7d20af01a4cf5765d0b60205d590694527dd808288c6f36e14c77f1773","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.929Z","job_size_bytes":467,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-12574554f6e7b648e4be2e32: start","job_status":"start","queue_duration_s":1.516996,"scheduling_latency_s":1.51703}1935gitlab # [ 256.712569] gitaly[902]: time="2026-08-16T17:06:50.479Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:20.277" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.478" grpc.time_ms=0.673 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936gitlab # [ 256.713395] gitaly[902]: time="2026-08-16T17:06:50.489Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:07:00.000" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:50.480" grpc.time_ms=8.701 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 256.790442] gitaly[902]: time="2026-08-16T17:06:50.566Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:20.364" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.565" grpc.time_ms=1.009 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938gitlab # [ 256.804268] gitaly[902]: time="2026-08-16T17:06:50.581Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=61 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:07:20.378" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.578" grpc.time_ms=2.438 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939gitlab # [ 256.888439] gitaly[902]: time="2026-08-16T17:06:50.665Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:00.174" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:50.655" grpc.time_ms=10.021 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1941gitlab # [ 257.163226] nixbot[2674]: INFO: ::ffff:127.0.0.1:43856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1942gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds)1943gitlab # [ 257.258069] gitaly[902]: time="2026-08-16T17:06:51.034Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:07:21.018" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.019" grpc.time_ms=15.223 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944gitlab # [ 257.303858] gitaly[902]: time="2026-08-16T17:06:51.080Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:07:21.069" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.069" grpc.time_ms=11.13 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1945gitlab # [ 257.327104] sidekiq-cluster[2616]: {"severity":"WARN","time":"2026-08-16T17:06:51.103Z","class":"CreatePipelineWorker","correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926","ref":"refs/heads/master"},"retry":0}1946gitlab # [ 257.332571] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.109Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"12574554f6e7b648e4be2e32","created_at":"2026-08-16T17:06:48.925Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:780f8c7d20af01a4cf5765d0b60205d590694527dd808288c6f36e14c77f1773","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.929Z","job_size_bytes":467,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-12574554f6e7b648e4be2e32: done: 0.662866 sec","job_status":"done","queue_duration_s":1.516996,"scheduling_latency_s":1.51703,"gitaly_calls":7,"gitaly_duration_s":0.105837,"redis_calls":51,"redis_duration_s":0.009033,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000724,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003411,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00252,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001135,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.505572,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002816,"duration_s":0.662866,"completed_at":"2026-08-16T17:06:51.109Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040807,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1947gitlab # [ 257.340200] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.110Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"9b6bc551-6b56-46ef-82f5-3a1c6dbd7030\"}"],"class":"WebHookWorker","jid":"dc614e3d8dea584cecbf3ece","created_at":"2026-08-16T17:06:49.020Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1d41de798733e3a622cfdf3a9c871978ceaf2ca539bc5ea04100ce11f3ce03d1","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.025Z","job_size_bytes":1751,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dc614e3d8dea584cecbf3ece: start","job_status":"start","queue_duration_s":2.084881,"scheduling_latency_s":2.084895}1948gitlab # [ 257.460625] nixbot[2674]: INFO: ::ffff:127.0.0.1:43868 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1949gitlab # [ 257.485068] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.260Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"9b6bc551-6b56-46ef-82f5-3a1c6dbd7030\"}"],"class":"WebHookWorker","jid":"dc614e3d8dea584cecbf3ece","created_at":"2026-08-16T17:06:49.020Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1d41de798733e3a622cfdf3a9c871978ceaf2ca539bc5ea04100ce11f3ce03d1","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.025Z","job_size_bytes":1751,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dc614e3d8dea584cecbf3ece: done: 0.149843 sec","job_status":"done","queue_duration_s":2.084881,"scheduling_latency_s":2.084895,"redis_calls":19,"redis_duration_s":0.004335,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001316,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00037,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00176,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04586588499995514,"cpu_s":0.087778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000584432,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.149843,"completed_at":"2026-08-16T17:06:51.260Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1950gitlab # [ 257.545750] gitaly[902]: time="2026-08-16T17:06:51.309Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMP7WCC0ER8JHRJ20AXDX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:51.299" grpc.time_ms=9.948 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1951gitlab # [ 257.547134] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 491952gitlab # [ 257.562497] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.338Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"439eafb0c68010c5de389d87","created_at":"2026-08-16T17:06:49.521Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.525Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-439eafb0c68010c5de389d87: start","job_status":"start","queue_duration_s":1.813214,"scheduling_latency_s":1.813262}1953gitlab # [ 257.678619] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"439eafb0c68010c5de389d87","created_at":"2026-08-16T17:06:49.521Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.525Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-439eafb0c68010c5de389d87: done: 0.116021 sec","job_status":"done","queue_duration_s":1.813214,"scheduling_latency_s":1.813262,"redis_calls":10,"redis_duration_s":0.002888,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000569347,"duration_s":0.116021,"completed_at":"2026-08-16T17:06:51.454Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017316,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1954gitlab # [ 257.724926] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.457Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2d5acb6208d3ace0abf2d6b2","created_at":"2026-08-16T17:06:49.647Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.654Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2d5acb6208d3ace0abf2d6b2: start","job_status":"start","queue_duration_s":1.802429,"scheduling_latency_s":1.802466}1955gitlab # [ 257.726430] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.496Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2d5acb6208d3ace0abf2d6b2","created_at":"2026-08-16T17:06:49.647Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.654Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2d5acb6208d3ace0abf2d6b2: done: 0.038988 sec","job_status":"done","queue_duration_s":1.802429,"scheduling_latency_s":1.802466,"redis_calls":10,"redis_duration_s":0.002174,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000600355,"duration_s":0.038988,"completed_at":"2026-08-16T17:06:51.496Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1956gitlab # [ 257.767979] gitaly[902]: time="2026-08-16T17:06:51.501Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMP9GCFAA45X6AKFB1JDW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:51.492" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1957gitlab # [ 257.768525] gitlab-workhorse[824]: time="2026-08-16T17:06:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671958gitlab # [ 257.770085] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1651959gitlab # [ 257.771571] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.497Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d3baee44be9afa4920fa9104","created_at":"2026-08-16T17:06:49.671Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.677Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d3baee44be9afa4920fa9104: start","job_status":"start","queue_duration_s":1.819849,"scheduling_latency_s":1.819865}1960gitlab # [ 257.784847] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.523Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d3baee44be9afa4920fa9104","created_at":"2026-08-16T17:06:49.671Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.677Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d3baee44be9afa4920fa9104: done: 0.025872 sec","job_status":"done","queue_duration_s":1.819849,"scheduling_latency_s":1.819865,"redis_calls":10,"redis_duration_s":0.002533,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000316,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000335,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212317,"duration_s":0.025872,"completed_at":"2026-08-16T17:06:51.523Z","load_balancing_strategy":"primary","db_duration_s":0.003339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1961gitlab # [ 257.825529] gitaly[902]: time="2026-08-16T17:06:51.501Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMP9GCFAA45X6AKFB1JDW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:51.492" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1962gitlab # [ 257.830596] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.524Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e48f6d9f7d8adb8eda4a4862","created_at":"2026-08-16T17:06:49.694Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.699Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e48f6d9f7d8adb8eda4a4862: start","job_status":"start","queue_duration_s":1.82487,"scheduling_latency_s":1.824883}1963gitlab # [ 257.868991] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.582Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e48f6d9f7d8adb8eda4a4862","created_at":"2026-08-16T17:06:49.694Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.699Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e48f6d9f7d8adb8eda4a4862: done: 0.057848 sec","job_status":"done","queue_duration_s":1.82487,"scheduling_latency_s":1.824883,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000361,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019835,"duration_s":0.057848,"completed_at":"2026-08-16T17:06:51.582Z","load_balancing_strategy":"primary","db_duration_s":0.00298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1964gitlab # [ 257.906385] gitaly[902]: time="2026-08-16T17:06:51.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMP9GCFAA45X6AKFB1JDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:51.492" grpc.time_ms=8.816 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc1965gitlab # [ 257.907151] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.583Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e98661c227488f7f5851a026","created_at":"2026-08-16T17:06:49.700Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.704Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e98661c227488f7f5851a026: start","job_status":"start","queue_duration_s":1.878691,"scheduling_latency_s":1.878764}1966gitlab # [ 257.907681] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.610Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e98661c227488f7f5851a026","created_at":"2026-08-16T17:06:49.700Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.704Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e98661c227488f7f5851a026: done: 0.027259 sec","job_status":"done","queue_duration_s":1.878691,"scheduling_latency_s":1.878764,"redis_calls":10,"redis_duration_s":0.00623,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234108,"duration_s":0.027259,"completed_at":"2026-08-16T17:06:51.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1967gitlab # [ 257.961550] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.612Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2d38e6451db85fc10c83b957","created_at":"2026-08-16T17:06:49.705Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.708Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2d38e6451db85fc10c83b957: start","job_status":"start","queue_duration_s":1.903444,"scheduling_latency_s":1.903457}1968gitlab # [ 257.962121] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2d38e6451db85fc10c83b957","created_at":"2026-08-16T17:06:49.705Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.708Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2d38e6451db85fc10c83b957: done: 0.018469 sec","job_status":"done","queue_duration_s":1.903444,"scheduling_latency_s":1.903457,"redis_calls":11,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254222,"duration_s":0.018469,"completed_at":"2026-08-16T17:06:51.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1969gitlab # [ 258.005956] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.631Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b1993cf002c4b514f5e86336","created_at":"2026-08-16T17:06:49.710Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.713Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b1993cf002c4b514f5e86336: start","job_status":"start","queue_duration_s":1.917785,"scheduling_latency_s":1.917798}1970gitlab # [ 258.006543] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.672Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b1993cf002c4b514f5e86336","created_at":"2026-08-16T17:06:49.710Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.713Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b1993cf002c4b514f5e86336: done: 0.040832 sec","job_status":"done","queue_duration_s":1.917785,"scheduling_latency_s":1.917798,"redis_calls":10,"redis_duration_s":0.001559,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000250311,"duration_s":0.040832,"completed_at":"2026-08-16T17:06:51.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1971gitlab # [ 258.057271] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.673Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"139ff9ddbe72332d5f158166","created_at":"2026-08-16T17:06:49.714Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.717Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-139ff9ddbe72332d5f158166: start","job_status":"start","queue_duration_s":1.95638,"scheduling_latency_s":1.956394}1972gitlab # [ 258.057935] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"139ff9ddbe72332d5f158166","created_at":"2026-08-16T17:06:49.714Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.717Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-139ff9ddbe72332d5f158166: done: 0.029723 sec","job_status":"done","queue_duration_s":1.95638,"scheduling_latency_s":1.956394,"redis_calls":10,"redis_duration_s":0.001528,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000228521,"duration_s":0.029723,"completed_at":"2026-08-16T17:06:51.703Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1973gitlab # [ 258.095635] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.704Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"69b6c64de8dc04f624759af3","created_at":"2026-08-16T17:06:49.721Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.724Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-69b6c64de8dc04f624759af3: start","job_status":"start","queue_duration_s":1.979543,"scheduling_latency_s":1.979557}1974gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'1975gitlab # [ 258.099661] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.727Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"69b6c64de8dc04f624759af3","created_at":"2026-08-16T17:06:49.721Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.724Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-69b6c64de8dc04f624759af3: done: 0.022938 sec","job_status":"done","queue_duration_s":1.979543,"scheduling_latency_s":1.979557,"redis_calls":10,"redis_duration_s":0.001289,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214274,"duration_s":0.022938,"completed_at":"2026-08-16T17:06:51.726Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1976gitlab # [ 258.155513] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.728Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b27bc6ec43944f527cc1fd7e","created_at":"2026-08-16T17:06:49.724Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.727Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b27bc6ec43944f527cc1fd7e: start","job_status":"start","queue_duration_s":2.000404,"scheduling_latency_s":2.000417}1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds)1978gitlab # [ 258.156206] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.741Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b27bc6ec43944f527cc1fd7e","created_at":"2026-08-16T17:06:49.724Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.727Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b27bc6ec43944f527cc1fd7e: done: 0.013915 sec","job_status":"done","queue_duration_s":2.000404,"scheduling_latency_s":2.000417,"redis_calls":10,"redis_duration_s":0.001299,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277968,"duration_s":0.013915,"completed_at":"2026-08-16T17:06:51.741Z","load_balancing_strategy":"primary","db_duration_s":0.001269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1979gitlab # [ 258.195562] gitaly[902]: time="2026-08-16T17:06:51.930Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W diskcache=9e8139fe-7945-4795-95c5-0218054c29b3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:06:51.921" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.922" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 258.196224] gitaly[902]: time="2026-08-16T17:06:51.931Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:06:51.921" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.922" grpc.time_ms=8.936 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981gitlab # [ 258.233595] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.742Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3587fc1a4e815110ef8d575a","created_at":"2026-08-16T17:06:49.728Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.730Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3587fc1a4e815110ef8d575a: start","job_status":"start","queue_duration_s":2.012245,"scheduling_latency_s":2.012258}1982gitlab # [ 258.234233] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.841Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3587fc1a4e815110ef8d575a","created_at":"2026-08-16T17:06:49.728Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.730Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3587fc1a4e815110ef8d575a: done: 0.098512 sec","job_status":"done","queue_duration_s":2.012245,"scheduling_latency_s":2.012258,"redis_calls":10,"redis_duration_s":0.00125,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019388,"duration_s":0.098512,"completed_at":"2026-08-16T17:06:51.841Z","load_balancing_strategy":"primary","db_duration_s":0.004164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1983gitlab # [ 258.276655] gitaly[902]: time="2026-08-16T17:06:51.955Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:21.754" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.954" grpc.time_ms=0.467 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 258.277524] nixbot[2674]: INFO: ::ffff:127.0.0.1:43872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK1985gitlab # [ 258.277923] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.842Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"48cc040b2aeb8d57278b4d14","created_at":"2026-08-16T17:06:49.735Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.738Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-48cc040b2aeb8d57278b4d14: start","job_status":"start","queue_duration_s":2.104272,"scheduling_latency_s":2.104292}1986gitlab # [ 258.278466] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.892Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"48cc040b2aeb8d57278b4d14","created_at":"2026-08-16T17:06:49.735Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.738Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-48cc040b2aeb8d57278b4d14: done: 0.049512 sec","job_status":"done","queue_duration_s":2.104272,"scheduling_latency_s":2.104292,"redis_calls":14,"redis_duration_s":0.0026,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000598679,"duration_s":0.049512,"completed_at":"2026-08-16T17:06:51.892Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987gitlab # [ 258.308678] gitaly[902]: time="2026-08-16T17:06:51.961Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:07:01.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:51.956" grpc.time_ms=4.448 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 258.349811] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.893Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"755dafffcb1ba4a205e3a183","created_at":"2026-08-16T17:06:49.803Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.816Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-755dafffcb1ba4a205e3a183: start","job_status":"start","queue_duration_s":2.076353,"scheduling_latency_s":2.076367}1989gitlab # [ 258.350621] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.909Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"755dafffcb1ba4a205e3a183","created_at":"2026-08-16T17:06:49.803Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.816Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-755dafffcb1ba4a205e3a183: done: 0.01639 sec","job_status":"done","queue_duration_s":2.076353,"scheduling_latency_s":2.076367,"redis_calls":8,"redis_duration_s":0.00102,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01639,"completed_at":"2026-08-16T17:06:51.909Z","load_balancing_strategy":"primary","db_duration_s":0.002334,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1990gitlab # [ 258.387607] gitaly[902]: time="2026-08-16T17:06:51.989Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:21.788" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.989" grpc.time_ms=0.489 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 258.388394] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.910Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"10722e5585e28fb80e342a59","created_at":"2026-08-16T17:06:49.960Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ba6c27110cd7d9ec53e7cc86","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.963Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-10722e5585e28fb80e342a59: start","job_status":"start","queue_duration_s":1.947537,"scheduling_latency_s":1.947551}1992gitlab # [ 258.389093] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.940Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"10722e5585e28fb80e342a59","created_at":"2026-08-16T17:06:49.960Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ba6c27110cd7d9ec53e7cc86","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.963Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-10722e5585e28fb80e342a59: done: 0.02938 sec","job_status":"done","queue_duration_s":1.947537,"scheduling_latency_s":1.947551,"gitaly_calls":1,"gitaly_duration_s":0.010744,"redis_calls":12,"redis_duration_s":0.0017499999999999998,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000334,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.018911343,"duration_s":0.02938,"completed_at":"2026-08-16T17:06:51.940Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002568,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1993gitlab # [ 258.425764] gitaly[902]: time="2026-08-16T17:06:51.993Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=55 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:07:21.791" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.992" grpc.time_ms=1.581 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994gitlab # [ 258.466051] nixbot[2674]: {"ts": "2026-08-16T17:06:52.181Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1995gitlab # [ 258.466601] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.941Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"46129efd1432c2f3dde178dd","created_at":"2026-08-16T17:06:50.094Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9c3f4d9a3b7f63d9d8fb58ac3a0fcda61f3f563c103fb4f221b19a9a2591aac8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.096Z","job_size_bytes":467,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-46129efd1432c2f3dde178dd: start","job_status":"start","queue_duration_s":1.844832,"scheduling_latency_s":1.844845}1996gitlab # [ 258.467184] gitaly[902]: time="2026-08-16T17:06:52.013Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:02.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.008" grpc.time_ms=4.541 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 258.467751] gitaly[902]: time="2026-08-16T17:06:52.236Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:22.035" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.236" grpc.time_ms=0.722 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 258.555366] gitaly[902]: time="2026-08-16T17:06:52.332Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:07:22.123" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.323" grpc.time_ms=8.208 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 258.575899] gitaly[902]: time="2026-08-16T17:06:52.352Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:07:22.144" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.344" grpc.time_ms=7.628 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 258.581714] gitaly[902]: time="2026-08-16T17:06:52.358Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:02.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.351" grpc.time_ms=6.738 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 258.587708] sidekiq-cluster[2616]: {"severity":"WARN","time":"2026-08-16T17:06:52.364Z","class":"CreatePipelineWorker","correlation_id":"01M05RK3N0FWAPYMA73MHP365W","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926","after":"e652aafceb871cb9d38ca62ebe5294ea158d1c90","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e652aafceb871cb9d38ca62ebe5294ea158d1c90","ref":"refs/heads/master"},"retry":0}2002gitlab # [ 258.591533] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.368Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"46129efd1432c2f3dde178dd","created_at":"2026-08-16T17:06:50.094Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9c3f4d9a3b7f63d9d8fb58ac3a0fcda61f3f563c103fb4f221b19a9a2591aac8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.096Z","job_size_bytes":467,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-46129efd1432c2f3dde178dd: done: 0.42656 sec","job_status":"done","queue_duration_s":1.844832,"scheduling_latency_s":1.844845,"gitaly_calls":7,"gitaly_duration_s":0.048529,"redis_calls":33,"redis_duration_s":0.003387,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000366,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001643,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.354345,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.42656,"completed_at":"2026-08-16T17:06:52.368Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01376,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2003gitlab # [ 258.605608] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.369Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"e089d911-cb01-4cd6-abe9-16d03822b108\"}"],"class":"WebHookWorker","jid":"1dc0751776295abdfffb401a","created_at":"2026-08-16T17:06:50.115Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9eb0890d8c8aaa63e67c20915ed65302c4d37e4b253a5eb81957a129a8b3dd04","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.117Z","job_size_bytes":1749,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1dc0751776295abdfffb401a: start","job_status":"start","queue_duration_s":2.251626,"scheduling_latency_s":2.251644}2004gitlab # [ 258.643043] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.399Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"e089d911-cb01-4cd6-abe9-16d03822b108\"}"],"class":"WebHookWorker","jid":"1dc0751776295abdfffb401a","created_at":"2026-08-16T17:06:50.115Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9eb0890d8c8aaa63e67c20915ed65302c4d37e4b253a5eb81957a129a8b3dd04","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.117Z","job_size_bytes":1749,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1dc0751776295abdfffb401a: done: 0.029964 sec","job_status":"done","queue_duration_s":2.251626,"scheduling_latency_s":2.251644,"redis_calls":14,"redis_duration_s":0.003023,"redis_read_bytes":25,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000287,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001653,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.004857321999963915,"cpu_s":0.017243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.029964,"completed_at":"2026-08-16T17:06:52.399Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2005gitlab # [ 258.685541] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.400Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"210a1f48ac10e4c77083a7b0","created_at":"2026-08-16T17:06:50.277Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-e7ffa8db8f354744","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.283Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-210a1f48ac10e4c77083a7b0: start","job_status":"start","queue_duration_s":2.117248,"scheduling_latency_s":2.117268}2006gitlab # [ 258.686216] nixbot[2674]: INFO: ::ffff:127.0.0.1:43876 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2007gitlab # [ 258.686621] nixbot[2674]: {"ts": "2026-08-16T17:06:52.424Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""}2008gitlab # [ 258.690551] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2342009gitlab # [ 258.693126] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.446Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"210a1f48ac10e4c77083a7b0","created_at":"2026-08-16T17:06:50.277Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-e7ffa8db8f354744","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.283Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-210a1f48ac10e4c77083a7b0: done: 0.046165 sec","job_status":"done","queue_duration_s":2.117248,"scheduling_latency_s":2.117268,"redis_calls":19,"redis_duration_s":0.0070550000000000005,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001809,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00038,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004375,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005590375,"duration_s":0.046165,"completed_at":"2026-08-16T17:06:52.446Z","load_balancing_strategy":"primary","db_duration_s":0.011825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2010gitlab # [ 258.746962] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.448Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dc614e3d8dea584cecbf3ece"],"class":"WebHooks::LogExecutionWorker","jid":"91e429a8fbda58f748bbe86a","created_at":"2026-08-16T17:06:51.240Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-fee729381711424a","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27cae85cd8d60e8ad4968007f2bb60cd457c6b8bde309197d255d5d89c7030a7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:51.249Z","job_size_bytes":2593,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-91e429a8fbda58f748bbe86a: start","job_status":"start","queue_duration_s":1.199684,"scheduling_latency_s":1.199698}2011gitlab # [ 258.747686] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.501Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dc614e3d8dea584cecbf3ece"],"class":"WebHooks::LogExecutionWorker","jid":"91e429a8fbda58f748bbe86a","created_at":"2026-08-16T17:06:51.240Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-fee729381711424a","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27cae85cd8d60e8ad4968007f2bb60cd457c6b8bde309197d255d5d89c7030a7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:51.249Z","job_size_bytes":2593,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-91e429a8fbda58f748bbe86a: done: 0.05219 sec","job_status":"done","queue_duration_s":1.199684,"scheduling_latency_s":1.199698,"redis_calls":10,"redis_duration_s":0.007521,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003782,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001494,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002245,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000477156,"duration_s":0.05219,"completed_at":"2026-08-16T17:06:52.501Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2012gitlab # [ 258.764379] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.502Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1dc0751776295abdfffb401a"],"class":"WebHooks::LogExecutionWorker","jid":"7383ff9b2e12bc6e54e41ee8","created_at":"2026-08-16T17:06:52.391Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-9d6214d7e36e4d43","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e972e96c7f06d3355a08fec34870d258437bb0a34d212057d354ec993bad979e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.394Z","job_size_bytes":2592,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7383ff9b2e12bc6e54e41ee8: start","job_status":"start","queue_duration_s":0.108503,"scheduling_latency_s":0.108518}2013gitlab # [ 258.778159] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 962014gitlab # [ 258.778809] gitaly[902]: time="2026-08-16T17:06:52.491Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQCCMFBP6DQWD7CA065G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:22.188" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.489" grpc.time_ms=2.129 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 258.822614] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.522Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1dc0751776295abdfffb401a"],"class":"WebHooks::LogExecutionWorker","jid":"7383ff9b2e12bc6e54e41ee8","created_at":"2026-08-16T17:06:52.391Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-9d6214d7e36e4d43","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e972e96c7f06d3355a08fec34870d258437bb0a34d212057d354ec993bad979e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.394Z","job_size_bytes":2592,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7383ff9b2e12bc6e54e41ee8: done: 0.020313 sec","job_status":"done","queue_duration_s":0.108503,"scheduling_latency_s":0.108518,"redis_calls":7,"redis_duration_s":0.002718,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020313,"completed_at":"2026-08-16T17:06:52.522Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016gitlab # [ 258.823802] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.529Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f866f418d14849a66ab489c5","created_at":"2026-08-16T17:06:52.405Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-90d5d62c0fcb4dd8","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.410Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f866f418d14849a66ab489c5: start","job_status":"start","queue_duration_s":0.118659,"scheduling_latency_s":0.118675}2017gitlab # [ 258.836582] nixbot[2674]: {"ts": "2026-08-16T17:06:52.587Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""}2018gitlab # [ 258.838996] gitlab-workhorse[824]: time="2026-08-16T17:06:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672019gitlab # [ 258.840382] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 752020gitlab # [ 258.841819] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1572021gitlab # [ 258.844410] gitaly[902]: time="2026-08-16T17:06:52.508Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQBW350DDNV8FEPHPZ4W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.497" grpc.time_ms=10.296 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2022gitlab # [ 258.855325] gitaly[902]: time="2026-08-16T17:06:52.529Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQCCMFBP6DQWD7CA065G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:02.184" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.524" grpc.time_ms=4.937 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2023gitlab # [ 258.892458] gitaly[902]: time="2026-08-16T17:06:52.584Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQEXZVPAGKNNZ3PBNFWR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.575" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2024gitlab # [ 258.909998] nix-daemon[2877]: accepted connection from pid 3373, user nixbot2025gitlab # [ 258.910751] gitaly[902]: time="2026-08-16T17:06:52.584Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQEXZVPAGKNNZ3PBNFWR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.575" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2026gitlab # [ 258.911458] gitaly[902]: time="2026-08-16T17:06:52.584Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQEXZVPAGKNNZ3PBNFWR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.575" grpc.time_ms=9.309 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2027gitlab # [ 258.911989] gitaly[902]: time="2026-08-16T17:06:52.684Z" level=info msg="finished unary call with code OK" catfile.duration_ms=29 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=29 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQHFH4THDXJV2VXKPMHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:22.354" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.654" grpc.time_ms=29.877 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab # [ 258.912757] gitaly[902]: time="2026-08-16T17:06:52.689Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:52.687" grpc.time_ms=0.536 pid=902 span.kind=server system=grpc2029gitlab # [ 258.944165] gitaly[902]: time="2026-08-16T17:06:52.721Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:52.720" grpc.time_ms=0.212 pid=902 span.kind=server system=grpc2030gitlab # [ 258.949140] gitaly[902]: time="2026-08-16T17:06:52.726Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQHFH4THDXJV2VXKPMHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:02.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.717" grpc.time_ms=8.76 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2031gitlab # [ 258.958039] gitaly[902]: time="2026-08-16T17:06:52.734Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=10 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQJQ5RRCH2TDCHBTHAKF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.716" grpc.time_ms=18.078 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2032gitlab # [ 258.961136] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1032033gitlab # [ 258.984096] gitaly[902]: time="2026-08-16T17:06:52.760Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:52.760" grpc.time_ms=0.305 pid=902 span.kind=server system=grpc2034gitlab # [ 258.991555] gitaly[902]: time="2026-08-16T17:06:52.768Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX diskcache=39aa8b26-2a75-4a51-9ed6-d446823fdeaa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:22.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.610" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 258.994113] gitaly[902]: time="2026-08-16T17:06:52.769Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=71 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7233 command.oublock=0 command.real_time_ms=153 command.spawn_token_fork_ms=1 command.system_time_ms=45 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:22.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.610" grpc.time_ms=159.054 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2036gitlab # [ 259.002812] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1882037gitlab # [ 259.003789] nixbot[2674]: {"ts": "2026-08-16T17:06:52.780Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""}2038gitlab # [ 259.027345] gitaly[902]: time="2026-08-16T17:06:52.804Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQP0WJFJ7SQ5S031196S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.797" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2039gitlab # [ 259.027871] gitaly[902]: time="2026-08-16T17:06:52.804Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQP0WJFJ7SQ5S031196S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.797" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2040gitlab # [ 259.028942] gitaly[902]: time="2026-08-16T17:06:52.805Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQP0WJFJ7SQ5S031196S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.797" grpc.time_ms=8.483 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2041gitlab # [ 259.031122] gitlab-workhorse[824]: time="2026-08-16T17:06:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672042gitlab # [ 259.031797] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 692043gitlab # [ 259.083159] gitaly[902]: time="2026-08-16T17:06:52.859Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:22.658" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.858" grpc.time_ms=0.902 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2044gitlab # [ 259.094867] gitaly[902]: time="2026-08-16T17:06:52.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQRY03VPTK0W1TYDR5XD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.865" grpc.time_ms=6.236 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2045gitlab # [ 259.096094] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 422046gitlab # [ 259.103571] gitaly[902]: time="2026-08-16T17:06:52.880Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:22.679" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.879" grpc.time_ms=0.449 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047gitlab # [ 259.112501] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.889Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"55701015ea7faa393848908d","created_at":"2026-08-16T17:06:52.887Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"f866f418d14849a66ab489c5","job_size_bytes":3,"pid":2616,"job_status":"deduplicated","message":"PipelineProcessWorker JID-55701015ea7faa393848908d: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2048gitlab # [ 259.113535] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.890Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f866f418d14849a66ab489c5","created_at":"2026-08-16T17:06:52.405Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-90d5d62c0fcb4dd8","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.410Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2616,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f866f418d14849a66ab489c5: rescheduled"}2049gitlab # [ 259.118465] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.895Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f866f418d14849a66ab489c5","created_at":"2026-08-16T17:06:52.405Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-90d5d62c0fcb4dd8","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.410Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f866f418d14849a66ab489c5: done: 0.365731 sec","job_status":"done","queue_duration_s":0.118659,"scheduling_latency_s":0.118675,"gitaly_calls":3,"gitaly_duration_s":0.168413,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.053657,"redis_read_bytes":227,"redis_write_bytes":18467,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001875,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000625,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.037239,"redis_queues_read_bytes":25,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.008628,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000152,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00096,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002303,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.016,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.016,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091753,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.327490505,"duration_s":0.365731,"completed_at":"2026-08-16T17:06:52.894Z","load_balancing_strategy":"primary","db_duration_s":0.050428,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2050gitlab # [ 259.157815] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6aa8c2fe41cb75b86089e897","created_at":"2026-08-16T17:06:52.435Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-747cc18611184935","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.439Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6aa8c2fe41cb75b86089e897: start","job_status":"start","queue_duration_s":0.45678,"scheduling_latency_s":0.456804}2051gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'2052gitlab # [ 259.176477] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6aa8c2fe41cb75b86089e897","created_at":"2026-08-16T17:06:52.435Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-747cc18611184935","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.439Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6aa8c2fe41cb75b86089e897: done: 0.056881 sec","job_status":"done","queue_duration_s":0.45678,"scheduling_latency_s":0.456804,"redis_calls":11,"redis_duration_s":0.0015600000000000002,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000324,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212876,"duration_s":0.056881,"completed_at":"2026-08-16T17:06:52.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2053gitlab # [ 259.225913] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.954Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"360a0f0a81d63d46faa27fb6","created_at":"2026-08-16T17:06:52.597Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.603Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-360a0f0a81d63d46faa27fb6: start","job_status":"start","queue_duration_s":0.350714,"scheduling_latency_s":0.350729}2054gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds)2055gitlab # [ 259.226591] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.979Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"360a0f0a81d63d46faa27fb6","created_at":"2026-08-16T17:06:52.597Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.603Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-360a0f0a81d63d46faa27fb6: done: 0.025292 sec","job_status":"done","queue_duration_s":0.350714,"scheduling_latency_s":0.350729,"redis_calls":7,"redis_duration_s":0.000946,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025292,"completed_at":"2026-08-16T17:06:52.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004792,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2056gitlab # [ 259.274335] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.980Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5f01213fa5e0ae994655ece7","created_at":"2026-08-16T17:06:52.775Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.777Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5f01213fa5e0ae994655ece7: start","job_status":"start","queue_duration_s":0.202607,"scheduling_latency_s":0.202624}2057gitlab # [ 259.274969] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.996Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5f01213fa5e0ae994655ece7","created_at":"2026-08-16T17:06:52.775Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.777Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5f01213fa5e0ae994655ece7: done: 0.015866 sec","job_status":"done","queue_duration_s":0.202607,"scheduling_latency_s":0.202624,"redis_calls":7,"redis_duration_s":0.000927,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015866,"completed_at":"2026-08-16T17:06:52.996Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2058gitlab # [ 259.292447] nixbot[2674]: INFO: ::ffff:127.0.0.1:43892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK2059gitlab # [ 259.293714] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.997Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"28db01467dac315ef30e8307","created_at":"2026-08-16T17:06:52.788Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.791Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-28db01467dac315ef30e8307: start","job_status":"start","queue_duration_s":0.206022,"scheduling_latency_s":0.206037}2060gitlab # [ 259.336923] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.015Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"28db01467dac315ef30e8307","created_at":"2026-08-16T17:06:52.788Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.791Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-28db01467dac315ef30e8307: done: 0.018266 sec","job_status":"done","queue_duration_s":0.206022,"scheduling_latency_s":0.206037,"redis_calls":7,"redis_duration_s":0.001738,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001426,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018266,"completed_at":"2026-08-16T17:06:53.015Z","load_balancing_strategy":"primary","db_duration_s":0.003701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2061gitlab # [ 259.341366] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.016Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4c902801cd6fee60d7f7f733","created_at":"2026-08-16T17:06:52.800Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.804Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4c902801cd6fee60d7f7f733: start","job_status":"start","queue_duration_s":0.211802,"scheduling_latency_s":0.211817}2062gitlab # [ 259.375719] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.038Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4c902801cd6fee60d7f7f733","created_at":"2026-08-16T17:06:52.800Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.804Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4c902801cd6fee60d7f7f733: done: 0.02207 sec","job_status":"done","queue_duration_s":0.211802,"scheduling_latency_s":0.211817,"redis_calls":10,"redis_duration_s":0.002285,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000403,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02207,"completed_at":"2026-08-16T17:06:53.038Z","load_balancing_strategy":"primary","db_duration_s":0.003644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2063gitlab # [ 259.411166] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.039Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"df0084360c9b2b2f68b121e9","created_at":"2026-08-16T17:06:52.840Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.842Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-df0084360c9b2b2f68b121e9: start","job_status":"start","queue_duration_s":0.197096,"scheduling_latency_s":0.197111}2064gitlab # [ 259.411837] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.054Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"df0084360c9b2b2f68b121e9","created_at":"2026-08-16T17:06:52.840Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.842Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-df0084360c9b2b2f68b121e9: done: 0.01549 sec","job_status":"done","queue_duration_s":0.197096,"scheduling_latency_s":0.197111,"redis_calls":7,"redis_duration_s":0.000954,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01549,"completed_at":"2026-08-16T17:06:53.054Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002655,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2065gitlab # [ 259.456804] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.055Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3ad9663ecadc70fc8072fcb2","created_at":"2026-08-16T17:06:52.842Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.844Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3ad9663ecadc70fc8072fcb2: start","job_status":"start","queue_duration_s":0.211558,"scheduling_latency_s":0.211572}2066gitlab # [ 259.457490] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.070Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3ad9663ecadc70fc8072fcb2","created_at":"2026-08-16T17:06:52.842Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.844Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3ad9663ecadc70fc8072fcb2: done: 0.01463 sec","job_status":"done","queue_duration_s":0.211558,"scheduling_latency_s":0.211572,"redis_calls":8,"redis_duration_s":0.001077,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01463,"completed_at":"2026-08-16T17:06:53.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2067gitlab # [ 259.494123] gitaly[902]: time="2026-08-16T17:06:53.190Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:53.189" grpc.time_ms=1.117 pid=902 span.kind=server system=grpc2068gitlab # [ 259.494715] gitaly[902]: time="2026-08-16T17:06:53.210Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:53.209" grpc.time_ms=1.094 pid=902 span.kind=server system=grpc2069gitlab # [ 259.500879] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.071Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"77e3d41e3a356caf2c410485","created_at":"2026-08-16T17:06:52.844Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.846Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-77e3d41e3a356caf2c410485: start","job_status":"start","queue_duration_s":0.225141,"scheduling_latency_s":0.225155}2070gitlab # [ 259.514536] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.084Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"77e3d41e3a356caf2c410485","created_at":"2026-08-16T17:06:52.844Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.846Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-77e3d41e3a356caf2c410485: done: 0.013356 sec","job_status":"done","queue_duration_s":0.225141,"scheduling_latency_s":0.225155,"redis_calls":7,"redis_duration_s":0.000941,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013356,"completed_at":"2026-08-16T17:06:53.084Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2071gitlab # [ 259.556166] gitaly[902]: time="2026-08-16T17:06:53.229Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:53.228" grpc.time_ms=0.331 pid=902 span.kind=server system=grpc2072gitlab # [ 259.556689] gitaly[902]: time="2026-08-16T17:06:53.240Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX diskcache=c1ebb3dc-5db0-44d5-9fae-c72e639cf427 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:23.167" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:53.167" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab # [ 259.564420] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.085Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7ea5cc2559cee790ebd6aa44","created_at":"2026-08-16T17:06:52.846Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.847Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7ea5cc2559cee790ebd6aa44: start","job_status":"start","queue_duration_s":0.237978,"scheduling_latency_s":0.237993}2074gitlab # [ 259.604238] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.101Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7ea5cc2559cee790ebd6aa44","created_at":"2026-08-16T17:06:52.846Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.847Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7ea5cc2559cee790ebd6aa44: done: 0.015894 sec","job_status":"done","queue_duration_s":0.237978,"scheduling_latency_s":0.237993,"redis_calls":7,"redis_duration_s":0.000911,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015894,"completed_at":"2026-08-16T17:06:53.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab # [ 259.644129] gitaly[902]: time="2026-08-16T17:06:53.240Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7546 command.oublock=0 command.real_time_ms=63 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:23.167" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:53.167" grpc.time_ms=72.675 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 259.644758] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.102Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"41237a79b698aea146f1de71","created_at":"2026-08-16T17:06:52.847Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.848Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-41237a79b698aea146f1de71: start","job_status":"start","queue_duration_s":0.253554,"scheduling_latency_s":0.253569}2077gitlab # [ 259.645435] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.111Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"41237a79b698aea146f1de71","created_at":"2026-08-16T17:06:52.847Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.848Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-41237a79b698aea146f1de71: done: 0.008701 sec","job_status":"done","queue_duration_s":0.253554,"scheduling_latency_s":0.253569,"redis_calls":7,"redis_duration_s":0.000991,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008701,"completed_at":"2026-08-16T17:06:53.111Z","load_balancing_strategy":"primary","db_duration_s":0.000246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2078gitlab # [ 259.684205] gitaly[902]: time="2026-08-16T17:06:53.278Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:23.076" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:53.277" grpc.time_ms=0.669 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2079gitlab # [ 259.684552] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.111Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dcb7990c8b2664811d8d0846","created_at":"2026-08-16T17:06:52.849Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.850Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dcb7990c8b2664811d8d0846: start","job_status":"start","queue_duration_s":0.261875,"scheduling_latency_s":0.261889}2080gitlab # [ 259.719662] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dcb7990c8b2664811d8d0846","created_at":"2026-08-16T17:06:52.849Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.850Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dcb7990c8b2664811d8d0846: done: 0.013548 sec","job_status":"done","queue_duration_s":0.261875,"scheduling_latency_s":0.261889,"redis_calls":7,"redis_duration_s":0.000959,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013548,"completed_at":"2026-08-16T17:06:53.125Z","load_balancing_strategy":"primary","db_duration_s":0.00194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2081gitlab # [ 259.723249] gitaly[902]: time="2026-08-16T17:06:53.300Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:23.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:53.299" grpc.time_ms=0.552 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 259.733387] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.126Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2789d2adc3753281c3569fb1","created_at":"2026-08-16T17:06:52.890Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.891Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2789d2adc3753281c3569fb1: start","job_status":"start","queue_duration_s":0.234879,"scheduling_latency_s":0.234894}2083gitlab # [ 259.768907] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.308Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2789d2adc3753281c3569fb1","created_at":"2026-08-16T17:06:52.890Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.891Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2789d2adc3753281c3569fb1: done: 0.182002 sec","job_status":"done","queue_duration_s":0.234879,"scheduling_latency_s":0.234894,"gitaly_calls":3,"gitaly_duration_s":0.079615,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007384,"redis_read_bytes":141,"redis_write_bytes":16720,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000325,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000675,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001729,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11226,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.002691,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000166,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000414,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080126,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16235164,"duration_s":0.182002,"completed_at":"2026-08-16T17:06:53.308Z","load_balancing_strategy":"primary","db_duration_s":0.019718,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2084gitlab # [ 259.787253] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5e55ed19ae1619e6d4491440","created_at":"2026-08-16T17:06:53.162Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.163Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5e55ed19ae1619e6d4491440: start","job_status":"start","queue_duration_s":0.145585,"scheduling_latency_s":0.145599}2085gitlab # [ 259.800560] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.334Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5e55ed19ae1619e6d4491440","created_at":"2026-08-16T17:06:53.162Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.163Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5e55ed19ae1619e6d4491440: done: 0.02518 sec","job_status":"done","queue_duration_s":0.145585,"scheduling_latency_s":0.145599,"redis_calls":7,"redis_duration_s":0.001112,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02518,"completed_at":"2026-08-16T17:06:53.334Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004276,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2086gitlab # [ 259.840988] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.335Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cb70126591d639ef08608457","created_at":"2026-08-16T17:06:53.245Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.247Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cb70126591d639ef08608457: start","job_status":"start","queue_duration_s":0.088471,"scheduling_latency_s":0.088486}2087gitlab # [ 259.878443] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.351Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cb70126591d639ef08608457","created_at":"2026-08-16T17:06:53.245Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.247Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cb70126591d639ef08608457: done: 0.015842 sec","job_status":"done","queue_duration_s":0.088471,"scheduling_latency_s":0.088486,"redis_calls":7,"redis_duration_s":0.0009249999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015842,"completed_at":"2026-08-16T17:06:53.351Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2088gitlab # [ 259.881055] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.352Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2b7804668ebd7ee5fdfba8f6","created_at":"2026-08-16T17:06:53.251Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.255Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2b7804668ebd7ee5fdfba8f6: start","job_status":"start","queue_duration_s":0.09729,"scheduling_latency_s":0.097304}2089gitlab # [ 259.894021] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.369Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2b7804668ebd7ee5fdfba8f6","created_at":"2026-08-16T17:06:53.251Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.255Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2b7804668ebd7ee5fdfba8f6: done: 0.017525 sec","job_status":"done","queue_duration_s":0.09729,"scheduling_latency_s":0.097304,"redis_calls":7,"redis_duration_s":0.001135,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017525,"completed_at":"2026-08-16T17:06:53.369Z","load_balancing_strategy":"primary","db_duration_s":0.003436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2090gitlab # [ 259.934285] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.370Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"26b0e264fdc3445ba57f8236","created_at":"2026-08-16T17:06:53.261Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.262Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-26b0e264fdc3445ba57f8236: start","job_status":"start","queue_duration_s":0.108395,"scheduling_latency_s":0.10841}2091gitlab # [ 259.972821] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.389Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"26b0e264fdc3445ba57f8236","created_at":"2026-08-16T17:06:53.261Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.262Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-26b0e264fdc3445ba57f8236: done: 0.0186 sec","job_status":"done","queue_duration_s":0.108395,"scheduling_latency_s":0.10841,"redis_calls":10,"redis_duration_s":0.001363,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000387,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0186,"completed_at":"2026-08-16T17:06:53.389Z","load_balancing_strategy":"primary","db_duration_s":0.002915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2092gitlab # [ 259.974474] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.390Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8e54ebfb51f60a537da22e97","created_at":"2026-08-16T17:06:53.262Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.263Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8e54ebfb51f60a537da22e97: start","job_status":"start","queue_duration_s":0.126669,"scheduling_latency_s":0.126685}2093gitlab # [ 260.017974] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.405Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8e54ebfb51f60a537da22e97","created_at":"2026-08-16T17:06:53.262Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.263Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8e54ebfb51f60a537da22e97: done: 0.015492 sec","job_status":"done","queue_duration_s":0.126669,"scheduling_latency_s":0.126685,"redis_calls":7,"redis_duration_s":0.00101,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015492,"completed_at":"2026-08-16T17:06:53.405Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002414,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2094gitlab # [ 260.022289] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.406Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0ad9e18ad7a275739c31941c","created_at":"2026-08-16T17:06:53.263Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.265Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0ad9e18ad7a275739c31941c: start","job_status":"start","queue_duration_s":0.141486,"scheduling_latency_s":0.141502}2095gitlab # [ 260.065227] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0ad9e18ad7a275739c31941c","created_at":"2026-08-16T17:06:53.263Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.265Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0ad9e18ad7a275739c31941c: done: 0.014857 sec","job_status":"done","queue_duration_s":0.141486,"scheduling_latency_s":0.141502,"redis_calls":8,"redis_duration_s":0.001107,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014857,"completed_at":"2026-08-16T17:06:53.421Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2096gitlab # [ 260.070069] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.422Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"80d9ec762995386fc4a57a97","created_at":"2026-08-16T17:06:53.265Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.266Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-80d9ec762995386fc4a57a97: start","job_status":"start","queue_duration_s":0.155684,"scheduling_latency_s":0.155699}2097gitlab # [ 260.105911] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.435Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"80d9ec762995386fc4a57a97","created_at":"2026-08-16T17:06:53.265Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.266Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-80d9ec762995386fc4a57a97: done: 0.013061 sec","job_status":"done","queue_duration_s":0.155684,"scheduling_latency_s":0.155699,"redis_calls":7,"redis_duration_s":0.000875,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013061,"completed_at":"2026-08-16T17:06:53.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2098gitlab # [ 260.119179] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.436Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"18efa2c675dafe0b0c8cf2dc","created_at":"2026-08-16T17:06:53.267Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.268Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-18efa2c675dafe0b0c8cf2dc: start","job_status":"start","queue_duration_s":0.168431,"scheduling_latency_s":0.168444}2099gitlab # [ 260.133307] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.451Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"18efa2c675dafe0b0c8cf2dc","created_at":"2026-08-16T17:06:53.267Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.268Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-18efa2c675dafe0b0c8cf2dc: done: 0.015526 sec","job_status":"done","queue_duration_s":0.168431,"scheduling_latency_s":0.168444,"redis_calls":7,"redis_duration_s":0.0009530000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015526,"completed_at":"2026-08-16T17:06:53.451Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2100gitlab # [ 260.186158] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.452Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"09b9eb699d59734a141205d7","created_at":"2026-08-16T17:06:53.268Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.269Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-09b9eb699d59734a141205d7: start","job_status":"start","queue_duration_s":0.183674,"scheduling_latency_s":0.183686}2101gitlab # [ 260.186787] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.461Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"09b9eb699d59734a141205d7","created_at":"2026-08-16T17:06:53.268Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.269Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-09b9eb699d59734a141205d7: done: 0.008349 sec","job_status":"done","queue_duration_s":0.183674,"scheduling_latency_s":0.183686,"redis_calls":7,"redis_duration_s":0.0008680000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008349,"completed_at":"2026-08-16T17:06:53.461Z","load_balancing_strategy":"primary","db_duration_s":0.000271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2102gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'2103gitlab # [ 260.223023] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.462Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a677dac5d3d44a3076d0329b","created_at":"2026-08-16T17:06:53.269Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.270Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a677dac5d3d44a3076d0329b: start","job_status":"start","queue_duration_s":0.191734,"scheduling_latency_s":0.191746}2104gitlab # [ 260.225544] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a677dac5d3d44a3076d0329b","created_at":"2026-08-16T17:06:53.269Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.270Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a677dac5d3d44a3076d0329b: done: 0.013132 sec","job_status":"done","queue_duration_s":0.191734,"scheduling_latency_s":0.191746,"redis_calls":7,"redis_duration_s":0.000882,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013132,"completed_at":"2026-08-16T17:06:53.475Z","load_balancing_strategy":"primary","db_duration_s":0.001845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2105gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)2106gitlab # [ 260.290839] nixbot[2674]: INFO: ::ffff:127.0.0.1:43900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK2107gitlab # [ 260.352125] gitaly[902]: time="2026-08-16T17:06:54.128Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQTAQQNPN6GCCM62WYYE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.109" pid=902 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2108gitlab # [ 260.353173] gitaly[902]: time="2026-08-16T17:06:54.128Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQTAQQNPN6GCCM62WYYE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.109" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2109gitlab # [ 260.353707] gitaly[902]: time="2026-08-16T17:06:54.128Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQTAQQNPN6GCCM62WYYE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.109" grpc.time_ms=19.447 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc2110gitlab # [ 260.383616] gitlab-workhorse[824]: time="2026-08-16T17:06:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162111gitlab # [ 260.384258] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 12852112gitlab # [ 260.476656] gitaly[902]: time="2026-08-16T17:06:54.253Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:24.051" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.252" grpc.time_ms=0.932 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 260.510156] gitaly[902]: time="2026-08-16T17:06:54.286Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:07:24.078" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:54.279" grpc.time_ms=7.451 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 260.550737] gitaly[902]: time="2026-08-16T17:06:54.327Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:04.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:54.318" grpc.time_ms=9.126 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 260.568766] gitaly[902]: time="2026-08-16T17:06:54.345Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:07:04.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.345" grpc.time_ms=0.368 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 260.581955] gitaly[902]: time="2026-08-16T17:06:54.358Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:07:04.007" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:54.348" grpc.time_ms=10.357 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 260.639028] gitaly[902]: time="2026-08-16T17:06:54.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:54.415" grpc.time_ms=0.563 pid=902 span.kind=server system=grpc2118gitlab # [ 260.678863] gitaly[902]: time="2026-08-16T17:06:54.455Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:54.454" grpc.time_ms=0.678 pid=902 span.kind=server system=grpc2119gitlab # [ 260.691778] gitaly[902]: time="2026-08-16T17:06:54.468Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" operations="[repack_refs]" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root2120gitlab # [ 260.694701] gitaly[902]: time="2026-08-16T17:06:54.471Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 17:05:53.070428901 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root2121gitlab # [ 260.718281] gitaly[902]: time="2026-08-16T17:06:54.495Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J diskcache=4db4c80a-1470-4f25-9d3d-68d7fb562bf3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root2122gitlab # [ 260.719493] gitaly[902]: time="2026-08-16T17:06:54.495Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=94 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6399 command.oublock=8 command.real_time_ms=107 command.spawn_token_fork_ms=0 command.system_time_ms=61 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" grpc.time_ms=123.731 pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root2123gitlab # [ 260.720537] gitaly[902]: time="2026-08-16T17:06:54.496Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2124gitlab # [ 260.721499] gitaly[902]: time="2026-08-16T17:06:54.496Z" level=info msg="optimized repository" clean_stale_data_time=23.738771ms clean_work_trees_time="79.619µs" commit_graph_time="3.911µs" correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=902 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=23.955279ms2125gitlab # [ 260.722212] gitaly[902]: time="2026-08-16T17:06:54.496Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root2126gitlab # [ 260.730647] gitaly[902]: time="2026-08-16T17:06:54.500Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:24.199" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.499" grpc.time_ms=0.408 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 260.741567] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.509Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bc848584deff658fb0b80865","created_at":"2026-08-16T17:06:54.501Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.505Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bc848584deff658fb0b80865: start","job_status":"start","queue_duration_s":0.003991,"scheduling_latency_s":0.004037}2128gitlab # [ 260.762584] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.539Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bc848584deff658fb0b80865","created_at":"2026-08-16T17:06:54.501Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.505Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bc848584deff658fb0b80865: done: 0.030208 sec","job_status":"done","queue_duration_s":0.003991,"scheduling_latency_s":0.004037,"redis_calls":7,"redis_duration_s":0.005101,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002049,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030208,"completed_at":"2026-08-16T17:06:54.539Z","load_balancing_strategy":"primary","db_duration_s":0.003404,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2129gitlab # [ 260.803873] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.543Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e3934e2164294e17a6345b59","created_at":"2026-08-16T17:06:54.507Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.511Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e3934e2164294e17a6345b59: start","job_status":"start","queue_duration_s":0.031379,"scheduling_latency_s":0.031395}2130gitlab # [ 260.804904] nixbot[2674]: {"ts": "2026-08-16T17:06:54.576Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 \"HTTP/1.1 201 Created\""}2131gitlab # [ 260.805663] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3822132gitlab # [ 260.807669] nixbot[2674]: {"ts": "2026-08-16T17:06:54.581Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e652aafceb87-4"}2133gitlab # [ 260.811230] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.587Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e3934e2164294e17a6345b59","created_at":"2026-08-16T17:06:54.507Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.511Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e3934e2164294e17a6345b59: done: 0.044637 sec","job_status":"done","queue_duration_s":0.031379,"scheduling_latency_s":0.031395,"redis_calls":10,"redis_duration_s":0.005721,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044637,"completed_at":"2026-08-16T17:06:54.587Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009286,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2134gitlab # [ 260.852173] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.589Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5b160c25928e05e46aa0df65","created_at":"2026-08-16T17:06:54.561Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.563Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5b160c25928e05e46aa0df65: start","job_status":"start","queue_duration_s":0.025264,"scheduling_latency_s":0.025308}2135gitlab # [ 260.863674] gitaly[902]: time="2026-08-16T17:06:54.640Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:24.439" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.639" grpc.time_ms=0.662 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2136gitlab # [ 260.900805] gitaly[902]: time="2026-08-16T17:06:54.665Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:24.464" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.664" grpc.time_ms=0.412 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 260.901554] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.676Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5b160c25928e05e46aa0df65","created_at":"2026-08-16T17:06:54.561Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.563Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5b160c25928e05e46aa0df65: done: 0.087965 sec","job_status":"done","queue_duration_s":0.025264,"scheduling_latency_s":0.025308,"gitaly_calls":2,"gitaly_duration_s":0.005049,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007317,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000631,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003194,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000192,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000155,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000703,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058543,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.065254662,"duration_s":0.087965,"completed_at":"2026-08-16T17:06:54.676Z","load_balancing_strategy":"primary","db_duration_s":0.020217,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2138gitlab # [ 260.918522] nix-daemon[2877]: accepted connection from pid 3493, user nixbot2139gitlab # [ 260.919141] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.683Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"868e15e3c36cc203915da175","created_at":"2026-08-16T17:06:54.626Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-ad193f0c921a4e8e","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.627Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-868e15e3c36cc203915da175: start","job_status":"start","queue_duration_s":0.055641,"scheduling_latency_s":0.055657}2140gitlab # [ 260.936716] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"868e15e3c36cc203915da175","created_at":"2026-08-16T17:06:54.626Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-ad193f0c921a4e8e","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.627Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-868e15e3c36cc203915da175: done: 0.030156 sec","job_status":"done","queue_duration_s":0.055641,"scheduling_latency_s":0.055657,"redis_calls":7,"redis_duration_s":0.006019999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005539,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030156,"completed_at":"2026-08-16T17:06:54.713Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2141gitlab # [ 260.973632] nix-daemon[2877]: accepted connection from pid 3501, user nixbot2142gitlab # [ 261.006131] nixbot[2674]: {"ts": "2026-08-16T17:06:54.782Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e652aafceb87-4", "argv0": "bwrap"}2143gitlab # [ 261.071029] nix-daemon[2877]: accepted connection from pid 3511, user nixbot2144gitlab # [ 261.136569] nix-daemon[2877]: accepted connection from pid 3521, user nixbot2145gitlab # [ 261.154546] nix-daemon[2877]: accepted connection from pid 3511, user nixbot2146gitlab # [ 261.255081] gitaly[902]: time="2026-08-16T17:06:55.031Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.030" grpc.time_ms=1.024 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90'2148gitlab # [ 261.292279] gitaly[902]: time="2026-08-16T17:06:55.068Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:05.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:55.056" grpc.time_ms=12.019 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2149gitlab # [ 261.325583] nixbot[2674]: INFO: ::ffff:127.0.0.1:43902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK2150gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds)2151(finished: subtest: push delivers the webhook, in 55.83 seconds)2152subtest: eval and build post commit statuses2153gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses2154gitlab # [ 261.367129] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.143Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"377abf87468df57a80c6961a","created_at":"2026-08-16T17:06:55.137Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-5e3c1d3edf914aa2","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.140Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-377abf87468df57a80c6961a: start","job_status":"start","queue_duration_s":0.003144,"scheduling_latency_s":0.003177}2155gitlab # [ 261.397422] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2092156gitlab # [ 261.398814] nixbot[2674]: {"ts": "2026-08-16T17:06:55.175Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 \"HTTP/1.1 201 Created\""}2157gitlab # [ 261.407540] gitaly[902]: time="2026-08-16T17:06:55.183Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMT0N5R42PMBYW46BPAWN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.080" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.182" grpc.time_ms=0.778 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab # [ 261.442458] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses HTTP/1.1" 200 659 "" "curl/8.21.0" 932159gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses, in 0.11 seconds)2160gitlab # [ 261.447426] gitaly[902]: time="2026-08-16T17:06:55.224Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:55.222" grpc.time_ms=1.425 pid=902 span.kind=server system=grpc2161gitlab # [ 261.454126] gitaly[902]: time="2026-08-16T17:06:55.227Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMT2BQES452SZKAA462QV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.225" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.225" grpc.time_ms=1.552 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 261.485529] gitaly[902]: time="2026-08-16T17:06:55.261Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:55.261" grpc.time_ms=0.221 pid=902 span.kind=server system=grpc2163gitlab # [ 261.493698] gitaly[902]: time="2026-08-16T17:06:55.270Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMT2BQES452SZKAA462QV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:05.209" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:55.259" grpc.time_ms=10.76 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 261.514132] gitaly[902]: time="2026-08-16T17:06:55.291Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:55.290" grpc.time_ms=0.37 pid=902 span.kind=server system=grpc2165gitlab # [ 261.530314] gitaly[902]: time="2026-08-16T17:06:55.307Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 diskcache=f0a3ee31-b745-4fad-8f93-3b33976c5ffd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:25.198" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:55.198" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 261.536505] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1332167gitlab # [ 261.537606] nixbot[2674]: {"ts": "2026-08-16T17:06:55.314Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 \"HTTP/1.1 201 Created\""}2168gitlab # [ 261.543062] gitaly[902]: time="2026-08-16T17:06:55.319Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=100 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7457 command.oublock=0 command.real_time_ms=103 command.spawn_token_fork_ms=0 command.system_time_ms=78 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:25.198" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:55.198" grpc.time_ms=108.676 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 261.585255] gitaly[902]: time="2026-08-16T17:06:55.362Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:25.160" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.361" grpc.time_ms=0.69 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab # [ 261.596569] gitaly[902]: time="2026-08-16T17:06:55.373Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMT6WSJ3QGC11AQ79SJ1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.272" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.372" grpc.time_ms=0.361 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 261.605240] gitaly[902]: time="2026-08-16T17:06:55.382Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.181" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.381" grpc.time_ms=0.545 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 261.614253] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.390Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0b093d9affc60ab857310459","created_at":"2026-08-16T17:06:55.389Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"377abf87468df57a80c6961a","job_size_bytes":3,"pid":2616,"job_status":"deduplicated","message":"PipelineProcessWorker JID-0b093d9affc60ab857310459: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2173gitlab # [ 261.615284] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.392Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"377abf87468df57a80c6961a","created_at":"2026-08-16T17:06:55.137Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-5e3c1d3edf914aa2","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.140Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2616,"job_status":"rescheduled","message":"PipelineProcessWorker JID-377abf87468df57a80c6961a: rescheduled"}2174gitlab # [ 261.620031] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.396Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"377abf87468df57a80c6961a","created_at":"2026-08-16T17:06:55.137Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-5e3c1d3edf914aa2","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.140Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-377abf87468df57a80c6961a: done: 0.253158 sec","job_status":"done","queue_duration_s":0.003144,"scheduling_latency_s":0.003177,"gitaly_calls":3,"gitaly_duration_s":0.127981,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011153,"redis_read_bytes":239,"redis_write_bytes":21784,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000977,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00097,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.00228,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14469,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.003718,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000161,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000658,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001412,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095597,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.221837133,"duration_s":0.253158,"completed_at":"2026-08-16T17:06:55.396Z","load_balancing_strategy":"primary","db_duration_s":0.023246,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2175gitlab # [ 261.670167] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.397Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2b548c5a33396e70dfad5364","created_at":"2026-08-16T17:06:55.192Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.194Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2b548c5a33396e70dfad5364: start","job_status":"start","queue_duration_s":0.203378,"scheduling_latency_s":0.203394}2176gitlab # [ 261.670776] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.426Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2b548c5a33396e70dfad5364","created_at":"2026-08-16T17:06:55.192Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.194Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2b548c5a33396e70dfad5364: done: 0.029069 sec","job_status":"done","queue_duration_s":0.203378,"scheduling_latency_s":0.203394,"redis_calls":7,"redis_duration_s":0.0013479999999999998,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029069,"completed_at":"2026-08-16T17:06:55.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007052,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2177gitlab # [ 261.726650] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.428Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1e1f1ac5b4a81edcaffcdcc6","created_at":"2026-08-16T17:06:55.324Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.326Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1e1f1ac5b4a81edcaffcdcc6: start","job_status":"start","queue_duration_s":0.101578,"scheduling_latency_s":0.101594}2178gitlab # [ 261.727224] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.446Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1e1f1ac5b4a81edcaffcdcc6","created_at":"2026-08-16T17:06:55.324Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.326Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1e1f1ac5b4a81edcaffcdcc6: done: 0.018501 sec","job_status":"done","queue_duration_s":0.101578,"scheduling_latency_s":0.101594,"redis_calls":7,"redis_duration_s":0.001359,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018501,"completed_at":"2026-08-16T17:06:55.446Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2179gitlab # [ 261.743761] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.447Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"065e9fdadcdab034f3717692","created_at":"2026-08-16T17:06:55.331Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.334Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-065e9fdadcdab034f3717692: start","job_status":"start","queue_duration_s":0.113145,"scheduling_latency_s":0.113159}2180gitlab # [ 261.779629] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.466Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"065e9fdadcdab034f3717692","created_at":"2026-08-16T17:06:55.331Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.334Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-065e9fdadcdab034f3717692: done: 0.0192 sec","job_status":"done","queue_duration_s":0.113145,"scheduling_latency_s":0.113159,"redis_calls":7,"redis_duration_s":0.001578,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0192,"completed_at":"2026-08-16T17:06:55.466Z","load_balancing_strategy":"primary","db_duration_s":0.00461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2181gitlab # [ 261.790648] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e52ce04ba362628dd71837c2","created_at":"2026-08-16T17:06:55.340Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.342Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e52ce04ba362628dd71837c2: start","job_status":"start","queue_duration_s":0.126177,"scheduling_latency_s":0.126192}2182gitlab # [ 261.803123] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.490Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e52ce04ba362628dd71837c2","created_at":"2026-08-16T17:06:55.340Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.342Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e52ce04ba362628dd71837c2: done: 0.022281 sec","job_status":"done","queue_duration_s":0.126177,"scheduling_latency_s":0.126192,"redis_calls":10,"redis_duration_s":0.002268,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000694,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022281,"completed_at":"2026-08-16T17:06:55.490Z","load_balancing_strategy":"primary","db_duration_s":0.005463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2183gitlab # [ 261.840089] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3cb2ab10255fb3905ced2a9a","created_at":"2026-08-16T17:06:55.342Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.343Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3cb2ab10255fb3905ced2a9a: start","job_status":"start","queue_duration_s":0.148287,"scheduling_latency_s":0.148303}2184gitlab # [ 261.851970] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.510Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3cb2ab10255fb3905ced2a9a","created_at":"2026-08-16T17:06:55.342Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.343Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3cb2ab10255fb3905ced2a9a: done: 0.018831 sec","job_status":"done","queue_duration_s":0.148287,"scheduling_latency_s":0.148303,"redis_calls":7,"redis_duration_s":0.001563,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018831,"completed_at":"2026-08-16T17:06:55.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2185gitlab # [ 261.891343] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.511Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9a83d581557224d31eda1a09","created_at":"2026-08-16T17:06:55.343Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.345Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9a83d581557224d31eda1a09: start","job_status":"start","queue_duration_s":0.166488,"scheduling_latency_s":0.166503}2186gitlab # [ 261.927907] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.529Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9a83d581557224d31eda1a09","created_at":"2026-08-16T17:06:55.343Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.345Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9a83d581557224d31eda1a09: done: 0.017962 sec","job_status":"done","queue_duration_s":0.166488,"scheduling_latency_s":0.166503,"redis_calls":8,"redis_duration_s":0.0018510000000000002,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00144,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017962,"completed_at":"2026-08-16T17:06:55.529Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2187gitlab # [ 261.935466] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.530Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1c3eb7c9eb3ed18c3d1b23a0","created_at":"2026-08-16T17:06:55.345Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.346Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1c3eb7c9eb3ed18c3d1b23a0: start","job_status":"start","queue_duration_s":0.18399,"scheduling_latency_s":0.184004}2188gitlab # [ 261.974236] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.547Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1c3eb7c9eb3ed18c3d1b23a0","created_at":"2026-08-16T17:06:55.345Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.346Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1c3eb7c9eb3ed18c3d1b23a0: done: 0.01635 sec","job_status":"done","queue_duration_s":0.18399,"scheduling_latency_s":0.184004,"redis_calls":7,"redis_duration_s":0.0016419999999999998,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01635,"completed_at":"2026-08-16T17:06:55.547Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2189gitlab # [ 261.998286] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.548Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"28b610667aa4f26525a0b1ef","created_at":"2026-08-16T17:06:55.347Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.348Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-28b610667aa4f26525a0b1ef: start","job_status":"start","queue_duration_s":0.199882,"scheduling_latency_s":0.199896}2190gitlab # [ 261.999283] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.609Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"28b610667aa4f26525a0b1ef","created_at":"2026-08-16T17:06:55.347Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.348Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-28b610667aa4f26525a0b1ef: done: 0.060999 sec","job_status":"done","queue_duration_s":0.199882,"scheduling_latency_s":0.199896,"redis_calls":7,"redis_duration_s":0.001346,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000356,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060999,"completed_at":"2026-08-16T17:06:55.609Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040842,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2191gitlab # [ 262.061178] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.610Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"0c5ea8cb96604c8682c228bb","created_at":"2026-08-16T17:06:55.350Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.351Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0c5ea8cb96604c8682c228bb: start","job_status":"start","queue_duration_s":0.258569,"scheduling_latency_s":0.258588}2192gitlab # [ 262.061925] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.628Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"0c5ea8cb96604c8682c228bb","created_at":"2026-08-16T17:06:55.350Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.351Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0c5ea8cb96604c8682c228bb: done: 0.018449 sec","job_status":"done","queue_duration_s":0.258569,"scheduling_latency_s":0.258588,"redis_calls":7,"redis_duration_s":0.001395,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000383,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018449,"completed_at":"2026-08-16T17:06:55.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2193gitlab # [ 262.110364] gitaly[902]: time="2026-08-16T17:06:55.820Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=64 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=64 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:25.553" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.754" grpc.time_ms=65.746 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2194gitlab # [ 262.111101] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c8168e0d9ee561edaf202862","created_at":"2026-08-16T17:06:55.352Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.353Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c8168e0d9ee561edaf202862: start","job_status":"start","queue_duration_s":0.276875,"scheduling_latency_s":0.276912}2195gitlab # [ 262.111744] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.639Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c8168e0d9ee561edaf202862","created_at":"2026-08-16T17:06:55.352Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.353Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c8168e0d9ee561edaf202862: done: 0.009508 sec","job_status":"done","queue_duration_s":0.276875,"scheduling_latency_s":0.276912,"redis_calls":7,"redis_duration_s":0.0014579999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000372,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009508,"completed_at":"2026-08-16T17:06:55.639Z","load_balancing_strategy":"primary","db_duration_s":0.000443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2196gitlab # [ 262.151432] gitaly[902]: time="2026-08-16T17:06:55.851Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.649" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.850" grpc.time_ms=0.579 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 262.152333] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.640Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"2e209c02394913f5c59b4f7c","created_at":"2026-08-16T17:06:55.353Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.354Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2e209c02394913f5c59b4f7c: start","job_status":"start","queue_duration_s":0.286213,"scheduling_latency_s":0.286226}2198gitlab # [ 262.161042] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.657Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"2e209c02394913f5c59b4f7c","created_at":"2026-08-16T17:06:55.353Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.354Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2e209c02394913f5c59b4f7c: done: 0.016523 sec","job_status":"done","queue_duration_s":0.286213,"scheduling_latency_s":0.286226,"redis_calls":7,"redis_duration_s":0.0015209999999999998,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016523,"completed_at":"2026-08-16T17:06:55.657Z","load_balancing_strategy":"primary","db_duration_s":0.003618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2199gitlab # [ 262.207701] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.658Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"ba3dc7f46d3b27c220e63f27","created_at":"2026-08-16T17:06:55.392Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.393Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ba3dc7f46d3b27c220e63f27: start","job_status":"start","queue_duration_s":0.265104,"scheduling_latency_s":0.265118}2200gitlab # [ 262.208536] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.861Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"ba3dc7f46d3b27c220e63f27","created_at":"2026-08-16T17:06:55.392Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.393Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ba3dc7f46d3b27c220e63f27: done: 0.203311 sec","job_status":"done","queue_duration_s":0.265104,"scheduling_latency_s":0.265118,"gitaly_calls":2,"gitaly_duration_s":0.072296,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.00642,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001007,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001331,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000289,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000254,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000285,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063757,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.151671232,"duration_s":0.203311,"completed_at":"2026-08-16T17:06:55.861Z","load_balancing_strategy":"primary","db_duration_s":0.067615,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2201gitlab # [ 262.255764] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.863Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f382af67021ba574a15d3107","created_at":"2026-08-16T17:06:55.740Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-7309eaf728e24d58","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.742Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f382af67021ba574a15d3107: start","job_status":"start","queue_duration_s":0.120885,"scheduling_latency_s":0.120899}2202gitlab # [ 262.262513] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.885Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f382af67021ba574a15d3107","created_at":"2026-08-16T17:06:55.740Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-7309eaf728e24d58","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.742Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f382af67021ba574a15d3107: done: 0.022831 sec","job_status":"done","queue_duration_s":0.120885,"scheduling_latency_s":0.120899,"redis_calls":7,"redis_duration_s":0.0008990000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022831,"completed_at":"2026-08-16T17:06:55.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2203gitlab # [ 262.415560] gitaly[902]: time="2026-08-16T17:06:56.191Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMT6WSJ3QGC11AQ79SJ1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:06.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:56.180" grpc.time_ms=10.97 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2204gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses2205gitlab # [ 262.480332] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:56.256Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"21cdc8b1118cafec1dc4696a","created_at":"2026-08-16T17:06:56.245Z","trace_propagation_headers":{"sentry-trace":"07520d1b2e0844c6b57b6788073be414-0d576c3be4d94386","baggage":"sentry-trace_id=07520d1b2e0844c6b57b6788073be414,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMT6WSJ3QGC11AQ79SJ1M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:56.253Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-21cdc8b1118cafec1dc4696a: start","job_status":"start","queue_duration_s":0.002903,"scheduling_latency_s":0.002956}2206gitlab # [ 262.524294] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 9692207gitlab # [ 262.529810] nixbot[2674]: {"ts": "2026-08-16T17:06:56.306Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 \"HTTP/1.1 201 Created\""}2208gitlab # [ 262.578978] gitaly[902]: time="2026-08-16T17:06:56.355Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMV5HTV7PQ3KN36F0NQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:26.254" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:56.354" grpc.time_ms=0.844 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2209gitlab # [ 262.607756] nix-daemon[2877]: accepted connection from pid 3584, user nixbot2210gitlab # [ 262.612099] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 832211gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses, in 0.17 seconds)2212(finished: subtest: eval and build post commit statuses, in 1.29 seconds)2213(finished: run the VM test script, in 331.59 seconds)2214gitlab # [ 262.618184] gitaly[902]: time="2026-08-16T17:06:56.394Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMT6WSJ3QGC11AQ79SJ1M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:56.393" grpc.time_ms=0.349 pid=902 span.kind=server system=grpc2215test script finished in 331.61s2216cleanup2217kill QemuMachine (pid 46)2218gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2219(finished: cleanup, in 1.59 seconds)2220additionally exposed symbols:2221 gitlab,2222 vlan1,2223 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2224[]2225[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T17:05:58.273Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2226[]2227[]2228[]2229[]2230[]2231[]2232[]2233[]2234[]2235[]2236[]2237[]2238[]2239[]2240[]2241[]2242[]2243[]2244[]2245[]2246[]2247[]2248[]2249[]2250[]2251[]2252[]2253[]2254[]2255[]2256[]2257[]2258[]2259[]2260[]2261[]2262[]2263[]2264[]2265[]2266[]2267[]2268[]2269[]2270[]2271[]2272[]2273[]2274[]2275[]2276[]2277[]2278[]2279[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'e652aafceb871cb9d38ca62ebe5294ea158d1c90', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'building', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T17:06:54.186566Z', 'started_at': '2026-08-16T17:06:54.577549Z', 'finished_at': None}]2280[{'id': 5, 'sha': 'e652aafceb871cb9d38ca62ebe5294ea158d1c90', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-16T17:06:54.555Z', 'started_at': None, 'finished_at': '2026-08-16T17:06:55.129Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2281[{'id': 5, 'sha': 'e652aafceb871cb9d38ca62ebe5294ea158d1c90', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-16T17:06:54.555Z', 'started_at': None, 'finished_at': '2026-08-16T17:06:55.129Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'e652aafceb871cb9d38ca62ebe5294ea158d1c90', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-16T17:06:55.285Z', 'started_at': None, 'finished_at': '2026-08-16T17:06:56.237Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]