vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #316
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.Bl4mIlOZ7d', fmt=raw size=107374182412(finished: start all VMs, in 74.04 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: df6462fd-28d8-47f3-8e93-3577e962c5b219gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/mj0gan6w4wfpgwa0drwdv7f0g8r90fjx-nixos-system-gitlab-test/init regInfo=/nix/store/m1pdbc9vxana27jpbw9pzyrnwvp71n31-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 453021177 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000803] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000833] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000878] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002728] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002739] Using GB pages for direct mapping73gitlab # [ 0.002841] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002848] ACPI: Early table checksum verification disabled75gitlab # [ 0.002851] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002854] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002858] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002865] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002876] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002878] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002879] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002881] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002882] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002883] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002884] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002884] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002885] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002885] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003109] No NUMA configuration found90gitlab # [ 0.003110] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003113] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005252] Zone ranges:93gitlab # [ 0.005253] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005255] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005256] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005257] Device empty97gitlab # [ 0.005258] Movable zone start for each node98gitlab # [ 0.005258] Early memory node ranges99gitlab # [ 0.005259] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005260] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005261] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005262] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005280] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005523] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.103144] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.103577] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.103593] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.103631] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.103634] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.103635] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.103637] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.103638] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.103639] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.103641] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.103642] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.103647] TSC deadline timer available117gitlab # [ 0.103652] CPU topo: Max. logical packages: 1118gitlab # [ 0.103652] CPU topo: Max. logical dies: 1119gitlab # [ 0.103653] CPU topo: Max. dies per package: 1120gitlab # [ 0.103656] CPU topo: Max. threads per core: 1121gitlab # [ 0.103657] CPU topo: Num. cores per package: 4122gitlab # [ 0.103657] CPU topo: Num. threads per package: 4123gitlab # [ 0.103658] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.103682] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.103700] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.103702] kvm-guest: setup PV sched yield127gitlab # [ 0.103718] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.103720] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.103721] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.103723] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.103724] Booting paravirtualized kernel on KVM132gitlab # [ 0.103728] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.108209] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.110214] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.110264] kvm-guest: PV spinlocks enabled136gitlab # [ 0.110266] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.110269] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/mj0gan6w4wfpgwa0drwdv7f0g8r90fjx-nixos-system-gitlab-test/init regInfo=/nix/store/m1pdbc9vxana27jpbw9pzyrnwvp71n31-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.110365] Unknown kernel command line parameters "regInfo=/nix/store/m1pdbc9vxana27jpbw9pzyrnwvp71n31-closure-info/registration", will be passed to user space.139gitlab # [ 0.110378] random: crng init done140gitlab # [ 0.110378] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.118298] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.122321] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.122397] software IO TLB: area num 4.144gitlab # [ 0.191085] Fallback order for Node 0: 0145gitlab # [ 0.191093] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.191095] Policy zone: Normal147gitlab # [ 0.193420] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.202535] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.215657] allocated 12582912 bytes of page_ext150gitlab # [ 0.225277] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.225280] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.226129] Dynamic Preempt: lazy153gitlab # [ 0.226305] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.226306] rcu: RCU event tracing is enabled.155gitlab # [ 0.226306] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.226308] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.226308] Rude variant of Tasks RCU enabled.158gitlab # [ 0.226309] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.226309] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.226310] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.226329] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.226331] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.226332] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.230646] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.230957] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.230966] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.231076] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.234657] Console: colour VGA+ 80x25169gitlab # [ 0.234660] printk: legacy console [tty0] enabled170gitlab # [ 0.265223] printk: legacy console [ttyS0] enabled171gitlab # [ 0.373621] ACPI: Core revision 20250807172gitlab # [ 0.374516] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.376128] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.377155] x2apic enabled175gitlab # [ 0.377924] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.378899] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.380203] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.381691] kvm-guest: setup PV IPIs179gitlab # [ 0.383306] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.384410] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.386221] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.387304] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.388349] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.390218] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.391222] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.392218] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.393218] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.395010] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.395981] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.397034] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.398226] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.399219] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.400219] active return thunk: srso_alias_return_thunk194gitlab # [ 0.401240] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.403218] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.404218] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.405218] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.406218] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.407218] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.408219] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.409219] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.411022] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.412011] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.413021] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.414017] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.415017] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.444754] Freeing SMP alternatives memory: 44K208gitlab # [ 0.445222] pid_max: default: 32768 minimum: 301209gitlab # [ 0.446323] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.447317] landlock: Up and running.211gitlab # [ 0.448219] Yama: becoming mindful.212gitlab # [ 0.449310] LSM support for eBPF active213gitlab # [ 0.450186] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.451354] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.454116] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.454792] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.455224] ... version: 2218gitlab # [ 0.455973] ... bit width: 48219gitlab # [ 0.456221] ... generic counters: 6220gitlab # [ 0.456996] ... generic bitmap: 000000000000003f221gitlab # [ 0.457232] ... fixed-purpose counters: 0222gitlab # [ 0.458003] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.458221] ... value mask: 0000ffffffffffff224gitlab # [ 0.459171] ... max period: 00007fffffffffff225gitlab # [ 0.459970] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.460354] signal: max sigframe size: 3376227gitlab # [ 0.461153] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.461856] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.462407] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.467734] smp: Bringing up secondary CPUs ...231gitlab # [ 0.468715] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.469224] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.473297] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.474756] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.475562] Memory: 6011580K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260112K reserved, 0K cma-reserved)236gitlab # [ 0.477222] devtmpfs: initialized237gitlab # [ 0.478257] x86/mm: Memory block size: 128MB238gitlab # [ 0.481426] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.482303] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.483323] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.484510] PM: RTC time: 07:39:22, date: 2026-09-04242gitlab # [ 0.487874] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.489542] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.490277] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.492230] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.493232] audit: initializing netlink subsys (disabled)247gitlab # [ 0.494372] audit: type=2000 audit(1788507563.265:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.494463] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.496223] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.497221] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.498206] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.499004] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.500027] cpuidle: using governor menu254gitlab # [ 0.502463] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.503470] PCI: Using configuration type 1 for base access256gitlab # [ 0.504222] PCI: Using configuration type 1 for extended access257gitlab # [ 0.505379] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.507629] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.509127] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.510108] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.511135] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.516040] ACPI: Added _OSI(Module Device)263gitlab # [ 0.518228] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.520227] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.527088] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.533810] ACPI: Interpreter enabled267gitlab # [ 0.536293] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.537228] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.539383] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.543228] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.546578] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.558933] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.561233] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.564153] acpiphp: Slot [3] registered275gitlab # [ 0.566216] acpiphp: Slot [4] registered276gitlab # [ 0.567201] acpiphp: Slot [5] registered277gitlab # [ 0.568236] acpiphp: Slot [6] registered278gitlab # [ 0.570269] acpiphp: Slot [7] registered279gitlab # [ 0.571265] acpiphp: Slot [8] registered280gitlab # [ 0.572285] acpiphp: Slot [9] registered281gitlab # [ 0.574266] acpiphp: Slot [10] registered282gitlab # [ 0.575264] acpiphp: Slot [11] registered283gitlab # [ 0.576266] acpiphp: Slot [12] registered284gitlab # [ 0.578284] acpiphp: Slot [13] registered285gitlab # [ 0.579265] acpiphp: Slot [14] registered286gitlab # [ 0.580241] acpiphp: Slot [15] registered287gitlab # [ 0.581019] acpiphp: Slot [16] registered288gitlab # [ 0.582253] acpiphp: Slot [17] registered289gitlab # [ 0.582980] acpiphp: Slot [18] registered290gitlab # [ 0.583240] acpiphp: Slot [19] registered291gitlab # [ 0.583983] acpiphp: Slot [20] registered292gitlab # [ 0.585249] acpiphp: Slot [21] registered293gitlab # [ 0.585977] acpiphp: Slot [22] registered294gitlab # [ 0.586240] acpiphp: Slot [23] registered295gitlab # [ 0.587005] acpiphp: Slot [24] registered296gitlab # [ 0.588243] acpiphp: Slot [25] registered297gitlab # [ 0.588966] acpiphp: Slot [26] registered298gitlab # [ 0.589242] acpiphp: Slot [27] registered299gitlab # [ 0.590005] acpiphp: Slot [28] registered300gitlab # [ 0.591242] acpiphp: Slot [29] registered301gitlab # [ 0.591961] acpiphp: Slot [30] registered302gitlab # [ 0.592240] acpiphp: Slot [31] registered303gitlab # [ 0.592976] PCI host bridge to bus 0000:00304gitlab # [ 0.594232] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.595415] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.598238] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.601228] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.604228] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.607301] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.610385] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.615724] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.620297] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.626299] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.628294] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.631228] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.633226] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.636227] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.639688] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.645400] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.649284] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.651747] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.654237] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.656671] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.668323] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.670235] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.671243] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.672596] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.674117] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.679262] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.680184] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.681056] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.693229] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.695662] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.699229] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.700228] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.701242] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.704509] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.707229] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.708148] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.709007] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.712475] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.715229] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.716120] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.717004] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.719437] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.725264] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.726240] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.728267] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.734588] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.742259] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.745243] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.747283] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.753751] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.761256] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.762238] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.764269] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.767237] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.771012] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.774262] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.775243] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.777442] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.781184] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.781939] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.783243] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.785453] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.790228] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.791301] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.792253] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.802590] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.805613] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.808570] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.811617] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.814438] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.820664] iommu: Default domain type: Translated375gitlab # [ 0.822227] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.826308] ACPI: bus type USB registered377gitlab # [ 0.827390] usbcore: registered new interface driver usbfs378gitlab # [ 0.830303] usbcore: registered new interface driver hub379gitlab # [ 0.832255] usbcore: registered new device driver usb380gitlab # [ 0.837082] NetLabel: Initializing381gitlab # [ 0.838226] NetLabel: domain hash size = 128382gitlab # [ 0.840224] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.842433] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.844242] PCI: Using ACPI for IRQ routing385gitlab # [ 0.846388] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.847217] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.847217] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.853235] vgaarb: loaded389gitlab # [ 0.854624] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.856225] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.861632] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.863204] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.864002] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.865719] pnp: PnP ACPI init395gitlab # [ 0.866992] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.876985] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.878627] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.879686] NET: Registered PF_INET protocol family399gitlab # [ 0.881669] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.899757] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.901317] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.902767] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.905369] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.906765] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.908368] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.910007] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.911468] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.912888] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.913945] NET: Registered PF_XDP protocol family410gitlab # [ 0.914846] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.915911] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.916982] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.918148] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.919357] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.920784] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.921792] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.924205] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.926742] PCI: CLS 0 bytes, default 64419gitlab # [ 0.927598] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.928080] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.928677] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.928805] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 0.952387] Initialise system trusted keyrings424gitlab # [ 0.953744] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.980992] Key type asymmetric registered426gitlab # [ 0.982949] Asymmetric key parser 'x509' registered427gitlab # [ 0.985192] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.988800] io scheduler mq-deadline registered429gitlab # [ 0.990758] io scheduler kyber registered430gitlab # [ 0.995984] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 0.999345] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.004960] Linux agpgart interface v0.103433gitlab # [ 1.006955] ACPI: bus type drm_connector registered434gitlab # [ 1.014186] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.016953] usbserial: USB Serial support registered for generic436gitlab # [ 1.019540] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.019540] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.025015] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.028567] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.031606] NET: Registered PF_INET6 protocol family441gitlab # [ 1.035907] Segment Routing with IPv6442gitlab # [ 1.037721] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.041951] IPI shorthand broadcast: enabled444gitlab # [ 1.052870] sched_clock: Marking stable (905036255, 147251363)->(1075647531, -23359913)445gitlab # [ 1.057113] registered taskstats version 1446gitlab # [ 1.060084] Loading compiled-in X.509 certificates447gitlab # [ 1.083818] Demotion targets for Node 0: null448gitlab # [ 1.086204] Key type .fscrypt registered449gitlab # [ 1.087977] Key type fscrypt-provisioning registered450gitlab # [ 1.090385] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.092698] ima: Allocated hash algorithm: sha1452gitlab # [ 1.094732] ima: No architecture policies found453gitlab # [ 1.097242] PM: Magic number: 10:192:672454gitlab # [ 1.101208] RAS: Correctable Errors collector initialized.455gitlab # [ 1.111382] clk: Disabling unused clocks456gitlab # [ 1.112779] PM: genpd: Disabling unused power domains457gitlab # [ 1.212560] Freeing initrd memory: 29392K458gitlab # [ 1.220100] Freeing unused decrypted memory: 2028K459gitlab # [ 1.226670] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.229473] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.234452] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.238419] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.305912] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.307187] Run /init as init process465gitlab # [ 1.321087] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.344767] fuse: init (API version 7.45)467gitlab # [ 1.353395] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.361411] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.365106] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.402295] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.738797] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.774039] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.776330] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.778441] systemd[1]: Running in initrd.475gitlab # [ 1.780987] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.783921] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.891779] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.954209] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.967991] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.969190] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.971108] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.973344] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.975488] systemd[1]: Reached target Path Units.484gitlab # [ 1.977198] systemd[1]: Reached target Slice Units.485gitlab # [ 1.978956] systemd[1]: Reached target Swaps.486gitlab # [ 1.980545] systemd[1]: Reached target Timer Units.487gitlab # [ 1.982422] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.984723] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.986173] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.987222] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.988366] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.989427] systemd[1]: Reached target Socket Units.493gitlab # [ 1.991624] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.994018] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.996054] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.001351] systemd[1]: Starting Journal Service...497gitlab # [ 2.004610] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.005886] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.009467] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.018924] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.024076] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.028584] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.032354] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config504gitlab # [ 2.032826] systemd-journald[92]: Collecting audit messages is disabled.505gitlab # [ 2.036576] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.059470] netfs: FS-Cache loaded507gitlab # [ 2.069941] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.508gitlab # [ 2.072413] 9pnet: Installing 9P2000 support509gitlab # [ 2.073545] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev510gitlab # [ 2.073750] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.511gitlab # [ 2.078394] systemd[1]: Starting Create Static Device Nodes in /dev...512gitlab # [ 2.081795] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.513gitlab # [ 2.084732] systemd[1]: Finished Load Kernel Module 9pnet_virtio.514gitlab # [ 2.086538] systemd[1]: Finished Load Kernel Modules.515gitlab # [ 2.089409] systemd[1]: Starting Apply Kernel Variables...516gitlab # [ 2.093035] systemd[1]: Finished Create Static Device Nodes in /dev.517gitlab # [ 2.094391] systemd[1]: Reached target Preparation for Local File Systems.518gitlab # [ 2.095770] systemd[1]: Reached target Local File Systems.519gitlab # [ 1.953499] systemd-modules-load[93]: Using 4 probe threads520gitlab # [ 1.955088] systemd-modules-load[93]: Inserted module 'virtio_balloon'521gitlab # [ 1.956141] systemd-modules-load[93]: Inserted module 'dm_mod'522gitlab # [ 1.957175] systemd-modules-load[93]: Inserted module 'virtio_gpu'523gitlab # [ 2.106312] systemd[1]: Starting Rule-based Manager for Device Events and Files...524gitlab # [ 2.107681] systemd[1]: Started Journal Service.525gitlab # [ 1.962218] systemd[1]: Finished Apply Kernel Variables.526gitlab # [ 1.973488] systemd[1]: Starting Create System Files and Directories...527gitlab # [ 1.982431] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.990905] systemd-udevd[104]: Using default interface naming scheme 'v261'.529gitlab # [ 1.998169] systemd[1]: Finished Coldplug All udev Devices.530gitlab # [ 2.004511] systemd[1]: Started Rule-based Manager for Device Events and Files.531gitlab # [ 2.005606] systemd[1]: Reached target System Initialization.532gitlab # [ 2.006488] systemd[1]: Reached target Basic System.533gitlab # [ 2.248618] virtio_blk virtio4: 4/0/0 default/read/poll queues534gitlab # [ 2.250786] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)535gitlab # [ 2.255049] SCSI subsystem initialized536gitlab # [ 2.262477] virtio_blk virtio5: 4/0/0 default/read/poll queues537gitlab # [ 2.263541] uhci_hcd 0000:00:01.2: UHCI Host Controller538gitlab # [ 2.263556] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1539gitlab # [ 2.263582] uhci_hcd 0000:00:01.2: detected 2 ports540gitlab # [ 2.268691] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140541gitlab # [ 2.270706] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18542gitlab # [ 2.272004] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1543gitlab # [ 2.273167] usb usb1: Product: UHCI Host Controller544gitlab # [ 2.274010] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd545gitlab # [ 2.274895] usb usb1: SerialNumber: 0000:00:01.2546gitlab # [ 2.284981] virtio_blk virtio5: [vdb] 11842888 512-byte logical blocks (6.06 GB/5.65 GiB)547gitlab # [ 2.289379] hub 1-0:1.0: USB hub found548gitlab # [ 2.290408] hub 1-0:1.0: 2 ports detected549gitlab # [ 2.318747] scsi host0: ata_piix550gitlab # [ 2.321337] scsi host1: ata_piix551gitlab # [ 2.322075] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0552gitlab # [ 2.322222] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12553gitlab # [ 2.322791] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0554gitlab # [ 2.327098] serio: i8042 KBD port at 0x60,0x64 irq 1555gitlab # [ 2.327861] serio: i8042 AUX port at 0x60,0x64 irq 12556gitlab # [ 2.186743] (udev-worker)[140]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.191134] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 2.200265] (udev-worker)[122]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.559gitlab # [ 2.203173] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.204498] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.205696] systemd[1]: Reached target Initrd Root Device.562gitlab # [ 2.206468] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...563gitlab # [ 2.212801] systemd[1]: Found device /dev/disk/by-label/nix-store.564gitlab # [ 2.220729] systemd-vconsole-setup[152]: Configuration of first virtual console was skipped, ignoring remaining ones.565gitlab # [ 2.223285] systemd[1]: Finished Virtual Console Setup.566gitlab # [ 2.230813] systemd-fsck[158]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.234686] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.481723] ata2: found unknown device (class 0)569gitlab # [ 2.484025] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100570gitlab # [ 2.487909] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5571gitlab # [ 2.513354] usb 1-1: new full-speed USB device number 2 using uhci_hcd572gitlab # [ 2.516858] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573gitlab # [ 2.546737] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.573919] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.682685] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.685819] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.688478] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.690108] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.691608] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.723680] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.736939] usbcore: registered new interface driver usbhid582gitlab # [ 2.739062] usbhid: USB HID core driver583gitlab # [ 2.748789] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.752878] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.873494] systemd[1]: Mounting /sysroot...586gitlab # [ 3.191710] EXT4-fs (vda): mounted filesystem df6462fd-28d8-47f3-8e93-3577e962c5b2 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.052121] systemd[1]: Mounted /sysroot.588gitlab # [ 3.053612] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.055548] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.057576] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.059519] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.062192] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.072138] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.073570] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.084544] systemd-sysroot-fstab-check[177]: /sysroot should be mounted in the initrd, will request daemon-reload.596gitlab # [ 3.087325] systemd[1]: Reload requested from client PID 177 ('systemd-sysroot') (unit initrd-parse-etc.service)...597gitlab # [ 3.090487] systemd[1]: Reloading...598gitlab # [ 3.247932] 9p: Installing v9fs 9p2000 file system support599gitlab # [ 3.248897] erofs (device vdb): mounted with root inode @ nid 128.600gitlab # [ 3.158134] systemd[1]: Reloading finished in 69 ms.601gitlab # [ 3.183476] systemd-sysroot-fstab-check[177]: Requesting initrd-fs.target/start/replace...602gitlab # [ 3.186394] systemd[1]: Mounted /sysroot/nix/.ro-store.603gitlab # [ 3.188301] systemd[1]: Mounted /sysroot/nix/.rw-store.604gitlab # [ 3.190288] systemd[1]: Mounted /sysroot/run.605gitlab # [ 3.191907] systemd[1]: Mounted /sysroot/tmp/shared.606gitlab # [ 3.193652] systemd[1]: Mounted /sysroot/tmp/xchg.607gitlab # [ 3.196100] systemd-sysroot-fstab-check[177]: Requesting swap.target/start/replace...608gitlab # [ 3.198659] systemd[1]: Starting rw-sysroot-nix-store.service...609gitlab # [ 3.200666] systemd[1]: initrd-parse-etc.service: Deactivated successfully.610gitlab # [ 3.202822] systemd[1]: Finished Mountpoints Configured in the Real Root.611gitlab # [ 3.205272] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.612gitlab # [ 3.209547] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.613gitlab # [ 3.212285] systemd[1]: Finished rw-sysroot-nix-store.service.614gitlab # [ 3.214599] systemd[1]: Mounting /sysroot/nix/store...615gitlab # [ 3.255480] systemd[1]: Mounted /sysroot/nix/store.616gitlab # [ 3.257158] systemd[1]: Reached target Initrd File Systems.617gitlab # [ 3.258923] systemd[1]: Starting Find NixOS closure...618gitlab # [ 3.260950] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...619gitlab # [ 3.289140] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.620gitlab # [ 3.305769] systemd[1]: Finished Find NixOS closure.621gitlab # [ 3.307729] systemd[1]: Reached target Initrd Default Target.622gitlab # [ 3.309882] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...623gitlab # [ 3.341144] systemd[1]: Stopped target Initrd Default Target.624gitlab # [ 3.343330] systemd[1]: Stopped target Basic System.625gitlab # [ 3.345202] systemd[1]: Stopped target Initrd Root Device.626gitlab # [ 3.347321] systemd[1]: Stopped target Path Units.627gitlab # [ 3.349294] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.628gitlab # [ 3.352237] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.629gitlab # [ 3.355322] systemd[1]: Stopped target Slice Units.630gitlab # [ 3.357476] systemd[1]: Stopped target Socket Units.631gitlab # [ 3.359628] systemd[1]: Stopped target System Initialization.632gitlab # [ 3.361953] systemd[1]: Stopped target Swaps.633gitlab # [ 3.364143] systemd[1]: Stopped target Timer Units.634gitlab # [ 3.366286] systemd[1]: dbus.socket: Deactivated successfully.635gitlab # [ 3.368640] systemd[1]: Closed D-Bus System Message Bus Socket.636gitlab # [ 3.371186] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.637gitlab # [ 3.374185] systemd[1]: Stopped Find NixOS closure.638gitlab # [ 3.375856] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio639gitlab # [ 3.379602] systemd[1]: Starting rw-sysroot-nix-store.service...640gitlab # [ 3.381618] systemd[1]: systemd-sysctl.service: Deactivated successfully.641gitlab # [ 3.383853] systemd[1]: Stopped Apply Kernel Variables.642gitlab # [ 3.385637] systemd[1]: systemd-modules-load.service: Deactivated successfully.643gitlab # [ 3.388037] systemd[1]: Stopped Load Kernel Modules.644gitlab # [ 3.389825] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.645gitlab # [ 3.392352] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.646gitlab # [ 3.394328] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.647gitlab # [ 3.396194] systemd[1]: Stopped Create System Files and Directories.648gitlab # [ 3.397759] systemd[1]: Stopped target Local File Systems.649gitlab # [ 3.399167] systemd[1]: Stopped target Preparation for Local File Systems.650gitlab # [ 3.400821] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.651gitlab # [ 3.402603] systemd[1]: Stopped Coldplug All udev Devices.652gitlab # [ 3.403925] systemd[1]: Stopping Rule-based Manager for Device Events and Files...653gitlab # [ 3.405789] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.654gitlab # [ 3.407636] systemd[1]: Stopped Virtual Console Setup.655gitlab # [ 3.408960] systemd[1]: initrd-cleanup.service: Deactivated successfully.656gitlab # [ 3.410433] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.657gitlab # [ 3.411493] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.658gitlab # [ 3.412506] systemd[1]: Finished rw-sysroot-nix-store.service.659gitlab # [ 3.413343] systemd[1]: systemd-udevd.service: Deactivated successfully.660gitlab # [ 3.414260] systemd[1]: Stopped Rule-based Manager for Device Events and Files.661gitlab # [ 3.415300] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.662gitlab # [ 3.416243] systemd[1]: Closed udev Control Socket.663gitlab # [ 3.416948] systemd[1]: Starting Cleanup udev Database...664gitlab # [ 3.417730] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.665gitlab # [ 3.418789] systemd[1]: Stopped Create Static Device Nodes in /dev.666gitlab # [ 3.419659] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.667gitlab # [ 3.420751] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.668gitlab # [ 3.421768] systemd[1]: kmod-static-nodes.service: Deactivated successfully.669gitlab # [ 3.422732] systemd[1]: Stopped Create List of Static Device Nodes.670gitlab # [ 3.423553] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.671gitlab # [ 3.424543] systemd[1]: Finished Cleanup udev Database.672gitlab # [ 3.425244] systemd[1]: Reached target Switch Root.673gitlab # [ 3.425961] systemd[1]: Starting NixOS Activation...674gitlab # [ 3.530816] initrd-nixos-activation-start[231]: booting system configuration /nix/store/mj0gan6w4wfpgwa0drwdv7f0g8r90fjx-nixos-system-gitlab-test675gitlab # [ 3.566898] initrd-nixos-activation-start[231]: running activation script...676gitlab # [ 3.805153] initrd-nixos-activation-start[254]: setting up /etc...677gitlab # [ 3.906059] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.678gitlab # [ 3.907449] systemd[1]: Finished NixOS Activation.679gitlab # [ 3.909818] systemd[1]: Starting Switch Root...680gitlab # [ 3.941734] systemd[1]: Switching root.681gitlab # [ 4.155705] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).682gitlab # [ 4.296175] NET: Registered PF_VSOCK protocol family683gitlab # [ 4.677017] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)684gitlab # [ 4.687118] systemd[1]: Detected virtualization kvm.685gitlab # [ 4.689012] systemd[1]: Detected architecture x86-64.686gitlab # [ 4.691032] systemd[1]: Detected first boot.687gitlab # [ 4.693678] systemd[1]: Initializing machine ID from random generator.688gitlab # [ 4.862081] systemd[1]: bpf-restrict-fs: LSM BPF program attached689gitlab # [ 4.954981] systemd[1]: Applying preset policy.690gitlab # [ 5.108664] systemd[1]: Populated /etc with preset unit settings.691gitlab # [ 5.229414] systemd[1]: initrd-switch-root.service: Deactivated successfully.692gitlab # [ 5.230932] systemd[1]: Stopped initrd-switch-root.service.693gitlab # [ 5.233115] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.694gitlab # [ 5.235671] systemd[1]: Created slice Slice /system/getty.695gitlab # [ 5.237276] systemd[1]: Created slice GitLab DevOps Platform Slice.696gitlab # [ 5.238884] systemd[1]: Created slice User and Session Slice.697gitlab # [ 5.239965] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.698gitlab # [ 5.241457] systemd[1]: Started Forward Password Requests to Wall Directory Watch.699gitlab # [ 5.242833] systemd[1]: Expecting device /dev/hvc0...700gitlab # [ 5.243703] systemd[1]: Expecting device /dev/ttyS0...701gitlab # [ 5.244625] systemd[1]: Reached target Local Encrypted Volumes.702gitlab # [ 5.245458] systemd[1]: Stopped target initrd-fs.target.703gitlab # [ 5.246266] systemd[1]: Stopped target initrd-root-fs.target.704gitlab # [ 5.247110] systemd[1]: Stopped target initrd-switch-root.target.705gitlab # [ 5.248046] systemd[1]: Reached target Virtual Machines and Containers.706gitlab # [ 5.249002] systemd[1]: Reached target Path Units.707gitlab # [ 5.249758] systemd[1]: Reached target Remote File Systems.708gitlab # [ 5.250556] systemd[1]: Reached target Slice Units.709gitlab # [ 5.251358] systemd[1]: Reached target Swaps.710gitlab # [ 5.252807] systemd[1]: Listening on Query the User Interactively for a Password.711gitlab # [ 5.254847] systemd[1]: Listening on Process Core Dump Socket.712gitlab # [ 5.256253] systemd[1]: Listening on Credential Encryption/Decryption.713gitlab # [ 5.257807] systemd[1]: Listening on Factory Reset Management.714gitlab # [ 5.258747] systemd[1]: Listening on Hostname Service Socket.715gitlab # [ 5.261072] systemd[1]: Starting Journal Log Access Socket...716gitlab # [ 5.262415] systemd[1]: Listening on Journal Audit Socket.717gitlab # [ 5.264369] systemd[1]: Listening on Console Output Muting Service Socket.718gitlab # [ 5.265581] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.719gitlab # [ 5.266716] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os720gitlab # [ 5.268084] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki721gitlab # [ 5.270951] systemd[1]: Listening on Disk Repartitioning Service Socket.722gitlab # [ 5.272082] systemd[1]: Listening on udev Control Socket.723gitlab # [ 5.273003] systemd[1]: Listening on udev Varlink Socket.724gitlab # [ 5.276178] systemd[1]: Mounting Huge Pages File System...725gitlab # [ 5.278206] systemd[1]: Mounting POSIX Message Queue File System...726gitlab # [ 5.280506] systemd[1]: Mounting Kernel Debug File System...727gitlab # [ 5.284074] systemd[1]: Mounting Kernel Trace File System...728gitlab # [ 5.295783] systemd[1]: Starting Create List of Static Device Nodes...729gitlab # [ 5.298454] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio730gitlab # [ 5.313417] systemd[1]: Starting Load Kernel Module configfs...731gitlab # [ 5.317312] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm732gitlab # [ 5.330636] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore733gitlab # [ 5.332205] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse734gitlab # [ 5.344406] systemd[1]: Mounting FUSE Control File System...735gitlab # [ 5.346700] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67736gitlab # [ 5.356556] systemd[1]: Starting Journal Service...737gitlab # [ 5.360990] systemd[1]: Starting Load Kernel Modules...738gitlab # [ 5.366780] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...739gitlab # [ 5.372446] systemd[1]: Starting Remount Root and Kernel File Systems...740gitlab # [ 5.374007] systemd-journald[324]: Collecting audit messages is enabled.741gitlab # [ 5.374845] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os742gitlab # [ 5.387298] systemd[1]: Starting Coldplug All udev Devices...743gitlab # [ 5.391566] EXT4-fs (vda): re-mounted df6462fd-28d8-47f3-8e93-3577e962c5b2.744gitlab # [ 5.246573] systemd[1]: Queued start job for default target M[ 5.394771] loop: module loaded745gitlab # ulti-User System.746gitlab # [ 5.249574] s[ 5.396656] systemd[1]: Started Journal Service.747gitlab # ystemd[1]: Unnecessary job was removed for /dev/vdb.748gitlab # [ 5.252301] systemd[1]: systemd-journald.service: Deactivated successfully.749gitlab # [ 5.254749] systemd-modules-load[326]: Using 3 probe threads750gitlab # [ 5.256723] systemd[1]: Listening on Journal Log Access Socket.751gitlab # [ 5.258683] systemd[1]: Mounted Huge Pages File System.752gitlab # [ 5.260426] systemd[1]: Mounted POSIX Message Queue File System.753gitlab # [ 5.263369] systemd[1]: Mounted Kernel Debug File System.754gitlab # [ 5.264969] systemd[1]: Mounted Kernel Trace File System.755gitlab # [ 5.266612] systemd[1]: Finished Create List of Static Device Nodes.756gitlab # [ 5.268875] systemd[1]: modprobe@configfs.service: Deactivated successfully.757gitlab # [ 5.271274] systemd[1]: Finished Load Kernel Module configfs.758gitlab # [ 5.274320] systemd[1]: Mounted FUSE Control File System.759gitlab # [ 5.276399] systemd[1]: Finished Remount Root and Kernel File Systems.760gitlab # [ 5.278380] systemd[1]: Listening on Disk Image Download Service Socket.761gitlab # [ 5.279698] systemd[1]: Mounting Kernel Configuration File System...762gitlab # [ 5.280954] systemd-modules-load[326]: Inserted module 'loop'763gitlab # [ 5.281898] systemd-modules-load[326]: Inserted module 'tls'764gitlab # [ 5.282867] systemd[1]: Starting Flush Journal to Persistent Storage...765gitlab # [ 5.284078] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore766gitlab # [ 5.433120] systemd-journald[324]: Received client request to flush runtime journal.767gitlab # [ 5.325092] systemd[1]: Starting Load/Save OS Random Seed...768gitlab # [ 5.327179] systemd-oomd[327]: No swap; memory pressure usage will be degraded769gitlab # [ 5.328701] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...770gitlab # [ 5.330968] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os771gitlab # [ 5.332450] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.772gitlab # [ 5.333585] systemd[1]: Finished Load Kernel Modules.773gitlab # [ 5.334400] systemd[1]: Mounted Kernel Configuration File System.774gitlab # [ 5.335295] systemd[1]: Starting Firewall...775gitlab # [ 5.335953] systemd[1]: Starting Apply Kernel Variables...776gitlab # [ 5.336754] systemd[1]: Finished Load/Save OS Random Seed.777gitlab # [ 5.337544] systemd[1]: Reached target First Boot Complete.778gitlab # [ 5.338346] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.779gitlab # [ 5.339535] systemd[1]: Starting Create Static Device Nodes in /dev...780gitlab # [ 5.340446] systemd[1]: Finished Apply Kernel Variables.781gitlab # [ 5.341201] systemd[1]: Finished Create Static Device Nodes in /dev.782gitlab # [ 5.342118] systemd[1]: Finished Flush Journal to Persistent Storage.783gitlab # [ 5.343049] systemd[1]: Reached target Preparation for Local File Systems.784gitlab # [ 5.343988] systemd[1]: Starting Rule-based Manager for Device Events and Files...785gitlab # [ 5.365106] systemd-udevd[359]: Using default interface naming scheme 'v261'.786gitlab # [ 5.415295] systemd[1]: Finished Coldplug All udev Devices.787gitlab # [ 5.438344] systemd[1]: Started Rule-based Manager for Device Events and Files.788gitlab # [ 5.522129] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse789gitlab # [ 5.557529] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.790gitlab # [ 5.573911] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.791gitlab # [ 5.596515] (udev-worker)[401]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.792gitlab # [ 5.601755] (udev-worker)[383]: Network interface NamePolicy= disabled on kernel command line.793gitlab # [ 5.603299] (udev-worker)[401]: Network interface NamePolicy= disabled on kernel command line.794gitlab # [ 5.621419] systemd[1]: Condition check resulted in Virtio network device being skipped.795gitlab # [ 5.628865] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore796gitlab # [ 5.630465] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67797gitlab # [ 5.632940] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore798gitlab # [ 5.634610] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os799gitlab # [ 5.635914] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os800gitlab # [ 5.785774] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3801gitlab # [ 5.785847] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console802gitlab # [ 5.790299] ACPI: button: Power Button [PWRF]803gitlab # [ 5.809642] Console: switching to colour dummy device 80x25804gitlab # [ 5.811542] [drm] Found bochs VGA, ID 0xb0c5.805gitlab # [ 5.812086] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.806gitlab # [ 5.814191] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0807gitlab # [ 5.814301] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic808gitlab # [ 5.815062] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD809gitlab # [ 5.815699] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0810gitlab # [ 5.841542] Console: switching to colour frame buffer device 160x50811gitlab # [ 5.843066] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device812gitlab # [ 5.846777] rtc_cmos 00:05: RTC can wake from S4813gitlab # [ 5.847434] parport_pc 00:03: reported by Plug and Play ACPI814gitlab # [ 5.848242] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]815gitlab # [ 5.853582] Floppy drive(s): fd0 is 2.88M AMI BIOS816gitlab # [ 5.854886] rtc_cmos 00:05: registered as rtc0817gitlab # [ 5.855553] rtc_cmos 00:05: setting system clock to 2026-09-04T07:39:28 UTC (1788507568)818gitlab # [ 5.856761] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs819gitlab # [ 5.860640] systemd-journald[324]: Time jumped backwards, rotating.820gitlab # [ 5.864609] FDC 0 is a S82078B821gitlab # [ 5.868067] mousedev: PS/2 mouse device common for all mice822gitlab # [ 5.885828] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4823gitlab # [ 5.758731] systemd[1]: Finished Firewall.824gitlab # [ 5.908026] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6825gitlab # [ 5.943989] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5826gitlab # [ 5.828964] systemd[1]: Starting Virtual Console Setup...827gitlab # [ 5.838466] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.828gitlab # [ 5.840312] systemd[1]: Stopped Virtual Console Setup.829gitlab # [ 5.847061] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 5.855723] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.831gitlab # [ 5.857453] systemd[1]: Stopped Virtual Console Setup.832gitlab # [ 6.006402] ppdev: user-space parallel port driver833gitlab # [ 5.860189] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.042261] kvm_amd: TSC scaling supported835gitlab # [ 6.042819] kvm_amd: Nested Virtualization enabled836gitlab # [ 6.043372] kvm_amd: Nested Paging enabled837gitlab # [ 6.043862] kvm_amd: LBR virtualization supported838gitlab # [ 6.044458] kvm_amd: Virtual VMLOAD VMSAVE supported839gitlab # [ 6.045087] kvm_amd: Virtual GIF supported840gitlab # [ 6.045646] kvm_amd: Virtual NMI enabled841gitlab # [ 6.081679] EDAC MC: Ver: 3.0.0842gitlab # [ 5.950149] systemd-vconsole-setup[499]: Configuration of first virtual console was skipped, ignoring remaining ones.843gitlab # [ 5.952939] systemd[1]: Finished Virtual Console Setup.844gitlab # [ 6.087273] systemd[1]: Mounting /run/wrappers...845gitlab # [ 6.114167] systemd[1]: Mounted /run/wrappers.846gitlab # [ 6.116499] systemd[1]: Reached target Local File Systems.847gitlab # [ 6.118389] systemd[1]: Listening on Boot Loader Control Service Socket.848gitlab # [ 6.120964] systemd[1]: Starting register-nix-paths.service...849gitlab # [ 6.123478] systemd[1]: Starting Create SUID/SGID Wrappers...850gitlab # [ 6.125484] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.851gitlab # [ 6.130461] systemd[1]: Starting Save Transient machine-id to Disk...852gitlab # [ 6.132822] systemd[1]: Starting Create System Files and Directories...853gitlab # [ 6.169920] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.854gitlab # [ 6.175601] systemd[1]: Finished Save Transient machine-id to Disk.855gitlab # [ 6.180995] systemd[1]: Finished Create System Files and Directories.856gitlab # [ 6.183624] systemd[1]: Starting Rebuild Journal Catalog...857gitlab # [ 6.185482] systemd[1]: Starting Record System Boot/Shutdown in UTMP...858gitlab # [ 6.201839] systemd[1]: Finished Record System Boot/Shutdown in UTMP.859gitlab # [ 6.220298] systemd[1]: Finished Rebuild Journal Catalog.860gitlab # [ 6.222919] systemd[1]: Starting Update is Completed...861gitlab # [ 6.238883] systemd[1]: Finished Update is Completed.862gitlab # [ 6.287140] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.863gitlab # [ 6.289508] systemd[1]: Finished Create SUID/SGID Wrappers.864gitlab # [ 6.595277] systemd[1]: Finished register-nix-paths.service.865gitlab # [ 6.597717] systemd[1]: Reached target System Initialization.866gitlab # [ 6.599879] systemd[1]: Started Discard unused filesystem blocks once a week.867gitlab # [ 6.602493] systemd[1]: Started logrotate.timer.868gitlab # [ 6.604404] systemd[1]: Started Daily Cleanup of Temporary Directories.869gitlab # [ 6.606735] systemd[1]: Reached target Timer Units.870gitlab # [ 6.608575] systemd[1]: Listening on D-Bus System Message Bus Socket.871gitlab # [ 6.610866] systemd[1]: Listening on Nix Daemon Socket.872gitlab # [ 6.612937] systemd[1]: Starting nixbot CI service socket...873gitlab # [ 6.615389] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.874gitlab # [ 6.618504] systemd[1]: Starting D-Bus System Message Bus...875gitlab # [ 6.620539] systemd[1]: Listening on nixbot CI service socket.876gitlab # [ 6.622521] systemd[1]: Reached target Socket Units.877gitlab # [ 6.682420] dbus-broker-launch[581]: Looking up NSS user entry for 'systemd-timesync'...878gitlab # [ 6.685570] dbus-broker-launch[581]: NSS returned no entry for 'systemd-timesync'879gitlab # [ 6.688374] dbus-broker-launch[581]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"880gitlab # [ 6.693779] systemd[1]: Started D-Bus System Message Bus.881gitlab # [ 6.715994] dbus-broker-launch[581]: Ready882gitlab # [ 6.719471] systemd[1]: Reached target Basic System.883gitlab # [ 6.722723] systemd[1]: Started backdoor.service.884gitlab # [ 6.725627] systemd[1]: Starting gitlab-config.service...885gitlab # [ 6.730540] systemd[1]: Starting Import lastlog data into lastlog2 database...886gitlab # [ 6.744223] systemd[1]: Starting Logrotate configuration check...887gitlab # [ 6.752354] systemd[1]: Starting Name Service Cache Daemon (nsncd)...888gitlab # [ 6.757573] systemd[1]: Starting Post-Boot Actions...889gitlab # [ 6.760057] systemd[1]: Started Reset console on configuration changes.890gitlab # [ 6.770416] systemd[1]: Starting resolvconf update...891gitlab # connecting to host...892gitlab: Guest shell says: b'Spawning backdoor root shell...\n'893gitlab # [ 6.778615] logrotate[586]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.894gitlab # [ 6.787277] logrotate[586]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf895gitlab: connected to guest root shell896gitlab # [ 6.788517] logrotate[586]: note: 'monthly' overrides previously specified 'weekly'897gitlab: (connecting took 7.40 seconds)898gitlab # [ 6.789648] logrotate[586]: Reading state from file: /var/lib/logrotate.status899gitlab: (finished: waiting for the VM to finish booting, in 7.40 seconds)900gitlab # [ 6.789937] logrotate[586]: state file /var/lib/logrotate.status does not exist901gitlab # [ 6.790602] logrotate[586]: Allocating hash table for state file, size 64 entries902gitlab # [ 6.791093] logrotate[586]: Handling 4 logs903gitlab # [ 6.791499] logrotate[586]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed904gitlab # [ 6.793246] logrotate[586]: considering log /var/log/btmp905gitlab # [ 6.794168] logrotate[586]: Creating new state906gitlab # [ 6.794804] logrotate[586]: Now: 2026-09-04 07:39907gitlab # [ 6.795387] logrotate[586]: Last rotated at 2026-09-04 07:00908gitlab # [ 6.795832] logrotate[586]: log does not need rotating (log has already been rotated)909gitlab # [ 6.796418] logrotate[586]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed910gitlab # [ 6.798214] logrotate[586]: considering log /var/log/wtmp911gitlab # [ 6.798927] logrotate[586]: Creating new state912gitlab # [ 6.799518] logrotate[586]: Now: 2026-09-04 07:39913gitlab # [ 6.800339] logrotate[586]: Last rotated at 2026-09-04 07:00914gitlab # [ 6.800831] logrotate[586]: log does not need rotating (log has already been rotated)915gitlab # [ 6.801499] logrotate[586]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed916gitlab # [ 6.802720] logrotate[586]: switching euid from 0 to 165 and egid from 0 to 165 (pid 586)917gitlab # [ 6.803480] logrotate[586]: considering log /var/gitlab/state/log/*.log918gitlab # [ 6.803973] logrotate[586]: log /var/gitlab/state/log/*.log does not exist -- skipping919gitlab # [ 6.804630] logrotate[586]: Creating new state920gitlab # [ 6.805114] logrotate[586]: switching euid from 165 to 0 and egid from 165 to 0 (pid 586)921gitlab # [ 6.805611] logrotate[586]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed922gitlab # [ 6.806108] logrotate[586]: switching euid from 0 to 60 and egid from 0 to 60 (pid 586)923gitlab # [ 6.806570] logrotate[586]: considering log /var/log/nginx/*.log924gitlab # [ 6.807093] logrotate[586]: log /var/log/nginx/*.log does not exist -- skipping925gitlab # [ 6.807538] logrotate[586]: Creating new state926gitlab # [ 6.808069] logrotate[586]: not running postrotate script, since no logs were rotated927gitlab # [ 6.808510] logrotate[586]: switching euid from 60 to 0 and egid from 60 to 0 (pid 586)928gitlab # [ 6.809113] systemd[1]: Finished Logrotate configuration check.929gitlab # [ 6.809729] systemd[1]: Finished Post-Boot Actions.930gitlab # [ 6.810591] systemd[1]: Finished Import lastlog data into lastlog2 database.931gitlab # [ 6.818616] nsncd[587]: Sep 04 07:39:29.609 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"932gitlab # [ 6.820920] systemd[1]: Started Name Service Cache Daemon (nsncd).933gitlab # [ 6.825746] systemd[1]: Reached target Host and Network Name Lookups.934gitlab # [ 6.827024] systemd[1]: Reached target User and Group Name Lookups.935gitlab # [ 6.830166] systemd[1]: Starting User Login Management...936gitlab # [ 6.872836] systemd-logind[626]: New seat seat0.937gitlab # [ 6.875146] systemd-logind[626]: Watching system buttons on /dev/input/event2 (Power Button)938gitlab # [ 6.876073] systemd-logind[626]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)939gitlab # [ 6.876650] systemd-logind[626]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)940gitlab # [ 6.879091] systemd[1]: Started User Login Management.941gitlab # [ 6.881700] systemd[1]: Stopped target Host and Network Name Lookups.942gitlab # [ 6.882232] systemd[1]: Stopping Host and Network Name Lookups...943gitlab # [ 6.882917] systemd[1]: Stopped target User and Group Name Lookups.944gitlab # [ 6.883613] systemd[1]: Stopping User and Group Name Lookups...945gitlab # [ 6.885558] systemd[1]: Starting linger-users.service...946gitlab # [ 6.886507] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...947gitlab # [ 6.888670] systemd[1]: nscd.service: Deactivated successfully.948gitlab # [ 6.889862] systemd[1]: Stopped Name Service Cache Daemon (nsncd).949gitlab # [ 6.890367] systemd[1]: nscd.service: Consumed 23ms CPU time over 139ms wall clock time, 7.4M memory peak, 5.5M read from disk.950gitlab # [ 6.894128] systemd[1]: Starting Name Service Cache Daemon (nsncd)...951gitlab # [ 6.900056] systemd[1]: linger-users.service: Deactivated successfully.952gitlab # [ 6.905500] systemd[1]: Finished linger-users.service.953gitlab # [ 6.915769] nsncd[679]: Sep 04 07:39:29.706 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"954gitlab # [ 6.916062] systemd[1]: Started Name Service Cache Daemon (nsncd).955gitlab # [ 6.916681] systemd[1]: Reached target Host and Network Name Lookups.956gitlab # [ 6.917152] systemd[1]: Reached target User and Group Name Lookups.957gitlab # [ 6.922917] systemd[1]: Finished resolvconf update.958gitlab # [ 6.923822] systemd[1]: Reached target Preparation for Network.959gitlab # [ 6.925429] systemd[1]: Starting DHCP Client...960gitlab # [ 6.927682] systemd[1]: Starting Address configuration of eth1...961gitlab # [ 6.928292] systemd[1]: Starting Extra networking commands....962gitlab # [ 6.960749] network-addresses-eth1-start[704]: adding address 192.168.1.1/24... done963gitlab # [ 6.966763] network-addresses-eth1-start[704]: adding address 2001:db8:1::1/64... done964gitlab # [ 6.971541] systemd[1]: Finished Address configuration of eth1.965gitlab # [ 6.997626] dhcpcd[710]: dhcpcd-10.3.2 starting966gitlab # [ 6.999924] dhcpcd[767]: dev: loaded udev967gitlab # [ 7.001854] systemd[1]: Finished Extra networking commands..968gitlab # [ 7.002872] systemd[1]: Reached target Network.969gitlab # [ 7.003961] systemd[1]: Starting gitlab-workhorse.service...970gitlab # [ 7.153172] 8021q: 802.1Q VLAN Support v1.8971gitlab # [ 7.006245] systemd[1]: Starting Nginx Web Server...972gitlab # [ 7.153980] 8021q: adding VLAN 0 to HW filter on device eth1973gitlab # [ 7.009525] systemd[1]: Starting PostgreSQL Server...974gitlab # [ 7.011807] systemd[1]: Starting Redis Server - redis-gitlab...975gitlab # [ 7.014964] systemd[1]: Starting Permit User Sessions...976gitlab # [ 7.024125] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.977gitlab # [ 7.030819] systemd[1]: Finished Permit User Sessions.978gitlab # [ 7.039304] systemd[1]: Started Getty on tty1.979gitlab # [ 7.040442] systemd[1]: Reached target Login Prompts.980gitlab # [ 7.251592] cfg80211: Loading compiled-in X.509 certificates for regulatory database981gitlab # [ 7.256978] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'982gitlab # [ 7.258376] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'983gitlab # [ 7.260700] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2984gitlab # [ 7.261951] cfg80211: failed to load regulatory.db985gitlab # [ 7.136305] nginx-pre-start[792]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok986gitlab # [ 7.137319] nginx-pre-start[792]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful987gitlab # [ 7.289816] 8021q: adding VLAN 0 to HW filter on device eth0988gitlab # [ 7.144038] systemd[1]: Started Nginx Web Server.989gitlab # [ 7.146310] dhcpcd[767]: eth0: waiting for carrier990gitlab # [ 7.146902] dhcpcd[767]: eth0: carrier acquired991gitlab # [ 7.149829] dhcpcd[767]: DUID 00:01:00:01:32:2d:32:31:52:54:00:12:34:56992gitlab # [ 7.150336] dhcpcd[767]: eth0: IAID 00:12:34:56993gitlab # [ 7.151087] dhcpcd[767]: eth0: adding address fe80::5054:ff:fe12:3456994gitlab # [ 7.160444] postgresql-pre-start[793]: The files belonging to this database system will be owned by user "postgres".995gitlab # [ 7.160836] postgresql-pre-start[793]: This user must also own the server process.996gitlab # [ 7.164097] postgresql-pre-start[793]: The database cluster will be initialized with locale "en_US.UTF-8".997gitlab # [ 7.165123] postgresql-pre-start[793]: The default database encoding has accordingly been set to "UTF8".998gitlab # [ 7.165384] postgresql-pre-start[793]: The default text search configuration will be set to "english".999gitlab # [ 7.165920] postgresql-pre-start[793]: Data page checksums are enabled.1000gitlab # [ 7.166660] postgresql-pre-start[793]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1001gitlab # [ 7.167621] postgresql-pre-start[793]: creating subdirectories ... ok1002gitlab # [ 7.168158] postgresql-pre-start[793]: selecting dynamic shared memory implementation ... posix1003gitlab # [ 7.172690] redis-server[796]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1004gitlab # [ 7.173080] redis-server[796]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1005gitlab # [ 7.173508] redis-server[796]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=796, just started1006gitlab # [ 7.174035] redis-server[796]: Configuration loaded1007gitlab # [ 7.174470] redis[796]: monotonic clock: POSIX clock_gettime1008gitlab # [ 7.175571] redis[796]: Running mode=standalone, port=0.1009gitlab # [ 7.177235] redis[796]: Server initialized1010gitlab # [ 7.178698] redis[796]: Ready to accept connections unix1011gitlab # [ 7.179818] systemd[1]: Started Redis Server - redis-gitlab.1012gitlab # [ 7.180546] redis[796]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1013gitlab # [ 7.209245] postgresql-pre-start[793]: selecting default "max_connections" ... 1001014gitlab # [ 7.255607] postgresql-pre-start[793]: selecting default "shared_buffers" ... 128MB1015gitlab # [ 7.553250] systemd[1]: Started gitlab-workhorse.service.1016gitlab # [ 7.663196] postgresql-pre-start[793]: selecting default time zone ... UTC1017gitlab # [ 7.666292] postgresql-pre-start[793]: creating configuration files ... ok1018gitlab # [ 7.793346] dhcpcd[767]: eth0: soliciting a DHCP lease1019gitlab # [ 7.947472] NET: Registered PF_PACKET protocol family1020gitlab # [ 7.806722] dhcpcd[767]: eth0: offered 10.0.2.15 from 10.0.2.21021gitlab # [ 7.812272] dhcpcd[767]: eth0: probing address 10.0.2.15/241022gitlab # [ 7.817851] gitlab-workhorse[829]: time="2026-09-04T07:39:30Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41023gitlab # [ 7.818227] gitlab-workhorse[829]: time="2026-09-04T07:39:30Z" level=info msg="Using redis/go-redis"1024gitlab # [ 7.819173] gitlab-workhorse[829]: time="2026-09-04T07:39:30Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1025gitlab # [ 7.837195] postgresql-pre-start[793]: running bootstrap script ... ok1026gitlab # [ 8.272897] postgresql-pre-start[793]: performing post-bootstrap initialization ... ok1027gitlab # [ 8.674749] postgresql-pre-start[793]: syncing data to disk ... ok1028gitlab # [ 8.677345] postgresql-pre-start[793]: initdb: warning: enabling "trust" authentication for local connections1029gitlab # [ 8.680853] postgresql-pre-start[793]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1030gitlab # [ 8.686191] postgresql-pre-start[793]: Success. You can now start the database server using:1031gitlab # [ 8.689220] postgresql-pre-start[793]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1032gitlab # [ 8.788228] postgres[855]: [855] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1033gitlab # [ 8.793442] postgres[855]: [855] LOG: listening on IPv6 address "::1", port 54321034gitlab # [ 8.796526] postgres[855]: [855] LOG: listening on IPv4 address "127.0.0.1", port 54321035gitlab # [ 8.799668] postgres[855]: [855] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1036gitlab # [ 8.804416] postgres[869]: [869] LOG: database system was shut down at 2026-09-04 07:39:31 GMT1037gitlab # [ 8.816750] postgres[855]: [855] LOG: database system is ready to accept connections1038gitlab # [ 8.821710] systemd[1]: Started PostgreSQL Server.1039gitlab # [ 8.823945] systemd[1]: Starting PostgreSQL Setup Scripts...1040gitlab # [ 8.865387] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[859]: mkdir -p /var/gitlab/state/home/.ssh: OK1041gitlab # [ 8.870129] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[859]: chmod 700 /var/gitlab/state/home/.ssh: OK1042gitlab # [ 8.936331] systemd[1]: Finished gitlab-config.service.1043gitlab # [ 8.942038] systemd[1]: Started gitaly.service.1044gitlab # [ 9.013402] postgresql-setup-start[898]: CREATE DATABASE1045gitlab # [ 9.037516] postgresql-setup-start[908]: CREATE ROLE1046gitlab # [ 9.048841] postgresql-setup-start[910]: ALTER DATABASE1047gitlab # [ 9.073501] postgresql-setup-start[915]: CREATE ROLE1048gitlab # [ 9.075693] systemd[1]: Finished PostgreSQL Setup Scripts.1049gitlab # [ 9.077881] systemd[1]: Reached target PostgreSQL.1050gitlab # [ 9.079782] systemd[1]: Starting gitlab-db-config.service...1051gitlab # [ 9.081973] systemd[1]: Starting gitlab-postgresql.service...1052gitlab # [ 9.192566] gitlab-postgresql-start[925]: CREATE DATABASE1053gitlab # [ 9.227527] gitlab-postgresql-start[935]: CREATE EXTENSION1054gitlab # [ 9.308292] gitlab-postgresql-start[937]: CREATE EXTENSION1055gitlab # [ 9.311461] systemd[1]: Finished gitlab-postgresql.service.1056gitlab # [ 9.389942] dhcpcd[767]: eth0: soliciting an IPv6 router1057gitlab # [ 9.391421] dhcpcd[767]: eth0: Router Advertisement from fe80::21058gitlab # [ 9.392480] dhcpcd[767]: eth0: adding address fec0::5054:ff:fe12:3456/641059gitlab # [ 9.393588] dhcpcd[767]: eth0: adding route to fec0::/641060gitlab # [ 9.394516] dhcpcd[767]: eth0: adding default route via fe80::21061gitlab # [ 9.501521] gitaly[903]: time="2026-09-04T07:39:32.292Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9031062gitlab # [ 9.501759] gitaly[903]: time="2026-09-04T07:39:32.293Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9031063gitlab # [ 9.502542] gitaly[903]: time="2026-09-04T07:39:32.293Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9031064gitlab # [ 9.503092] gitaly[903]: time="2026-09-04T07:39:32.293Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9031065gitlab # [ 9.503632] gitaly[903]: time="2026-09-04T07:39:32.293Z" level=info msg="Starting Gitaly" pid=903 version=1066gitlab # [ 9.702861] gitaly[903]: time="2026-09-04T07:39:32.494Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=200 pid=9031067gitlab # [ 9.703306] gitaly[903]: time="2026-09-04T07:39:32.494Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9031068gitlab # [ 9.704054] gitaly[903]: time="2026-09-04T07:39:32.495Z" level=info msg="finished initializing command factory" duration_ms=1 pid=9031069gitlab # [ 9.704733] gitaly[903]: time="2026-09-04T07:39:32.495Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-903/git-exec-322252391.d/git pid=9031070gitlab # [ 9.709237] gitaly[903]: time="2026-09-04T07:39:32.500Z" level=info msg="finished detecting git version" duration_ms=5 pid=9031071gitlab # [ 9.711075] gitaly[903]: time="2026-09-04T07:39:32.501Z" level=info msg="using Git version" pid=903 version=2.53.g1072gitlab # [ 9.712546] gitaly[903]: time="2026-09-04T07:39:32.502Z" level=info msg="clearing disk cache object folder" pid=903 storage=default1073gitlab # [ 9.714225] gitaly[903]: time="2026-09-04T07:39:32.502Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache157774471 pid=903 storage=default1074gitlab # [ 9.716931] gitaly[903]: time="2026-09-04T07:39:32.502Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache157774471 pid=903 storage=default1075gitlab # [ 9.720024] gitaly[903]: time="2026-09-04T07:39:32.502Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9031076gitlab # [ 9.722851] gitaly[903]: time="2026-09-04T07:39:32.502Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9031077gitlab # [ 9.725575] gitaly[903]: time="2026-09-04T07:39:32.502Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache157774471 clear_duration_ms=0 pid=903 storage=default1078gitlab # [ 9.773306] gitaly[903]: time="2026-09-04T07:39:32.564Z" level=info msg="counting repositories" pid=9031079gitlab # [ 9.773773] gitaly[903]: time="2026-09-04T07:39:32.564Z" level=info msg="starting to count repositories" pid=903 storage_path=/var/gitlab/state/repositories1080gitlab # [ 9.774173] gitaly[903]: time="2026-09-04T07:39:32.564Z" level=info msg="finished tempdir cleaner walk" pid=903 storage=default time_ms=01081gitlab # [ 9.774699] gitaly[903]: time="2026-09-04T07:39:32.564Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9031082gitlab # [ 9.775385] gitaly[903]: time="2026-09-04T07:39:32.564Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=903 storage_path=/var/gitlab/state/repositories1083gitlab # [ 9.776069] gitaly[903]: time="2026-09-04T07:39:32.564Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9031084gitlab # [ 9.776679] gitaly[903]: time="2026-09-04T07:39:32.564Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=903 schema=unix1085gitlab # [ 9.777451] gitaly[903]: time="2026-09-04T07:39:32.564Z" level=info msg="listening at address" address=/run/gitaly/gitaly-903/sock.d/intern pid=903 schema=unix1086gitlab # [ 9.789693] gitaly[903]: time="2026-09-04T07:39:32.581Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9031087gitlab # [ 9.790035] gitaly[903]: time="2026-09-04T07:39:32.581Z" level=info msg="Started Gitaly" duration_ms=288 pid=9031088gitlab # [ 9.790526] gitaly[903]: time="2026-09-04T07:39:32.581Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9031089gitlab # [ 9.791332] gitaly[903]: time="2026-09-04T07:39:32.582Z" level=info msg="maintenance: daily scheduled" pid=903 scheduled="2026-09-04 12:00:00 +0000 UTC"1090gitlab # [ 10.746450] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1091gitlab # [ 10.747446] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1092gitlab # [ 10.789634] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1093gitlab # [ 11.762731] gitaly[903]: time="2026-09-04T07:39:34.553Z" level=info msg="License database preloaded" duration_ms=2260 pid=9031094gitlab # [ 13.294946] dhcpcd[767]: eth0: leased 10.0.2.15 for 86400 seconds1095gitlab # [ 13.295440] dhcpcd[767]: eth0: adding route to 10.0.2.0/241096gitlab # [ 13.296952] dhcpcd[767]: eth0: adding default route via 10.0.2.21097gitlab # [ 13.411773] systemd[1]: Started DHCP Client.1098gitlab # [ 13.413805] systemd[1]: Reached target Network is Online.1099gitlab # [ 41.114454] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: W, [2026-09-04T07:40:03.905275 #920] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1100gitlab # [ 43.293699] postgres[1320]: [1320] ERROR: relation "feature_gates" does not exist at character 5231101gitlab # [ 43.294169] postgres[1320]: [1320] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1102gitlab # [ 43.294543] postgres[1320]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1103gitlab # [ 43.295202] postgres[1320]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1104gitlab # [ 43.295849] postgres[1320]: attidentity AS identity,1105gitlab # [ 43.296706] postgres[1320]: attgenerated as attgenerated1106gitlab # [ 43.297466] postgres[1320]: FROM pg_attribute a1107gitlab # [ 43.298120] postgres[1320]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1108gitlab # [ 43.298746] postgres[1320]: LEFT JOIN pg_type t ON a.atttypid = t.oid1109gitlab # [ 43.299507] postgres[1320]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1110gitlab # [ 43.300175] postgres[1320]: WHERE a.attrelid = '"feature_gates"'::regclass1111gitlab # [ 43.300793] postgres[1320]: AND a.attnum > 0 AND NOT a.attisdropped1112gitlab # [ 43.301578] postgres[1320]: ORDER BY a.attnum1113gitlab # [ 43.302386] postgres[1320]:1114gitlab # [ 46.707227] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1357]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1115gitlab # [ 46.709388] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1357]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1116gitlab # [ 47.873598] gitlab-workhorse[829]: time="2026-09-04T07:40:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1117gitlab # [ 57.875139] gitlab-workhorse[829]: time="2026-09-04T07:40:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 61.152374] postgres[1428]: [1428] ERROR: relation "table_without_models" does not exist1119gitlab # [ 61.153582] postgres[1428]: [1428] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1120gitlab # [ 67.885148] gitlab-workhorse[829]: time="2026-09-04T07:40:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 73.727910] systemd[1]: Finished gitlab-db-config.service.1122gitlab # [ 73.733623] systemd[1]: Started gitlab-sidekiq.service.1123gitlab # [ 73.737202] systemd[1]: Starting gitlab.service...1124gitlab # [ 74.091387] bundle[1595]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1125gitlab # [ 74.091939] bundle[1595]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1126gitlab # [ 74.094168] bundle[1595]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1127gitlab # [ 76.989553] sidekiq-cluster[1594]: {"severity":"INFO","time":"2026-09-04T07:40:39.762Z","message":"Starting cluster with 1 processes"}1128gitlab # [ 77.053502] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.823Z","pid":1595,"message":"* Enabling systemd notification integration"}1129gitlab # [ 77.057417] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"Puma starting in cluster mode..."}1130gitlab # [ 77.060820] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1131gitlab # [ 77.064472] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1132gitlab # [ 77.069231] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"* Min threads: 0"}1133gitlab # [ 77.072470] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"* Max threads: 4"}1134gitlab # [ 77.075812] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"* Environment: production"}1135gitlab # [ 77.079433] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"* Master PID: 1595"}1136gitlab # [ 77.082915] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"* Workers: 2"}1137gitlab # [ 77.086220] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1138gitlab # [ 77.090103] bundle[1595]: {"timestamp":"2026-09-04T07:40:39.844Z","pid":1595,"message":"* Preloading application"}1139gitlab # [ 77.894919] gitlab-workhorse[829]: time="2026-09-04T07:40:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1140gitlab # [ 87.905929] gitlab-workhorse[829]: time="2026-09-04T07:40:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 97.916162] gitlab-workhorse[829]: time="2026-09-04T07:41:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 101.136180] bundle[1595]: W, [2026-09-04T07:41:03.926933 #1595] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1143gitlab # [ 103.821200] sidekiq-cluster[1625]: 2026-09-04T07:41:06.612Z pid=1625 tid=wkx INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1625, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431755264}1144gitlab # [ 104.002901] sidekiq-cluster[1625]: W, [2026-09-04T07:41:06.794232 #1625] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1145gitlab # [ 104.041998] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:06.833Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1146gitlab # [ 106.054248] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.845Z","message":"GitLab reliable fetch activated!"}1147gitlab # [ 106.055980] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.845Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1148gitlab # [ 106.076424] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.867Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1149gitlab # [ 106.081707] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.869Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1150gitlab # [ 106.087053] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.871Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1151gitlab # [ 106.092078] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.873Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1152gitlab # [ 106.097683] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.875Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1153gitlab # [ 106.102697] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.876Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1154gitlab # [ 106.107777] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.878Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1155gitlab # [ 106.112434] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.880Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1156gitlab # [ 106.117066] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.881Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1157gitlab # [ 106.121071] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.883Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1158gitlab # [ 106.125352] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.884Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1159gitlab # [ 106.129444] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.886Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1160gitlab # [ 106.133277] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.887Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1161gitlab # [ 106.136555] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.889Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1162gitlab # [ 106.138707] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.890Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1163gitlab # [ 106.140965] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.892Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1164gitlab # [ 106.143076] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.894Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1165gitlab # [ 106.145051] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.896Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1166gitlab # [ 106.147230] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.899Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1167gitlab # [ 106.149370] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.901Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1168gitlab # [ 106.151774] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.903Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1169gitlab # [ 106.154154] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.905Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1170gitlab # [ 106.156225] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.907Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1171gitlab # [ 106.158431] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.908Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1172gitlab # [ 106.160667] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.910Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1173gitlab # [ 106.162813] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.913Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1174gitlab # [ 106.164886] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.915Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1175gitlab # [ 106.167001] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.917Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1176gitlab # [ 106.169098] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.919Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1177gitlab # [ 106.171322] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.921Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1178gitlab # [ 106.173225] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.923Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1179gitlab # [ 106.175353] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.925Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1180gitlab # [ 106.177284] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.926Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1181gitlab # [ 106.179457] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.928Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1182gitlab # [ 106.181528] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.930Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1183gitlab # [ 106.183621] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.932Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1184gitlab # [ 106.185689] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.933Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1185gitlab # [ 106.187728] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.935Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1186gitlab # [ 106.189712] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.937Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1187gitlab # [ 106.191731] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.938Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1188gitlab # [ 106.193883] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.940Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1189gitlab # [ 106.196023] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.942Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1190gitlab # [ 106.198147] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.943Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1191gitlab # [ 106.200178] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.945Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1192gitlab # [ 106.202370] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.947Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1193gitlab # [ 106.204541] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.949Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1194gitlab # [ 106.206627] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.951Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1195gitlab # [ 106.208940] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.952Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1196gitlab # [ 106.209396] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.954Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1197gitlab # [ 106.210052] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.956Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1198gitlab # [ 106.210494] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.958Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1199gitlab # [ 106.211048] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.960Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1200gitlab # [ 106.211612] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.969Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1201gitlab # [ 106.212061] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.971Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1202gitlab # [ 106.212490] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.973Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1203gitlab # [ 106.213036] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.975Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1204gitlab # [ 106.213463] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.977Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1205gitlab # [ 106.213969] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.979Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1206gitlab # [ 106.214657] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.981Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1207gitlab # [ 106.215155] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.983Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1208gitlab # [ 106.215641] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.985Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1209gitlab # [ 106.216117] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.986Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1210gitlab # [ 106.216594] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.988Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1211gitlab # [ 106.217115] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.990Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1212gitlab # [ 106.217588] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.992Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1213gitlab # [ 106.218094] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.995Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1214gitlab # [ 106.218605] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.996Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1215gitlab # [ 106.219146] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.998Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1216gitlab # [ 106.219618] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:08.999Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1217gitlab # [ 106.253490] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.044Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1218gitlab # [ 106.257193] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.048Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1219gitlab # [ 106.295921] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.087Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1220gitlab # [ 106.299552] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.091Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1221gitlab # [ 106.306402] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.097Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1222gitlab # [ 106.312518] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.104Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1223gitlab # [ 106.319988] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.111Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1224gitlab # [ 106.325333] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.116Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1225gitlab # [ 106.331932] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.123Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1226gitlab # [ 106.336965] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.128Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1227gitlab # [ 106.342344] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.133Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1228gitlab # [ 106.347327] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.138Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1229gitlab # [ 106.350567] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.142Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1230gitlab # [ 106.355109] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.146Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1231gitlab # [ 106.358642] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.150Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1232gitlab # [ 106.362623] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.154Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1233gitlab # [ 106.366204] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.157Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1234gitlab # [ 106.370663] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.162Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1235gitlab # [ 106.374216] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.165Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1236gitlab # [ 106.378402] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.169Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1237gitlab # [ 106.382268] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.173Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1238gitlab # [ 106.389457] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.180Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1239gitlab # [ 106.394914] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.186Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1240gitlab # [ 106.400491] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.192Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1241gitlab # [ 106.405991] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.197Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1242gitlab # [ 106.413875] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.205Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1243gitlab # [ 106.421622] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.213Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1244gitlab # [ 106.427295] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.218Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1245gitlab # [ 106.433066] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.224Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1246gitlab # [ 106.441396] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.232Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1247gitlab # [ 106.444991] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.236Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1248gitlab # [ 106.448562] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.240Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1249gitlab # [ 106.452742] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.244Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1250gitlab # [ 106.455405] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.246Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1251gitlab # [ 106.457139] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.248Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1252gitlab # [ 106.459468] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.251Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1253gitlab # [ 106.461597] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.252Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1254gitlab # [ 106.463627] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.255Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1255gitlab # [ 106.466500] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.258Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1256gitlab # [ 106.468348] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:09.259Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1257gitlab # [ 107.916929] gitlab-workhorse[829]: time="2026-09-04T07:41:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1258gitlab # [ 109.560916] sidekiq-cluster[1625]: InitializerConnections Query: SET client_min_messages TO 'warning'1259gitlab # [ 109.561787] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1260gitlab # [ 109.562889] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1261gitlab # [ 109.564681] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1262gitlab # [ 109.567133] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1263gitlab # [ 109.568402] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1264gitlab # [ 109.569643] sidekiq-cluster[1625]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1265gitlab # [ 109.585161] sidekiq-cluster[1625]: InitializerConnections Query: SET standard_conforming_strings = on1266gitlab # [ 109.586360] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1267gitlab # [ 109.587147] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1268gitlab # [ 109.589161] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1269gitlab # [ 109.591102] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1270gitlab # [ 109.594965] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1271gitlab # [ 109.595643] sidekiq-cluster[1625]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1272gitlab # [ 109.597935] sidekiq-cluster[1625]: InitializerConnections Query: SET intervalstyle = iso_86011273gitlab # [ 109.600959] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1274gitlab # [ 109.602951] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1275gitlab # [ 109.606045] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1276gitlab # [ 109.607286] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1277gitlab # [ 109.608275] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1278gitlab # [ 109.609954] sidekiq-cluster[1625]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1279gitlab # [ 109.610986] sidekiq-cluster[1625]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1280gitlab # [ 109.613329] sidekiq-cluster[1625]: FROM pg_type as t1281gitlab # [ 109.614146] sidekiq-cluster[1625]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1282gitlab # [ 109.615385] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1283gitlab # [ 109.616333] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1284gitlab # [ 109.618237] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1285gitlab # [ 109.619765] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1286gitlab # [ 109.621021] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1287gitlab # [ 109.621614] sidekiq-cluster[1625]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1288gitlab # [ 109.622827] sidekiq-cluster[1625]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1289gitlab # [ 109.623580] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1290gitlab # [ 109.625311] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1291gitlab # [ 109.626801] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1292gitlab # [ 109.627697] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1293gitlab # [ 109.629377] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1294gitlab # [ 109.629914] sidekiq-cluster[1625]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1295gitlab # [ 109.631095] sidekiq-cluster[1625]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1296gitlab # [ 109.631873] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1297gitlab # [ 109.633132] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1298gitlab # [ 109.633460] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1299gitlab # [ 109.633981] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1300gitlab # [ 109.634732] sidekiq-cluster[1625]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1301gitlab # [ 109.635455] sidekiq-cluster[1625]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1302gitlab # [ 117.918588] gitlab-workhorse[829]: time="2026-09-04T07:41:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1303gitlab # [ 127.919154] gitlab-workhorse[829]: time="2026-09-04T07:41:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1304gitlab # [ 129.756188] postgres[2090]: [2090] ERROR: relation "table_without_models" does not exist1305gitlab # [ 129.756592] postgres[2090]: [2090] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1306gitlab # [ 129.889695] postgres[2101]: [2101] ERROR: relation "table_without_models" does not exist1307gitlab # [ 129.890406] postgres[2101]: [2101] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1308gitlab # [ 132.126933] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:34.914Z","message":"Booted Rails 7.2.3.1 application in production environment"}1309gitlab # [ 132.129586] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:34.920Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1310gitlab # [ 132.132275] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:34.922Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1311gitlab # [ 132.133486] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:34.922Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1312gitlab # [ 132.144450] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:34.935Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1313gitlab # [ 132.566632] bundle[1595]: {"timestamp":"2026-09-04T07:41:35.357Z","pid":1595,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1314gitlab # [ 132.566979] bundle[1595]: {"timestamp":"2026-09-04T07:41:35.357Z","pid":1595,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1315gitlab # [ 132.567799] bundle[1595]: {"timestamp":"2026-09-04T07:41:35.357Z","pid":1595,"message":"! #\u003cThread:0x00007ee34a189640 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1316gitlab # [ 132.568882] bundle[1595]: {"timestamp":"2026-09-04T07:41:35.357Z","pid":1595,"message":"! #\u003cThread:0x00007ee34a424620 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1317gitlab # [ 132.570407] bundle[1595]: {"timestamp":"2026-09-04T07:41:35.357Z","pid":1595,"message":"Use Ctrl-C to stop"}1318gitlab # [ 132.571889] bundle[1595]: {"timestamp":"2026-09-04T07:41:35.358Z","pid":1595,"message":"Sending status to systemd every 1.0 sec"}1319gitlab # [ 132.973976] bundle[1595]: {"timestamp":"2026-09-04T07:41:35.765Z","pid":1595,"message":"- Worker 0 (PID: 2168) booted in 0.34s, phase: 0"}1320gitlab # [ 132.975863] bundle[1595]: {"timestamp":"2026-09-04T07:41:35.767Z","pid":1595,"message":"- Worker 1 (PID: 2172) booted in 0.32s, phase: 0"}1321gitlab # [ 132.984745] systemd[1]: Started gitlab.service.1322gitlab # [ 132.987316] systemd[1]: Reached target Common target for all GitLab services..1323gitlab # [ 132.995068] systemd[1]: Starting setup-gitlab.service...1324gitlab # [ 133.011157] setup-gitlab-start[2205]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1325gitlab # [ 133.627977] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:36.418Z","message":"Cleaning working queues"}1326gitlab # [ 133.632854] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:36.423Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e9999516cb5ca32df8e5de46","created_at":"2026-09-04T07:40:36.133Z","trace_propagation_headers":{"sentry-trace":"ac6f5dce951b434898809205b9120dd7-a2fba2d0b4754e45","baggage":"sentry-trace_id=ac6f5dce951b434898809205b9120dd7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"5b4d590c8b09483894daf729f28ee9af","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:40:36.141Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e9999516cb5ca32df8e5de46: start","job_status":"start","queue_duration_s":60.282405,"scheduling_latency_s":60.282584}1327gitlab # [ 133.832668] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:41:36.623Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e9999516cb5ca32df8e5de46","created_at":"2026-09-04T07:40:36.133Z","trace_propagation_headers":{"sentry-trace":"ac6f5dce951b434898809205b9120dd7-a2fba2d0b4754e45","baggage":"sentry-trace_id=ac6f5dce951b434898809205b9120dd7,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"5b4d590c8b09483894daf729f28ee9af","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:40:36.141Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e9999516cb5ca32df8e5de46: done: 0.200009 sec","job_status":"done","queue_duration_s":60.282405,"scheduling_latency_s":60.282584,"redis_calls":26,"redis_duration_s":0.0077659999999999995,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004129,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002306,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001331,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.098186502,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.200009,"completed_at":"2026-09-04T07:41:36.623Z","load_balancing_strategy":"primary","db_duration_s":0.064186,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1328gitlab # [ 135.253605] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:41:38 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 22161329gitlab # [ 135.258554] setup-gitlab-start[2205]: + TOKEN=nixbot-test-token-of-20-chars1330gitlab # [ 135.261061] setup-gitlab-start[2205]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1331gitlab # [ 135.273228] runuser[2230]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1332gitlab # [ 135.636819] setup-gitlab-start[2231]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1333gitlab # [ 135.641667] setup-gitlab-start[2231]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1334gitlab # [ 135.646444] setup-gitlab-start[2231]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1335gitlab # [ 136.213531] setup-gitlab-start[2231]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1336gitlab # [ 136.218440] setup-gitlab-start[2231]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1337gitlab # [ 136.223163] setup-gitlab-start[2231]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1338gitlab # [ 161.115420] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:03.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d7cba5d95163535e96960faa","created_at":"2026-09-04T07:42:03.874Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"773f1f4efa9b3e426e01ba0022f909b6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:42:03.903Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d7cba5d95163535e96960faa: start","job_status":"start","queue_duration_s":0.001965,"scheduling_latency_s":0.002007}1339gitlab # [ 161.227797] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d7cba5d95163535e96960faa","created_at":"2026-09-04T07:42:03.874Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"773f1f4efa9b3e426e01ba0022f909b6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:42:03.903Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d7cba5d95163535e96960faa: done: 0.113928 sec","job_status":"done","queue_duration_s":0.001965,"scheduling_latency_s":0.002007,"redis_calls":10,"redis_duration_s":0.012624999999999999,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001952,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.008336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000284673,"duration_s":0.113928,"completed_at":"2026-09-04T07:42:04.018Z","load_balancing_strategy":"primary","db_duration_s":0.007056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 161.309452] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"003b379e17844a1ba6c979dc","created_at":"2026-09-04T07:42:03.964Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55b868fffb605839fd20cf4fda23d454","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:03.987Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-003b379e17844a1ba6c979dc: start","job_status":"start","queue_duration_s":0.032696,"scheduling_latency_s":0.032712}1341gitlab # [ 161.326289] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.068Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"003b379e17844a1ba6c979dc","created_at":"2026-09-04T07:42:03.964Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55b868fffb605839fd20cf4fda23d454","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:03.987Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-003b379e17844a1ba6c979dc: done: 0.047894 sec","job_status":"done","queue_duration_s":0.032696,"scheduling_latency_s":0.032712,"redis_calls":10,"redis_duration_s":0.007871,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002672,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003581,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000728025,"duration_s":0.047894,"completed_at":"2026-09-04T07:42:04.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 161.378188] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c75e81eacf7845337227fefb","created_at":"2026-09-04T07:42:04.001Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84e29a9771148e43ba3fab658bc001b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.039Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c75e81eacf7845337227fefb: start","job_status":"start","queue_duration_s":0.032818,"scheduling_latency_s":0.03285}1343gitlab # [ 161.396445] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c75e81eacf7845337227fefb","created_at":"2026-09-04T07:42:04.001Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84e29a9771148e43ba3fab658bc001b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.039Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c75e81eacf7845337227fefb: done: 0.039767 sec","job_status":"done","queue_duration_s":0.032818,"scheduling_latency_s":0.03285,"redis_calls":12,"redis_duration_s":0.008477,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004113,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00316,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001204,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000632203,"duration_s":0.039767,"completed_at":"2026-09-04T07:42:04.112Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 161.397426] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.116Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"529407779b3db7ac1a28bbea","created_at":"2026-09-04T07:42:04.054Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adc3fbc446d96f22556ec2a83fa92b3c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.062Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-529407779b3db7ac1a28bbea: start","job_status":"start","queue_duration_s":0.054644,"scheduling_latency_s":0.054666}1345gitlab # [ 161.410599] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.158Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"529407779b3db7ac1a28bbea","created_at":"2026-09-04T07:42:04.054Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adc3fbc446d96f22556ec2a83fa92b3c","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.062Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-529407779b3db7ac1a28bbea: done: 0.04113 sec","job_status":"done","queue_duration_s":0.054644,"scheduling_latency_s":0.054666,"redis_calls":12,"redis_duration_s":0.017864,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00751,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00222,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002451,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001701893,"duration_s":0.04113,"completed_at":"2026-09-04T07:42:04.158Z","load_balancing_strategy":"primary","db_duration_s":0.001808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 161.472888] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"be7f030832631938c2237138","created_at":"2026-09-04T07:42:04.072Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18c65471b7810f8a9126e05c864298f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.079Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-be7f030832631938c2237138: start","job_status":"start","queue_duration_s":0.082134,"scheduling_latency_s":0.082153}1347gitlab # [ 161.484875] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.276Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"be7f030832631938c2237138","created_at":"2026-09-04T07:42:04.072Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18c65471b7810f8a9126e05c864298f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.079Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-be7f030832631938c2237138: done: 0.113965 sec","job_status":"done","queue_duration_s":0.082134,"scheduling_latency_s":0.082153,"redis_calls":14,"redis_duration_s":0.018654999999999998,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004391,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003276,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010988,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.009086351,"exclusive_lock_hold_duration_s":0.062007601,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.113965,"completed_at":"2026-09-04T07:42:04.275Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020055,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 161.547507] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.280Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7b20e3b7bcf08c0aa46fcb42","created_at":"2026-09-04T07:42:04.088Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b1a873bff01ec4c62b13a2f3a6167b9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.098Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7b20e3b7bcf08c0aa46fcb42: start","job_status":"start","queue_duration_s":0.182117,"scheduling_latency_s":0.182138}1349gitlab # [ 161.548192] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.333Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"7b20e3b7bcf08c0aa46fcb42","created_at":"2026-09-04T07:42:04.088Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b1a873bff01ec4c62b13a2f3a6167b9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.098Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-7b20e3b7bcf08c0aa46fcb42: done: 0.053509 sec","job_status":"done","queue_duration_s":0.182117,"scheduling_latency_s":0.182138,"redis_calls":16,"redis_duration_s":0.012487999999999999,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.007413,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000381892,"duration_s":0.053509,"completed_at":"2026-09-04T07:42:04.333Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011414,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 161.597708] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9c04f31b6c1f3f3e5ebe1ec4","created_at":"2026-09-04T07:42:04.109Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba283e6fc169126b6c804119f63c5864","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.116Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9c04f31b6c1f3f3e5ebe1ec4: start","job_status":"start","queue_duration_s":0.222941,"scheduling_latency_s":0.222956}1351gitlab # [ 161.598539] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.378Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"9c04f31b6c1f3f3e5ebe1ec4","created_at":"2026-09-04T07:42:04.109Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba283e6fc169126b6c804119f63c5864","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.116Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-9c04f31b6c1f3f3e5ebe1ec4: done: 0.038895 sec","job_status":"done","queue_duration_s":0.222941,"scheduling_latency_s":0.222956,"redis_calls":12,"redis_duration_s":0.010712,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00134,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002691,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001390679,"exclusive_lock_hold_duration_s":0.011207848999999999,"duration_s":0.038895,"completed_at":"2026-09-04T07:42:04.378Z","load_balancing_strategy":"primary","db_duration_s":0.008502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 161.639347] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0b10021ac57221c7cd6edf0c","created_at":"2026-09-04T07:42:04.125Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"748e95c32289746f586956610c98f8ad","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.137Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0b10021ac57221c7cd6edf0c: start","job_status":"start","queue_duration_s":0.245092,"scheduling_latency_s":0.245125}1353gitlab # [ 161.646768] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0b10021ac57221c7cd6edf0c","created_at":"2026-09-04T07:42:04.125Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"748e95c32289746f586956610c98f8ad","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.137Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0b10021ac57221c7cd6edf0c: done: 0.041467 sec","job_status":"done","queue_duration_s":0.245092,"scheduling_latency_s":0.245125,"redis_calls":10,"redis_duration_s":0.004598,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001228,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000285791,"duration_s":0.041467,"completed_at":"2026-09-04T07:42:04.424Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 161.723477] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0f153b5b8ce8b2b27eb1770d","created_at":"2026-09-04T07:42:04.148Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20b02cab4e36bd5c45d16428972f9502","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:42:04.161Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0f153b5b8ce8b2b27eb1770d: start","job_status":"start","queue_duration_s":0.265639,"scheduling_latency_s":0.265663}1355gitlab # [ 161.723801] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.442Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1356gitlab # [ 161.724205] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.451Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0f153b5b8ce8b2b27eb1770d","created_at":"2026-09-04T07:42:04.148Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20b02cab4e36bd5c45d16428972f9502","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:42:04.161Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0f153b5b8ce8b2b27eb1770d: done: 0.024153 sec","job_status":"done","queue_duration_s":0.265639,"scheduling_latency_s":0.265663,"redis_calls":10,"redis_duration_s":0.001822,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000411,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000242209,"duration_s":0.024153,"completed_at":"2026-09-04T07:42:04.451Z","load_balancing_strategy":"primary","db_duration_s":0.006361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 161.735656] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.452Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b25c7e8891d7f6afcfd05d14","created_at":"2026-09-04T07:42:04.171Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caa978da220d0a62552600d790a42e26","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.180Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b25c7e8891d7f6afcfd05d14: start","job_status":"start","queue_duration_s":0.271818,"scheduling_latency_s":0.271832}1358gitlab # [ 161.777334] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b25c7e8891d7f6afcfd05d14","created_at":"2026-09-04T07:42:04.171Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caa978da220d0a62552600d790a42e26","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.180Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b25c7e8891d7f6afcfd05d14: done: 0.039297 sec","job_status":"done","queue_duration_s":0.271818,"scheduling_latency_s":0.271832,"redis_calls":10,"redis_duration_s":0.001375,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000258692,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.039297,"completed_at":"2026-09-04T07:42:04.491Z","load_balancing_strategy":"primary","db_duration_s":0.018714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 161.822779] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"d4513e5e9a8630d79ca71b30","created_at":"2026-09-04T07:42:04.201Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"287600f519d39c82db9ced2b2ae55728","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.213Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-d4513e5e9a8630d79ca71b30: start","job_status":"start","queue_duration_s":0.279309,"scheduling_latency_s":0.279323}1360gitlab # [ 161.823811] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.506Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"d4513e5e9a8630d79ca71b30","created_at":"2026-09-04T07:42:04.201Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"287600f519d39c82db9ced2b2ae55728","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.213Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-d4513e5e9a8630d79ca71b30: done: 0.013605 sec","job_status":"done","queue_duration_s":0.279309,"scheduling_latency_s":0.279323,"redis_calls":12,"redis_duration_s":0.002003,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000211758,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.013605,"completed_at":"2026-09-04T07:42:04.506Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 161.838038] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.507Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ca917cdb756ecd49f2fb1b47","created_at":"2026-09-04T07:42:04.217Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72c0175a5582e3888b81b1cfa1adace3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.230Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ca917cdb756ecd49f2fb1b47: start","job_status":"start","queue_duration_s":0.276853,"scheduling_latency_s":0.276866}1362gitlab # [ 161.884120] setup-gitlab-start[2231]: W, [2026-09-04T07:42:04.637756 #2231] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1363gitlab # [ 161.902551] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.693Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ca917cdb756ecd49f2fb1b47","created_at":"2026-09-04T07:42:04.217Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72c0175a5582e3888b81b1cfa1adace3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.230Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ca917cdb756ecd49f2fb1b47: done: 0.186501 sec","job_status":"done","queue_duration_s":0.276853,"scheduling_latency_s":0.276866,"redis_calls":12,"redis_duration_s":0.0019169999999999999,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000307301,"exclusive_lock_hold_duration_s":0.17395618799999998,"duration_s":0.186501,"completed_at":"2026-09-04T07:42:04.693Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.170676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 161.942643] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"413c8d8f9f82a4606a05223a","created_at":"2026-09-04T07:42:04.237Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.244Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-413c8d8f9f82a4606a05223a: start","job_status":"start","queue_duration_s":0.489355,"scheduling_latency_s":0.489392}1365gitlab # [ 162.036646] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"413c8d8f9f82a4606a05223a","created_at":"2026-09-04T07:42:04.237Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.244Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-413c8d8f9f82a4606a05223a: done: 0.093958 sec","job_status":"done","queue_duration_s":0.489355,"scheduling_latency_s":0.489392,"redis_calls":71,"redis_duration_s":0.017688,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002682,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000837,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013216,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000339708,"duration_s":0.093958,"completed_at":"2026-09-04T07:42:04.827Z","load_balancing_strategy":"primary","db_duration_s":0.003021,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 162.038487] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d6ec9da4423074d327e39622","created_at":"2026-09-04T07:42:04.253Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.258Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d6ec9da4423074d327e39622: start","job_status":"start","queue_duration_s":0.570017,"scheduling_latency_s":0.570033}1367gitlab # [ 162.154773] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d6ec9da4423074d327e39622","created_at":"2026-09-04T07:42:04.253Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.258Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d6ec9da4423074d327e39622: done: 0.115832 sec","job_status":"done","queue_duration_s":0.570017,"scheduling_latency_s":0.570033,"redis_calls":19,"redis_duration_s":0.005605,"redis_read_bytes":22,"redis_write_bytes":4781,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001578,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000404,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002685,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.074,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.074,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000537499,"duration_s":0.115832,"completed_at":"2026-09-04T07:42:04.944Z","load_balancing_strategy":"primary","db_duration_s":0.073675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 162.206541] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:04.997Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"da7a7e4ee3f5879e8f70303b","created_at":"2026-09-04T07:42:04.272Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51d1218f616be997e70df230f9050cd5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.283Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-da7a7e4ee3f5879e8f70303b: start","job_status":"start","queue_duration_s":0.714038,"scheduling_latency_s":0.714093}1369gitlab # [ 162.225922] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.017Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1370gitlab # [ 162.237393] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"da7a7e4ee3f5879e8f70303b","created_at":"2026-09-04T07:42:04.272Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51d1218f616be997e70df230f9050cd5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.283Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-da7a7e4ee3f5879e8f70303b: done: 0.031053 sec","job_status":"done","queue_duration_s":0.714038,"scheduling_latency_s":0.714093,"redis_calls":10,"redis_duration_s":0.003245,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000632,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000679,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000550349,"duration_s":0.031053,"completed_at":"2026-09-04T07:42:05.028Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 162.240679] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"dd676401a98a35c188631626","created_at":"2026-09-04T07:42:04.292Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e5fc20b9b6e4c94320ba30fad326f5f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.299Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-dd676401a98a35c188631626: start","job_status":"start","queue_duration_s":0.731967,"scheduling_latency_s":0.732021}1372gitlab # [ 162.375488] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"dd676401a98a35c188631626","created_at":"2026-09-04T07:42:04.292Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e5fc20b9b6e4c94320ba30fad326f5f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.299Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-dd676401a98a35c188631626: done: 0.135235 sec","job_status":"done","queue_duration_s":0.731967,"scheduling_latency_s":0.732021,"redis_calls":12,"redis_duration_s":0.00343,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000655,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001492,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001283,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000799823,"exclusive_lock_hold_duration_s":0.107682121,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.135235,"completed_at":"2026-09-04T07:42:05.166Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012337,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1373gitlab # [ 162.377295] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.168Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"cb7ab22fb2656e834a006933","created_at":"2026-09-04T07:42:04.305Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa7d3a63159d7e599bf9c91abf5ca610","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.312Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-cb7ab22fb2656e834a006933: start","job_status":"start","queue_duration_s":0.856152,"scheduling_latency_s":0.856167}1374gitlab # [ 162.405381] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"cb7ab22fb2656e834a006933","created_at":"2026-09-04T07:42:04.305Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa7d3a63159d7e599bf9c91abf5ca610","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.312Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-cb7ab22fb2656e834a006933: done: 0.020717 sec","job_status":"done","queue_duration_s":0.856152,"scheduling_latency_s":0.856167,"redis_calls":13,"redis_duration_s":0.001861,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000664,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006091556999999999,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.020717,"completed_at":"2026-09-04T07:42:05.188Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00218,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1375gitlab # [ 162.479097] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"036ebc026f7994b62ff98661","created_at":"2026-09-04T07:42:04.318Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2a4f25bde1928094dcbe36ff48ca29b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.324Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-036ebc026f7994b62ff98661: start","job_status":"start","queue_duration_s":0.865242,"scheduling_latency_s":0.865254}1376gitlab # [ 162.541775] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.197Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1377gitlab # [ 162.542655] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"036ebc026f7994b62ff98661","created_at":"2026-09-04T07:42:04.318Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2a4f25bde1928094dcbe36ff48ca29b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.324Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-036ebc026f7994b62ff98661: done: 0.012109 sec","job_status":"done","queue_duration_s":0.865242,"scheduling_latency_s":0.865254,"redis_calls":10,"redis_duration_s":0.0012850000000000001,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023802,"duration_s":0.012109,"completed_at":"2026-09-04T07:42:05.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 162.550094] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"55bf114d2448d03e9999972f","created_at":"2026-09-04T07:42:04.332Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49bfda302aa9cee6aec31b6f73c2690d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.338Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-55bf114d2448d03e9999972f: start","job_status":"start","queue_duration_s":0.864074,"scheduling_latency_s":0.864089}1379gitlab # [ 162.715584] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.506Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"55bf114d2448d03e9999972f","created_at":"2026-09-04T07:42:04.332Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49bfda302aa9cee6aec31b6f73c2690d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.338Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-55bf114d2448d03e9999972f: done: 0.303712 sec","job_status":"done","queue_duration_s":0.864074,"scheduling_latency_s":0.864089,"redis_calls":565,"redis_duration_s":0.100644,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000604,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.098758,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.225115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000331885,"duration_s":0.303712,"completed_at":"2026-09-04T07:42:05.506Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000785,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 162.718711] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"45465482fd87ded9094187ea","created_at":"2026-09-04T07:42:04.350Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8abf8f42cb33e6f0bb0a359ce2d79b89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.359Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-45465482fd87ded9094187ea: start","job_status":"start","queue_duration_s":1.149471,"scheduling_latency_s":1.149489}1381gitlab # [ 162.793470] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.520Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1382gitlab # [ 162.794181] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.526Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"45465482fd87ded9094187ea","created_at":"2026-09-04T07:42:04.350Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8abf8f42cb33e6f0bb0a359ce2d79b89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.359Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-45465482fd87ded9094187ea: done: 0.017491 sec","job_status":"done","queue_duration_s":1.149471,"scheduling_latency_s":1.149489,"redis_calls":10,"redis_duration_s":0.0017920000000000002,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000342,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000291657,"duration_s":0.017491,"completed_at":"2026-09-04T07:42:05.526Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000568,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 162.803853] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.527Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ac3ea3c65eaf0b47bd4de3f9","created_at":"2026-09-04T07:42:04.366Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f41825c81a2092df08d71423d897a8a6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.372Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ac3ea3c65eaf0b47bd4de3f9: start","job_status":"start","queue_duration_s":1.155053,"scheduling_latency_s":1.155069}1384gitlab # [ 162.816892] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ac3ea3c65eaf0b47bd4de3f9","created_at":"2026-09-04T07:42:04.366Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f41825c81a2092df08d71423d897a8a6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.372Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ac3ea3c65eaf0b47bd4de3f9: done: 0.015882 sec","job_status":"done","queue_duration_s":1.155053,"scheduling_latency_s":1.155069,"redis_calls":12,"redis_duration_s":0.002014,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000408711,"exclusive_lock_hold_duration_s":0.002334655,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.015882,"completed_at":"2026-09-04T07:42:05.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001219,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 162.866329] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0863feb18d843952b15dda4c","created_at":"2026-09-04T07:42:04.381Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2232ca510662fae2dceb33ec6cde8845","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.387Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0863feb18d843952b15dda4c: start","job_status":"start","queue_duration_s":1.157122,"scheduling_latency_s":1.157137}1386gitlab # [ 162.868779] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.571Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"0863feb18d843952b15dda4c","created_at":"2026-09-04T07:42:04.381Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2232ca510662fae2dceb33ec6cde8845","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.387Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-0863feb18d843952b15dda4c: done: 0.026561 sec","job_status":"done","queue_duration_s":1.157122,"scheduling_latency_s":1.157137,"redis_calls":12,"redis_duration_s":0.00217,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000600076,"exclusive_lock_hold_duration_s":0.008842743,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.026561,"completed_at":"2026-09-04T07:42:05.571Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 162.914230] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a16ce0251426f3d34d44c2b9","created_at":"2026-09-04T07:42:04.402Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2074c0b21c4c7aaf94322655fad89ceb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.413Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a16ce0251426f3d34d44c2b9: start","job_status":"start","queue_duration_s":1.158312,"scheduling_latency_s":1.158327}1388gitlab # [ 162.958843] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.580Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1389gitlab # [ 162.959759] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"a16ce0251426f3d34d44c2b9","created_at":"2026-09-04T07:42:04.402Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2074c0b21c4c7aaf94322655fad89ceb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.413Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-a16ce0251426f3d34d44c2b9: done: 0.013471 sec","job_status":"done","queue_duration_s":1.158312,"scheduling_latency_s":1.158327,"redis_calls":10,"redis_duration_s":0.001606,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000348,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000319,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000253384,"duration_s":0.013471,"completed_at":"2026-09-04T07:42:05.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 163.000708] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ea967e1a9fe77a5ccf1d6101","created_at":"2026-09-04T07:42:04.420Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"165dbb17ac3f783d6308e252cd40b9ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.426Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ea967e1a9fe77a5ccf1d6101: start","job_status":"start","queue_duration_s":1.160096,"scheduling_latency_s":1.16011}1391gitlab # [ 163.001581] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.726Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ea967e1a9fe77a5ccf1d6101","created_at":"2026-09-04T07:42:04.420Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"165dbb17ac3f783d6308e252cd40b9ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.426Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ea967e1a9fe77a5ccf1d6101: done: 0.139464 sec","job_status":"done","queue_duration_s":1.160096,"scheduling_latency_s":1.16011,"redis_calls":14,"redis_duration_s":0.002286,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000343619,"exclusive_lock_hold_duration_s":0.123563469,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.139464,"completed_at":"2026-09-04T07:42:05.726Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 163.020841] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.727Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1c3f1f961f13553e181bd796","created_at":"2026-09-04T07:42:04.448Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8baddeafe3507e8ccbf8d5750ec4f42c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.453Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1c3f1f961f13553e181bd796: start","job_status":"start","queue_duration_s":1.274027,"scheduling_latency_s":1.274042}1393gitlab # [ 163.034320] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1c3f1f961f13553e181bd796","created_at":"2026-09-04T07:42:04.448Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8baddeafe3507e8ccbf8d5750ec4f42c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.453Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1c3f1f961f13553e181bd796: done: 0.013079 sec","job_status":"done","queue_duration_s":1.274027,"scheduling_latency_s":1.274042,"redis_calls":10,"redis_duration_s":0.001396,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000384965,"duration_s":0.013079,"completed_at":"2026-09-04T07:42:05.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 163.087756] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"673a5ae33503608813b9aec1","created_at":"2026-09-04T07:42:04.455Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"692090e4ea096623ee1705d35b710557","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:42:04.463Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-673a5ae33503608813b9aec1: start","job_status":"start","queue_duration_s":1.278007,"scheduling_latency_s":1.27802}1395gitlab # [ 163.088715] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.748Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1396gitlab # [ 163.092065] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"673a5ae33503608813b9aec1","created_at":"2026-09-04T07:42:04.455Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-d0e27b23f4604090","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"692090e4ea096623ee1705d35b710557","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:42:04.463Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-673a5ae33503608813b9aec1: done: 0.011615 sec","job_status":"done","queue_duration_s":1.278007,"scheduling_latency_s":1.27802,"redis_calls":10,"redis_duration_s":0.001436,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213714,"duration_s":0.011615,"completed_at":"2026-09-04T07:42:05.753Z","load_balancing_strategy":"primary","db_duration_s":0.000249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 163.135801] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"364f1149518661fc35377bc1","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-364f1149518661fc35377bc1: start","job_status":"start","queue_duration_s":0.934121,"scheduling_latency_s":0.934135}1398gitlab # [ 163.142754] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"364f1149518661fc35377bc1","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-364f1149518661fc35377bc1: done: 0.013845 sec","job_status":"done","queue_duration_s":0.934121,"scheduling_latency_s":0.934135,"redis_calls":16,"redis_duration_s":0.0022789999999999998,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001223,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000350045,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013845,"completed_at":"2026-09-04T07:42:05.768Z","load_balancing_strategy":"primary","db_duration_s":0.000266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 163.180563] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cbe07a5c2f18150763a0cfa","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cbe07a5c2f18150763a0cfa: start","job_status":"start","queue_duration_s":0.948987,"scheduling_latency_s":0.949001}1400gitlab # [ 163.226931] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cbe07a5c2f18150763a0cfa","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cbe07a5c2f18150763a0cfa: done: 0.011169 sec","job_status":"done","queue_duration_s":0.948987,"scheduling_latency_s":0.949001,"redis_calls":13,"redis_duration_s":0.002238,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011169,"completed_at":"2026-09-04T07:42:05.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 163.229533] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e1b0eb8cde7fa47b9933424","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e1b0eb8cde7fa47b9933424: start","job_status":"start","queue_duration_s":0.961218,"scheduling_latency_s":0.961233}1402gitlab # [ 163.242476] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e1b0eb8cde7fa47b9933424","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e1b0eb8cde7fa47b9933424: done: 0.009692 sec","job_status":"done","queue_duration_s":0.961218,"scheduling_latency_s":0.961233,"redis_calls":13,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009692,"completed_at":"2026-09-04T07:42:05.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 163.294332] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0563e5cf8f7818d11359fb18","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0563e5cf8f7818d11359fb18: start","job_status":"start","queue_duration_s":0.972228,"scheduling_latency_s":0.972264}1404gitlab # [ 163.295074] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0563e5cf8f7818d11359fb18","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0563e5cf8f7818d11359fb18: done: 0.012491 sec","job_status":"done","queue_duration_s":0.972228,"scheduling_latency_s":0.972264,"redis_calls":13,"redis_duration_s":0.0016090000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012491,"completed_at":"2026-09-04T07:42:05.804Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 163.343584] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f002fdd6fad29663cf8ca082","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f002fdd6fad29663cf8ca082: start","job_status":"start","queue_duration_s":0.985556,"scheduling_latency_s":0.985571}1406gitlab # [ 163.344237] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f002fdd6fad29663cf8ca082","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f002fdd6fad29663cf8ca082: done: 0.009358 sec","job_status":"done","queue_duration_s":0.985556,"scheduling_latency_s":0.985571,"redis_calls":13,"redis_duration_s":0.001633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009358,"completed_at":"2026-09-04T07:42:05.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 163.410627] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a698b7d904d6b0f5e2965dd","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a698b7d904d6b0f5e2965dd: start","job_status":"start","queue_duration_s":0.995756,"scheduling_latency_s":0.99577}1408gitlab # [ 163.411620] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a698b7d904d6b0f5e2965dd","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a698b7d904d6b0f5e2965dd: done: 0.009315 sec","job_status":"done","queue_duration_s":0.995756,"scheduling_latency_s":0.99577,"redis_calls":13,"redis_duration_s":0.001706,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009315,"completed_at":"2026-09-04T07:42:05.825Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 163.425122] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8167382fa0c444bdf7fb65d","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8167382fa0c444bdf7fb65d: start","job_status":"start","queue_duration_s":1.005914,"scheduling_latency_s":1.005928}1410gitlab # [ 163.474974] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8167382fa0c444bdf7fb65d","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8167382fa0c444bdf7fb65d: done: 0.009247 sec","job_status":"done","queue_duration_s":1.005914,"scheduling_latency_s":1.005928,"redis_calls":13,"redis_duration_s":0.0016450000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009247,"completed_at":"2026-09-04T07:42:05.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 163.476052] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35f6346a44e8c64d20552f4f","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35f6346a44e8c64d20552f4f: start","job_status":"start","queue_duration_s":1.016014,"scheduling_latency_s":1.016027}1412gitlab # [ 163.521641] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35f6346a44e8c64d20552f4f","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35f6346a44e8c64d20552f4f: done: 0.009934 sec","job_status":"done","queue_duration_s":1.016014,"scheduling_latency_s":1.016027,"redis_calls":13,"redis_duration_s":0.001894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000593,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001301,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009934,"completed_at":"2026-09-04T07:42:05.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 163.522735] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be01aedbd8e3d3ea0808ee0f","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be01aedbd8e3d3ea0808ee0f: start","job_status":"start","queue_duration_s":1.026802,"scheduling_latency_s":1.026816}1414gitlab # [ 163.568799] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be01aedbd8e3d3ea0808ee0f","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be01aedbd8e3d3ea0808ee0f: done: 0.009737 sec","job_status":"done","queue_duration_s":1.026802,"scheduling_latency_s":1.026816,"redis_calls":13,"redis_duration_s":0.001691,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001142,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009737,"completed_at":"2026-09-04T07:42:05.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 163.570894] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8faa438efaf39327c8b01e2b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8faa438efaf39327c8b01e2b: start","job_status":"start","queue_duration_s":1.037516,"scheduling_latency_s":1.037531}1416gitlab # [ 163.582582] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8faa438efaf39327c8b01e2b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8faa438efaf39327c8b01e2b: done: 0.00948 sec","job_status":"done","queue_duration_s":1.037516,"scheduling_latency_s":1.037531,"redis_calls":13,"redis_duration_s":0.001608,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00948,"completed_at":"2026-09-04T07:42:05.867Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 163.622706] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ee0d1ead80ec8e0f4219d19","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ee0d1ead80ec8e0f4219d19: start","job_status":"start","queue_duration_s":1.047998,"scheduling_latency_s":1.048011}1418gitlab # [ 163.627549] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ee0d1ead80ec8e0f4219d19","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ee0d1ead80ec8e0f4219d19: done: 0.009516 sec","job_status":"done","queue_duration_s":1.047998,"scheduling_latency_s":1.048011,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009516,"completed_at":"2026-09-04T07:42:05.877Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 163.674250] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b32615220ecb553561721f4","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b32615220ecb553561721f4: start","job_status":"start","queue_duration_s":1.058491,"scheduling_latency_s":1.058505}1420gitlab # [ 163.676488] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b32615220ecb553561721f4","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b32615220ecb553561721f4: done: 0.009416 sec","job_status":"done","queue_duration_s":1.058491,"scheduling_latency_s":1.058505,"redis_calls":13,"redis_duration_s":0.001596,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009416,"completed_at":"2026-09-04T07:42:05.888Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 163.719359] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07f222b56d9bc75dd51d5315","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07f222b56d9bc75dd51d5315: start","job_status":"start","queue_duration_s":1.068933,"scheduling_latency_s":1.068947}1422gitlab # [ 163.724656] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07f222b56d9bc75dd51d5315","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07f222b56d9bc75dd51d5315: done: 0.009732 sec","job_status":"done","queue_duration_s":1.068933,"scheduling_latency_s":1.068947,"redis_calls":13,"redis_duration_s":0.0015600000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009732,"completed_at":"2026-09-04T07:42:05.898Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 163.767974] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d474f034397a13227a6a14","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d474f034397a13227a6a14: start","job_status":"start","queue_duration_s":1.079685,"scheduling_latency_s":1.0797}1424gitlab # [ 163.770058] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1d474f034397a13227a6a14","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1d474f034397a13227a6a14: done: 0.009441 sec","job_status":"done","queue_duration_s":1.079685,"scheduling_latency_s":1.0797,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009441,"completed_at":"2026-09-04T07:42:05.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 163.829114] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92d8593673524fdc275453d8","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92d8593673524fdc275453d8: start","job_status":"start","queue_duration_s":1.089961,"scheduling_latency_s":1.089974}1426gitlab # [ 163.829977] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92d8593673524fdc275453d8","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92d8593673524fdc275453d8: done: 0.009616 sec","job_status":"done","queue_duration_s":1.089961,"scheduling_latency_s":1.089974,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009616,"completed_at":"2026-09-04T07:42:05.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 163.871229] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae8181d1bcf8df6aa604f28b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae8181d1bcf8df6aa604f28b: start","job_status":"start","queue_duration_s":1.100449,"scheduling_latency_s":1.100463}1428gitlab # [ 163.871922] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae8181d1bcf8df6aa604f28b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae8181d1bcf8df6aa604f28b: done: 0.041091 sec","job_status":"done","queue_duration_s":1.100449,"scheduling_latency_s":1.100463,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041091,"completed_at":"2026-09-04T07:42:05.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 163.924769] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be7df8aa5e4aace9e700cc12","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be7df8aa5e4aace9e700cc12: start","job_status":"start","queue_duration_s":1.142683,"scheduling_latency_s":1.1427}1430gitlab # [ 163.925587] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be7df8aa5e4aace9e700cc12","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be7df8aa5e4aace9e700cc12: done: 0.010937 sec","job_status":"done","queue_duration_s":1.142683,"scheduling_latency_s":1.1427,"redis_calls":13,"redis_duration_s":0.001673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010937,"completed_at":"2026-09-04T07:42:05.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 163.972839] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac84f0487f7a21b555a89296","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac84f0487f7a21b555a89296: start","job_status":"start","queue_duration_s":1.154487,"scheduling_latency_s":1.154501}1432gitlab # [ 163.973827] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac84f0487f7a21b555a89296","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac84f0487f7a21b555a89296: done: 0.009281 sec","job_status":"done","queue_duration_s":1.154487,"scheduling_latency_s":1.154501,"redis_calls":13,"redis_duration_s":0.001581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009281,"completed_at":"2026-09-04T07:42:05.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 164.026064] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9a8948ae63d80a899e19282","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9a8948ae63d80a899e19282: start","job_status":"start","queue_duration_s":1.164621,"scheduling_latency_s":1.164634}1434gitlab # [ 164.027050] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9a8948ae63d80a899e19282","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9a8948ae63d80a899e19282: done: 0.009342 sec","job_status":"done","queue_duration_s":1.164621,"scheduling_latency_s":1.164634,"redis_calls":13,"redis_duration_s":0.0016979999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009342,"completed_at":"2026-09-04T07:42:05.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 164.099051] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:05.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4ab4f5f98a6792354ed50cf","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4ab4f5f98a6792354ed50cf: start","job_status":"start","queue_duration_s":1.174802,"scheduling_latency_s":1.174814}1436gitlab # [ 164.100051] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4ab4f5f98a6792354ed50cf","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4ab4f5f98a6792354ed50cf: done: 0.009956 sec","job_status":"done","queue_duration_s":1.174802,"scheduling_latency_s":1.174814,"redis_calls":13,"redis_duration_s":0.001606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009956,"completed_at":"2026-09-04T07:42:06.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 164.163861] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2549a400323078346bc7eb1","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2549a400323078346bc7eb1: start","job_status":"start","queue_duration_s":1.18566,"scheduling_latency_s":1.185683}1438gitlab # [ 164.164808] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2549a400323078346bc7eb1","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2549a400323078346bc7eb1: done: 0.009271 sec","job_status":"done","queue_duration_s":1.18566,"scheduling_latency_s":1.185683,"redis_calls":13,"redis_duration_s":0.001587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009271,"completed_at":"2026-09-04T07:42:06.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 164.228059] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f828320dfc7610a5c6f0a74","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f828320dfc7610a5c6f0a74: start","job_status":"start","queue_duration_s":1.195798,"scheduling_latency_s":1.195813}1440gitlab # [ 164.229087] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f828320dfc7610a5c6f0a74","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f828320dfc7610a5c6f0a74: done: 0.009155 sec","job_status":"done","queue_duration_s":1.195798,"scheduling_latency_s":1.195813,"redis_calls":13,"redis_duration_s":0.001589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009155,"completed_at":"2026-09-04T07:42:06.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 164.279801] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"761d10d3d08982eacbd72cc4","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-761d10d3d08982eacbd72cc4: start","job_status":"start","queue_duration_s":1.205795,"scheduling_latency_s":1.205809}1442gitlab # [ 164.280855] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"761d10d3d08982eacbd72cc4","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-761d10d3d08982eacbd72cc4: done: 0.00915 sec","job_status":"done","queue_duration_s":1.205795,"scheduling_latency_s":1.205809,"redis_calls":13,"redis_duration_s":0.001628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00915,"completed_at":"2026-09-04T07:42:06.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 164.319712] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"022532151747e71b36996d30","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-022532151747e71b36996d30: start","job_status":"start","queue_duration_s":1.21581,"scheduling_latency_s":1.215824}1444gitlab # [ 164.320425] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"022532151747e71b36996d30","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-022532151747e71b36996d30: done: 0.009314 sec","job_status":"done","queue_duration_s":1.21581,"scheduling_latency_s":1.215824,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009314,"completed_at":"2026-09-04T07:42:06.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 164.336122] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fbcc2e72a4e36d96fece2cc","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fbcc2e72a4e36d96fece2cc: start","job_status":"start","queue_duration_s":1.226386,"scheduling_latency_s":1.226399}1446gitlab # [ 164.347538] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fbcc2e72a4e36d96fece2cc","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fbcc2e72a4e36d96fece2cc: done: 0.009573 sec","job_status":"done","queue_duration_s":1.226386,"scheduling_latency_s":1.226399,"redis_calls":13,"redis_duration_s":0.002094,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009573,"completed_at":"2026-09-04T07:42:06.056Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 164.406395] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67f4648a73fc8b219dfea1c5","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67f4648a73fc8b219dfea1c5: start","job_status":"start","queue_duration_s":1.236802,"scheduling_latency_s":1.236815}1448gitlab # [ 164.407152] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67f4648a73fc8b219dfea1c5","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67f4648a73fc8b219dfea1c5: done: 0.00937 sec","job_status":"done","queue_duration_s":1.236802,"scheduling_latency_s":1.236815,"redis_calls":13,"redis_duration_s":0.001616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00937,"completed_at":"2026-09-04T07:42:06.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 164.448125] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfe6bc98e98f05bcbd2a072f","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfe6bc98e98f05bcbd2a072f: start","job_status":"start","queue_duration_s":1.247014,"scheduling_latency_s":1.247027}1450gitlab # [ 164.448883] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfe6bc98e98f05bcbd2a072f","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfe6bc98e98f05bcbd2a072f: done: 0.009265 sec","job_status":"done","queue_duration_s":1.247014,"scheduling_latency_s":1.247027,"redis_calls":13,"redis_duration_s":0.0016480000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009265,"completed_at":"2026-09-04T07:42:06.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 164.492651] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e228eb634f7be5f63b73bb62","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e228eb634f7be5f63b73bb62: start","job_status":"start","queue_duration_s":1.257493,"scheduling_latency_s":1.257507}1452gitlab # [ 164.493843] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e228eb634f7be5f63b73bb62","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e228eb634f7be5f63b73bb62: done: 0.009336 sec","job_status":"done","queue_duration_s":1.257493,"scheduling_latency_s":1.257507,"redis_calls":13,"redis_duration_s":0.0015829999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009336,"completed_at":"2026-09-04T07:42:06.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 164.545469] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a1dc56b31b5478b7e2037ef","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a1dc56b31b5478b7e2037ef: start","job_status":"start","queue_duration_s":1.26768,"scheduling_latency_s":1.267693}1454gitlab # [ 164.546743] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a1dc56b31b5478b7e2037ef","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a1dc56b31b5478b7e2037ef: done: 0.009327 sec","job_status":"done","queue_duration_s":1.26768,"scheduling_latency_s":1.267693,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009327,"completed_at":"2026-09-04T07:42:06.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 164.609417] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e59bba9bb53c8cfde5f1266e","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e59bba9bb53c8cfde5f1266e: start","job_status":"start","queue_duration_s":1.277849,"scheduling_latency_s":1.277862}1456gitlab # [ 164.610664] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e59bba9bb53c8cfde5f1266e","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e59bba9bb53c8cfde5f1266e: done: 0.009241 sec","job_status":"done","queue_duration_s":1.277849,"scheduling_latency_s":1.277862,"redis_calls":13,"redis_duration_s":0.001673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009241,"completed_at":"2026-09-04T07:42:06.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 164.665501] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e69a653a8ca9f3db788de1ff","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e69a653a8ca9f3db788de1ff: start","job_status":"start","queue_duration_s":1.28793,"scheduling_latency_s":1.287945}1458gitlab # [ 164.669714] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e69a653a8ca9f3db788de1ff","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e69a653a8ca9f3db788de1ff: done: 0.009646 sec","job_status":"done","queue_duration_s":1.28793,"scheduling_latency_s":1.287945,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009646,"completed_at":"2026-09-04T07:42:06.117Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 164.738765] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d8ae1a7d426b53920f021a7","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d8ae1a7d426b53920f021a7: start","job_status":"start","queue_duration_s":1.298387,"scheduling_latency_s":1.2984}1460gitlab # [ 164.739804] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d8ae1a7d426b53920f021a7","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d8ae1a7d426b53920f021a7: done: 0.009314 sec","job_status":"done","queue_duration_s":1.298387,"scheduling_latency_s":1.2984,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009314,"completed_at":"2026-09-04T07:42:06.127Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 164.812477] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a13155403894a7e4abac88b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a13155403894a7e4abac88b: start","job_status":"start","queue_duration_s":1.30855,"scheduling_latency_s":1.308564}1462gitlab # [ 164.813574] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a13155403894a7e4abac88b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a13155403894a7e4abac88b: done: 0.009229 sec","job_status":"done","queue_duration_s":1.30855,"scheduling_latency_s":1.308564,"redis_calls":13,"redis_duration_s":0.001651,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009229,"completed_at":"2026-09-04T07:42:06.138Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 164.880959] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75653080264d4ed20d88cf3f","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75653080264d4ed20d88cf3f: start","job_status":"start","queue_duration_s":1.318649,"scheduling_latency_s":1.318662}1464gitlab # [ 164.881997] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75653080264d4ed20d88cf3f","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75653080264d4ed20d88cf3f: done: 0.009208 sec","job_status":"done","queue_duration_s":1.318649,"scheduling_latency_s":1.318662,"redis_calls":13,"redis_duration_s":0.001609,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009208,"completed_at":"2026-09-04T07:42:06.148Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 164.934357] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ba15bc2b78e6fbaf178260","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ba15bc2b78e6fbaf178260: start","job_status":"start","queue_duration_s":1.329025,"scheduling_latency_s":1.329038}1466gitlab # [ 164.935683] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ba15bc2b78e6fbaf178260","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ba15bc2b78e6fbaf178260: done: 0.009566 sec","job_status":"done","queue_duration_s":1.329025,"scheduling_latency_s":1.329038,"redis_calls":13,"redis_duration_s":0.0015670000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009566,"completed_at":"2026-09-04T07:42:06.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 165.008990] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2676b1dfb5e51b35ce1e607","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2676b1dfb5e51b35ce1e607: start","job_status":"start","queue_duration_s":1.339396,"scheduling_latency_s":1.339408}1468gitlab # [ 165.010060] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2676b1dfb5e51b35ce1e607","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2676b1dfb5e51b35ce1e607: done: 0.009369 sec","job_status":"done","queue_duration_s":1.339396,"scheduling_latency_s":1.339408,"redis_calls":13,"redis_duration_s":0.001586,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009369,"completed_at":"2026-09-04T07:42:06.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 165.021098] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ea2a385426057eda7f5b41a","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ea2a385426057eda7f5b41a: start","job_status":"start","queue_duration_s":1.349595,"scheduling_latency_s":1.349609}1470gitlab # [ 165.036871] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ea2a385426057eda7f5b41a","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ea2a385426057eda7f5b41a: done: 0.009474 sec","job_status":"done","queue_duration_s":1.349595,"scheduling_latency_s":1.349609,"redis_calls":13,"redis_duration_s":0.0016679999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009474,"completed_at":"2026-09-04T07:42:06.179Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 165.110455] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"356ff286aa7a16aed4d7387b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-356ff286aa7a16aed4d7387b: start","job_status":"start","queue_duration_s":1.359923,"scheduling_latency_s":1.359937}1472gitlab # [ 165.111398] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"356ff286aa7a16aed4d7387b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-356ff286aa7a16aed4d7387b: done: 0.009229 sec","job_status":"done","queue_duration_s":1.359923,"scheduling_latency_s":1.359937,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009229,"completed_at":"2026-09-04T07:42:06.189Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 165.187069] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac85b214293bc07fd970d53c","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac85b214293bc07fd970d53c: start","job_status":"start","queue_duration_s":1.370386,"scheduling_latency_s":1.370399}1474gitlab # [ 165.188122] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac85b214293bc07fd970d53c","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac85b214293bc07fd970d53c: done: 0.009329 sec","job_status":"done","queue_duration_s":1.370386,"scheduling_latency_s":1.370399,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009329,"completed_at":"2026-09-04T07:42:06.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 165.241414] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9ae69e96e0c4b1a050021c8","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9ae69e96e0c4b1a050021c8: start","job_status":"start","queue_duration_s":1.380554,"scheduling_latency_s":1.380567}1476gitlab # [ 165.242611] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9ae69e96e0c4b1a050021c8","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9ae69e96e0c4b1a050021c8: done: 0.009361 sec","job_status":"done","queue_duration_s":1.380554,"scheduling_latency_s":1.380567,"redis_calls":13,"redis_duration_s":0.0015890000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009361,"completed_at":"2026-09-04T07:42:06.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 165.290308] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edbfcf664251acc95613fb38","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edbfcf664251acc95613fb38: start","job_status":"start","queue_duration_s":1.390773,"scheduling_latency_s":1.390787}1478gitlab # [ 165.291223] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edbfcf664251acc95613fb38","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edbfcf664251acc95613fb38: done: 0.009259 sec","job_status":"done","queue_duration_s":1.390773,"scheduling_latency_s":1.390787,"redis_calls":13,"redis_duration_s":0.001627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009259,"completed_at":"2026-09-04T07:42:06.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 165.351437] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e898b81745ddecad31da3010","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e898b81745ddecad31da3010: start","job_status":"start","queue_duration_s":1.401221,"scheduling_latency_s":1.401234}1480gitlab # [ 165.352602] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e898b81745ddecad31da3010","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e898b81745ddecad31da3010: done: 0.009324 sec","job_status":"done","queue_duration_s":1.401221,"scheduling_latency_s":1.401234,"redis_calls":13,"redis_duration_s":0.0016229999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009324,"completed_at":"2026-09-04T07:42:06.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 165.405945] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd5891bb65d6f6db46ccb99c","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd5891bb65d6f6db46ccb99c: start","job_status":"start","queue_duration_s":1.411383,"scheduling_latency_s":1.411395}1482gitlab # [ 165.406987] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd5891bb65d6f6db46ccb99c","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd5891bb65d6f6db46ccb99c: done: 0.009471 sec","job_status":"done","queue_duration_s":1.411383,"scheduling_latency_s":1.411395,"redis_calls":13,"redis_duration_s":0.001623,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009471,"completed_at":"2026-09-04T07:42:06.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 165.460431] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7c22ac42b19c1259f92b482","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7c22ac42b19c1259f92b482: start","job_status":"start","queue_duration_s":1.421692,"scheduling_latency_s":1.421705}1484gitlab # [ 165.463748] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7c22ac42b19c1259f92b482","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7c22ac42b19c1259f92b482: done: 0.009313 sec","job_status":"done","queue_duration_s":1.421692,"scheduling_latency_s":1.421705,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009313,"completed_at":"2026-09-04T07:42:06.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 165.523721] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17b36437002e2be653c48445","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17b36437002e2be653c48445: start","job_status":"start","queue_duration_s":1.432049,"scheduling_latency_s":1.432062}1486gitlab # [ 165.526738] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17b36437002e2be653c48445","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17b36437002e2be653c48445: done: 0.009315 sec","job_status":"done","queue_duration_s":1.432049,"scheduling_latency_s":1.432062,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009315,"completed_at":"2026-09-04T07:42:06.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 165.589897] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64e5f6bdf75d4d501bc974dd","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64e5f6bdf75d4d501bc974dd: start","job_status":"start","queue_duration_s":1.44259,"scheduling_latency_s":1.442604}1488gitlab # [ 165.590880] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64e5f6bdf75d4d501bc974dd","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64e5f6bdf75d4d501bc974dd: done: 0.00925 sec","job_status":"done","queue_duration_s":1.44259,"scheduling_latency_s":1.442604,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00925,"completed_at":"2026-09-04T07:42:06.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 165.647831] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e254131ad610b8f4c2ab47b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e254131ad610b8f4c2ab47b: start","job_status":"start","queue_duration_s":1.452666,"scheduling_latency_s":1.452689}1490gitlab # [ 165.649882] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e254131ad610b8f4c2ab47b","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e254131ad610b8f4c2ab47b: done: 0.00926 sec","job_status":"done","queue_duration_s":1.452666,"scheduling_latency_s":1.452689,"redis_calls":13,"redis_duration_s":0.001622,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00926,"completed_at":"2026-09-04T07:42:06.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 165.710672] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f8665a59760c66a5c2a50bc","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f8665a59760c66a5c2a50bc: start","job_status":"start","queue_duration_s":1.46278,"scheduling_latency_s":1.462795}1492gitlab # [ 165.711890] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f8665a59760c66a5c2a50bc","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f8665a59760c66a5c2a50bc: done: 0.009342 sec","job_status":"done","queue_duration_s":1.46278,"scheduling_latency_s":1.462795,"redis_calls":13,"redis_duration_s":0.001655,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009342,"completed_at":"2026-09-04T07:42:06.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 165.767990] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d632a700d58690c6b63f9db","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d632a700d58690c6b63f9db: start","job_status":"start","queue_duration_s":1.472977,"scheduling_latency_s":1.472991}1494gitlab # [ 165.773869] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d632a700d58690c6b63f9db","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d632a700d58690c6b63f9db: done: 0.009555 sec","job_status":"done","queue_duration_s":1.472977,"scheduling_latency_s":1.472991,"redis_calls":13,"redis_duration_s":0.001578,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009555,"completed_at":"2026-09-04T07:42:06.302Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 165.839746] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4cd428bf2635fcf405c97a7","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4cd428bf2635fcf405c97a7: start","job_status":"start","queue_duration_s":1.483343,"scheduling_latency_s":1.483356}1496gitlab # [ 165.840800] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4cd428bf2635fcf405c97a7","created_at":"2026-09-04T07:42:04.756Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-41f36c17754344c9","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"e689c135251738bf259cdba5ae5b7088","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.820Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4cd428bf2635fcf405c97a7: done: 0.009335 sec","job_status":"done","queue_duration_s":1.483343,"scheduling_latency_s":1.483356,"redis_calls":13,"redis_duration_s":0.001694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009335,"completed_at":"2026-09-04T07:42:06.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 165.916386] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.313Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5ead00a1e1f413c9681905ef","created_at":"2026-09-04T07:42:04.915Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-b7078113e10d4aab","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.933Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5ead00a1e1f413c9681905ef: start","job_status":"start","queue_duration_s":1.379929,"scheduling_latency_s":1.379942}1498gitlab # [ 165.917036] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.324Z","message":"No existing merge request to be cleaned up."}1499gitlab # [ 165.917552] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.332Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5ead00a1e1f413c9681905ef","created_at":"2026-09-04T07:42:04.915Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-b7078113e10d4aab","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.933Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5ead00a1e1f413c9681905ef: done: 0.01917 sec","job_status":"done","queue_duration_s":1.379929,"scheduling_latency_s":1.379942,"redis_calls":13,"redis_duration_s":0.001741,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234946,"duration_s":0.01917,"completed_at":"2026-09-04T07:42:06.332Z","load_balancing_strategy":"primary","db_duration_s":0.002554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 165.937771] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.333Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a26ccb0ae4b9371a62e2e88a","created_at":"2026-09-04T07:42:04.915Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-b7078113e10d4aab","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.933Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a26ccb0ae4b9371a62e2e88a: start","job_status":"start","queue_duration_s":1.400023,"scheduling_latency_s":1.400037}1501gitlab # [ 165.980332] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.340Z","message":"No existing merge request to be cleaned up."}1502gitlab # [ 165.981110] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.345Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a26ccb0ae4b9371a62e2e88a","created_at":"2026-09-04T07:42:04.915Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-b7078113e10d4aab","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.933Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a26ccb0ae4b9371a62e2e88a: done: 0.011693 sec","job_status":"done","queue_duration_s":1.400023,"scheduling_latency_s":1.400037,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011693,"completed_at":"2026-09-04T07:42:06.345Z","load_balancing_strategy":"primary","db_duration_s":0.001502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 165.983697] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.346Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b56e2c15c0a8eb5496162274","created_at":"2026-09-04T07:42:04.915Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-b7078113e10d4aab","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.933Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b56e2c15c0a8eb5496162274: start","job_status":"start","queue_duration_s":1.412556,"scheduling_latency_s":1.41257}1504gitlab # [ 165.994824] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.353Z","message":"No existing merge request to be cleaned up."}1505gitlab # [ 165.996267] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.357Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b56e2c15c0a8eb5496162274","created_at":"2026-09-04T07:42:04.915Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-b7078113e10d4aab","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.933Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b56e2c15c0a8eb5496162274: done: 0.010966 sec","job_status":"done","queue_duration_s":1.412556,"scheduling_latency_s":1.41257,"redis_calls":10,"redis_duration_s":0.0013549999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010966,"completed_at":"2026-09-04T07:42:06.357Z","load_balancing_strategy":"primary","db_duration_s":0.001171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 166.043363] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.358Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"943d1ecb30b8e4a94c624df6","created_at":"2026-09-04T07:42:04.915Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-b7078113e10d4aab","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.933Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-943d1ecb30b8e4a94c624df6: start","job_status":"start","queue_duration_s":1.424423,"scheduling_latency_s":1.424436}1507gitlab # [ 166.043578] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.367Z","message":"No existing merge request to be cleaned up."}1508gitlab # [ 166.044201] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:06.372Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"943d1ecb30b8e4a94c624df6","created_at":"2026-09-04T07:42:04.915Z","trace_propagation_headers":{"sentry-trace":"0a77753c53ec420ebd0e3528ffdc6752-b7078113e10d4aab","baggage":"sentry-trace_id=0a77753c53ec420ebd0e3528ffdc6752,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ab670a4a025e8e5adce4cdda62342e96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:04.933Z","job_size_bytes":2,"pid":1625,"sidekiq_tid":"madp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-943d1ecb30b8e4a94c624df6: done: 0.014211 sec","job_status":"done","queue_duration_s":1.424423,"scheduling_latency_s":1.424436,"redis_calls":10,"redis_duration_s":0.0013449999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000801,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014211,"completed_at":"2026-09-04T07:42:06.372Z","load_balancing_strategy":"primary","db_duration_s":0.005258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 166.261747] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1869366919 wd_nsec: 18693668321510gitlab # [ 184.038502] postgres[2424]: [2424] ERROR: relation "table_without_models" does not exist1511gitlab # [ 184.038911] postgres[2424]: [2424] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1512gitlab # [ 187.539348] runuser[2230]: pam_unix(runuser:session): session closed for user gitlab1513gitlab # [ 187.540448] setup-gitlab-start[2205]: + systemctl restart gitlab-sidekiq.service1514gitlab # [ 187.564182] systemd[1]: Stopping gitlab-sidekiq.service...1515gitlab # [ 187.565217] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:30.355Z","message":"Shutting down"}1516gitlab # [ 187.566303] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:30.356Z","message":"Scheduler exiting..."}1517gitlab # [ 187.566989] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:30.357Z","message":"Terminating quiet threads for default capsule"}1518gitlab # [ 187.571704] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:30.359Z","message":"Scheduler exiting..."}1519gitlab # [ 188.073228] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:30.864Z","message":"Pausing to allow jobs to finish..."}1520gitlab # [ 189.076478] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:31.866Z","message":"Bye!"}1521gitlab # [ 189.098447] sidekiq-cluster[1625]: {"severity":"INFO","time":"2026-09-04T07:42:31.889Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1625,"worker_id":"sidekiq_0","memwd_rss_bytes":936099840,"retry":0}1522gitlab # [ 192.027853] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1523gitlab # [ 192.030488] systemd[1]: Stopped gitlab-sidekiq.service.1524gitlab # [ 192.032229] systemd[1]: gitlab-sidekiq.service: Consumed 58.424s CPU time over 1min 58.293s wall clock time, 953.7M memory peak, 4.4M read from disk.1525gitlab # [ 192.040781] systemd[1]: Started gitlab-sidekiq.service.1526gitlab # [ 192.044682] setup-gitlab-start[2205]: + mkdir -p /var/lib/secrets1527gitlab # [ 192.049204] setup-gitlab-start[2205]: + echo nixbot-test-token-of-20-chars1528gitlab # [ 192.050445] setup-gitlab-start[2205]: + chmod 644 /var/lib/secrets/gitlab-token1529gitlab # [ 192.052280] setup-gitlab-start[2205]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1530gitlab # [ 192.721357] gitaly[903]: time="2026-09-04T07:42:35.512Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.511" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1531gitlab # [ 192.722477] gitaly[903]: time="2026-09-04T07:42:35.512Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.511" grpc.time_ms=0.296 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1532gitlab # [ 192.875938] gitaly[903]: time="2026-09-04T07:42:35.665Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.153" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.664" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1533gitlab # [ 192.898368] gitaly[903]: time="2026-09-04T07:42:35.667Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.153" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.664" grpc.time_ms=1.02 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 192.969284] gitaly[903]: time="2026-09-04T07:42:35.760Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A diskcache=5de64676-9545-49db-b4ab-f9aa8378dacd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:42:45.209" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.719" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1535gitlab # [ 192.970204] gitaly[903]: time="2026-09-04T07:42:35.761Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=32 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:42:45.209" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.719" grpc.time_ms=40.851 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1536gitlab # [ 193.006468] gitaly[903]: time="2026-09-04T07:42:35.797Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.286" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.797" pid=903 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1537gitlab # [ 193.016432] gitaly[903]: time="2026-09-04T07:42:35.798Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.286" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.797" grpc.time_ms=0.976 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1538gitlab # [ 193.025811] gitaly[903]: time="2026-09-04T07:42:35.817Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:45.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.804" grpc.time_ms=12.875 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1539gitlab # [ 193.078474] gitaly[903]: time="2026-09-04T07:42:35.869Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.069" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.869" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1540gitlab # [ 193.078783] gitaly[903]: time="2026-09-04T07:42:35.870Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.069" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.869" grpc.time_ms=0.48 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1541gitlab # [ 193.147767] gitaly[903]: time="2026-09-04T07:42:35.939Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A diskcache=78990fe8-ecb0-4f0d-8ac2-6e831f9b9153 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:42:45.098" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.898" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1542gitlab # [ 193.157093] gitaly[903]: time="2026-09-04T07:42:35.948Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1577 command.oublock=32 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:42:45.098" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.898" grpc.time_ms=40.975 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1543gitlab # [ 193.177918] gitaly[903]: time="2026-09-04T07:42:35.969Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.168" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.969" pid=903 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1544gitlab # [ 193.178831] gitaly[903]: time="2026-09-04T07:42:35.969Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:45.168" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.969" grpc.time_ms=0.414 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1545gitlab # [ 193.208985] gitaly[903]: time="2026-09-04T07:42:36.000Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:45.189" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:35.990" grpc.time_ms=10.095 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1546gitlab # [ 193.248803] gitaly[903]: time="2026-09-04T07:42:36.040Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:42:46.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:36.040" grpc.time_ms=0.151 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1547gitlab # [ 193.268598] gitaly[903]: time="2026-09-04T07:42:36.059Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:42:46.028" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:36.059" grpc.time_ms=0.476 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 193.747240] gitaly[903]: time="2026-09-04T07:42:36.537Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX4BF6F9C183R54FJSB9A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:46.015" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:36.526" grpc.time_ms=11.387 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1549gitlab # [ 193.979639] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:36 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 19061550gitlab # [ 193.984611] setup-gitlab-start[2205]: + mkdir -p /tmp/test-flake1551gitlab # [ 193.986869] setup-gitlab-start[2205]: + cd /tmp/test-flake1552gitlab # [ 193.988819] setup-gitlab-start[2205]: + git init -b master1553gitlab # [ 194.005495] setup-gitlab-start[2518]: Initialized empty Git repository in /tmp/test-flake/.git/1554gitlab # [ 194.008476] setup-gitlab-start[2205]: + git config user.name test1555gitlab # [ 194.010547] setup-gitlab-start[2205]: + git config user.email test@example.com1556gitlab # [ 194.012911] setup-gitlab-start[2205]: + cat1557gitlab # [ 194.014425] setup-gitlab-start[2205]: + git add flake.nix1558gitlab # [ 194.016317] setup-gitlab-start[2205]: + git commit -m 'initial commit'1559gitlab # [ 194.032247] setup-gitlab-start[2523]: [master (root-commit) d5695ff] initial commit1560gitlab # [ 194.032464] setup-gitlab-start[2523]: 1 file changed, 10 insertions(+)1561gitlab # [ 194.033565] setup-gitlab-start[2523]: create mode 100644 flake.nix1562gitlab # [ 194.034950] setup-gitlab-start[2205]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1563gitlab # [ 194.043791] setup-gitlab-start[2205]: + git push -u origin master1564gitlab # [ 194.109266] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:36 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 381565gitlab # [ 194.716392] gitaly[903]: time="2026-09-04T07:42:37.507Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6B63JSCMQGZXPVTB8Z3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:37.496" grpc.time_ms=10.857 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1566gitlab # [ 194.746102] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:37 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 6061567gitlab # [ 194.971944] gitaly[903]: time="2026-09-04T07:42:37.761Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:47.240" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:37.751" grpc.time_ms=9.978 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1568gitlab # [ 195.036302] gitaly[903]: time="2026-09-04T07:42:37.827Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=332 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:43:07.016" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:42:37.816" grpc.time_ms=11.057 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1569gitlab # [ 195.068764] gitaly[903]: time="2026-09-04T07:42:37.859Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NNX6Z90318NPVEB8RP55TP duration_ms=167ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/allowed"1570gitlab # [ 195.162515] gitaly[903]: time="2026-09-04T07:42:37.954Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NNX6Z90318NPVEB8RP55TP duration_ms=93ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/pre_receive"1571gitlab # [ 195.163124] gitaly[903]: time="2026-09-04T07:42:37.954Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5308 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:37.691" grpc.time_ms=263.055 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1572gitlab # [ 195.232862] gitaly[903]: time="2026-09-04T07:42:38.024Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:38.023" grpc.time_ms=1.1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1573gitlab # [ 195.294484] sidekiq-cluster[2471]: {"severity":"INFO","time":"2026-09-04T07:42:38.068Z","message":"Starting cluster with 1 processes"}1574gitlab # [ 195.301355] gitaly[903]: time="2026-09-04T07:42:38.092Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:38.092" grpc.time_ms=0.683 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1575gitlab # [ 195.337638] gitaly[903]: time="2026-09-04T07:42:38.129Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:38.128" grpc.time_ms=0.436 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1576gitlab # [ 195.413134] gitaly[903]: time="2026-09-04T07:42:38.204Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:42:48.163" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:38.194" grpc.time_ms=9.862 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1577gitlab # [ 195.431382] gitaly[903]: time="2026-09-04T07:42:38.222Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1559 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:42:48.178" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:38.208" grpc.time_ms=14.373 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1578gitlab # [ 195.452199] gitaly[903]: time="2026-09-04T07:42:38.243Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NNX6Z90318NPVEB8RP55TP duration_ms=83ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/post_receive"1579gitlab # [ 195.455610] gitaly[903]: time="2026-09-04T07:42:38.247Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4802 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:38.159" grpc.time_ms=87.549 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1580gitlab # [ 195.474363] gitaly[903]: time="2026-09-04T07:42:38.265Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP diskcache=8142e762-f201-41d2-b73b-db8e23f7cd47 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:37.614" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1581gitlab # [ 195.474564] gitaly[903]: time="2026-09-04T07:42:38.266Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=269 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13622 command.oublock=32 command.real_time_ms=642 command.spawn_token_fork_ms=0 command.system_time_ms=195 command.user_time_ms=74 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:37.614" grpc.time_ms=651.74 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1582gitlab # [ 195.475519] gitlab-workhorse[829]: time="2026-09-04T07:42:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521583gitlab # [ 195.475934] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:38 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7201584gitlab # [ 195.500236] setup-gitlab-start[2527]: To http://gitlab/root/test-flake.git1585gitlab # [ 195.500591] setup-gitlab-start[2527]: * [new branch] master -> master1586gitlab # [ 195.505296] setup-gitlab-start[2527]: branch 'master' set up to track 'origin/master'.1587gitlab # [ 195.508807] systemd[1]: Finished setup-gitlab.service.1588gitlab # [ 195.511614] systemd[1]: Starting nixbot CI service...1589gitlab: (finished: waiting for unit setup-gitlab.service, in 196.69 seconds)1590gitlab: waiting for unit nixbot.service1591gitlab # [ 196.666187] nixbot[2613]: {"ts": "2026-09-04T07:42:39.457Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1592gitlab # [ 196.697737] nixbot[2613]: {"ts": "2026-09-04T07:42:39.489Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1593gitlab # [ 196.726524] nixbot[2613]: {"ts": "2026-09-04T07:42:39.517Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1594gitlab # [ 196.733378] nixbot[2613]: {"ts": "2026-09-04T07:42:39.524Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1595gitlab # [ 196.738427] nixbot[2613]: {"ts": "2026-09-04T07:42:39.529Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1596gitlab # [ 196.744824] nixbot[2613]: {"ts": "2026-09-04T07:42:39.536Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1597gitlab # [ 196.749755] nixbot[2613]: {"ts": "2026-09-04T07:42:39.541Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1598gitlab # [ 196.753320] nixbot[2613]: {"ts": "2026-09-04T07:42:39.544Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1599gitlab # [ 196.759583] nixbot[2613]: {"ts": "2026-09-04T07:42:39.550Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1600gitlab # [ 196.761812] nixbot[2613]: {"ts": "2026-09-04T07:42:39.553Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1601gitlab # [ 196.765728] nixbot[2613]: {"ts": "2026-09-04T07:42:39.557Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1602gitlab # [ 196.770583] nixbot[2613]: {"ts": "2026-09-04T07:42:39.562Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1603gitlab # [ 196.775594] nixbot[2613]: {"ts": "2026-09-04T07:42:39.567Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1604gitlab # [ 196.780074] nixbot[2613]: {"ts": "2026-09-04T07:42:39.571Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1605gitlab # [ 196.785537] nixbot[2613]: {"ts": "2026-09-04T07:42:39.577Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1606gitlab # [ 196.789749] nixbot[2613]: {"ts": "2026-09-04T07:42:39.581Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1607gitlab # [ 196.793775] nixbot[2613]: {"ts": "2026-09-04T07:42:39.585Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1608gitlab # [ 196.797679] nixbot[2613]: {"ts": "2026-09-04T07:42:39.589Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1609gitlab # [ 196.803579] nixbot[2613]: {"ts": "2026-09-04T07:42:39.595Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1610gitlab # [ 196.808478] nixbot[2613]: {"ts": "2026-09-04T07:42:39.599Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1611gitlab # [ 196.813113] nixbot[2613]: {"ts": "2026-09-04T07:42:39.604Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1612gitlab # [ 196.818863] nixbot[2613]: {"ts": "2026-09-04T07:42:39.610Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1613gitlab # [ 196.823128] nixbot[2613]: {"ts": "2026-09-04T07:42:39.614Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1614gitlab # [ 196.827391] nixbot[2613]: {"ts": "2026-09-04T07:42:39.618Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1615gitlab # [ 196.831359] nixbot[2613]: {"ts": "2026-09-04T07:42:39.622Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1616gitlab # [ 196.836069] nixbot[2613]: {"ts": "2026-09-04T07:42:39.627Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1617gitlab # [ 196.840443] nixbot[2613]: {"ts": "2026-09-04T07:42:39.631Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1618gitlab # [ 196.844427] nixbot[2613]: {"ts": "2026-09-04T07:42:39.635Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1619gitlab # [ 196.848613] nixbot[2613]: {"ts": "2026-09-04T07:42:39.640Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1620gitlab # [ 196.859248] nixbot[2613]: {"ts": "2026-09-04T07:42:39.650Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1621gitlab # [ 196.864857] nixbot[2613]: {"ts": "2026-09-04T07:42:39.656Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1622gitlab # [ 197.188797] nixbot[2613]: INFO: Started server process [2613]1623gitlab # [ 197.189085] nixbot[2613]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1624gitlab # [ 197.209337] nixbot[2613]: INFO: ::ffff:127.0.0.1:43384 - "GET /health HTTP/1.1" 200 OK1625gitlab # [ 197.218809] systemd[1]: Started nixbot CI service.1626gitlab # [ 197.221659] systemd[1]: Reached target Multi-User System.1627gitlab # [ 197.223149] systemd[1]: Startup finished in 1.165s (kernel) + 2.928s (initrd) + 3min 13.128s (userspace) = 3min 17.222s.1628gitlab # [ 197.876045] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:40 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 6671629gitlab # [ 197.882869] nixbot[2613]: {"ts": "2026-09-04T07:42:40.674Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1630gitlab # [ 197.907094] nixbot[2613]: {"ts": "2026-09-04T07:42:40.698Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1631gitlab # [ 197.967284] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 461632gitlab # [ 197.973501] nixbot[2613]: {"ts": "2026-09-04T07:42:40.764Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1633gitlab # [ 197.980563] nixbot[2613]: {"ts": "2026-09-04T07:42:40.772Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1634gitlab # [ 198.074611] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 861635gitlab # [ 198.080617] nixbot[2613]: {"ts": "2026-09-04T07:42:40.872Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1636gitlab: (finished: waiting for unit nixbot.service, in 2.06 seconds)1637gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1638gitlab # [ 198.181180] nixbot[2613]: INFO: ::ffff:127.0.0.1:43390 - "GET /health HTTP/1.1" 200 OK1639gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1640subtest: project discovered and webhook registered1641gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1642gitlab # [ 198.190935] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:40 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 961643gitlab # [ 198.192372] nixbot[2613]: {"ts": "2026-09-04T07:42:40.983Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1644gitlab # [ 198.263942] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 561645gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1646(finished: subtest: project discovered and webhook registered, in 0.08 seconds)1647subtest: push delivers the webhook1648gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1649gitlab # [ 198.280792] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 791650gitlab # [ 198.281843] nixbot[2613]: {"ts": "2026-09-04T07:42:41.073Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1651gitlab # [ 198.339768] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 551652gitlab # [ 198.342800] nixbot[2613]: {"ts": "2026-09-04T07:42:41.134Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1653gitlab # [ 198.349698] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 471654gitlab # [ 198.393283] gitaly[903]: time="2026-09-04T07:42:41.184Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAFMC7680S6R3FM6BRTM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-04T07:43:11.074" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:41.174" grpc.time_ms=9.316 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 198.418344] gitaly[903]: time="2026-09-04T07:42:41.209Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAFRZTRSANDK1YZQH4ND grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.202" grpc.time_ms=6.875 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1656gitlab # [ 198.419329] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 204 "" "git/2.55.0" 661657gitlab # [ 198.420442] gitaly[903]: time="2026-09-04T07:42:41.212Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAFMC7680S6R3FM6BRTM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:11.108" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:41.209" grpc.time_ms=2.698 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # Enumerating objects: 5, done.1659gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1660gitlab # Delta compression using up to 4 threads1661gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1662gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1663gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1664gitlab # [ 198.454923] gitaly[903]: time="2026-09-04T07:42:41.246Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAFMC7680S6R3FM6BRTM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-04T07:42:51.207" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:41.238" grpc.time_ms=8.18 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 198.487839] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1381666gitlab # [ 198.491064] nixbot[2613]: {"ts": "2026-09-04T07:42:41.282Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1667gitlab # [ 198.554070] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 601668gitlab # [ 198.557400] nixbot[2613]: {"ts": "2026-09-04T07:42:41.348Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1669gitlab # [ 198.564589] nixbot[2613]: {"ts": "2026-09-04T07:42:41.354Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1670gitlab # [ 198.611832] gitaly[903]: time="2026-09-04T07:42:41.403Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:43:11.295" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:42:41.396" grpc.time_ms=6.79 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1671gitlab # [ 198.635462] gitaly[903]: time="2026-09-04T07:42:41.427Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NNXAK02VJF4G8TB9F02H46 duration_ms=74ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/allowed"1672gitlab # [ 198.637453] gitaly[903]: time="2026-09-04T07:42:41.428Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAQ891CBZNYGP9KS6G1J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.420" grpc.time_ms=7.968 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1673gitlab # [ 198.650482] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 521674gitlab # [ 198.657825] gitaly[903]: time="2026-09-04T07:42:41.449Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NNXAK02VJF4G8TB9F02H46 duration_ms=19ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/pre_receive"1675gitlab # [ 198.661076] gitaly[903]: time="2026-09-04T07:42:41.451Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5308 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:41.351" grpc.time_ms=99.314 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1676gitlab # [ 198.690344] gitaly[903]: time="2026-09-04T07:42:41.481Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:41.481" grpc.time_ms=0.454 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1677gitlab # [ 198.722231] gitaly[903]: time="2026-09-04T07:42:41.513Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4777 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:41.513" grpc.time_ms=0.421 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1678gitlab # [ 198.742710] gitaly[903]: time="2026-09-04T07:42:41.534Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAS5817K2NS76KQRZYYA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.527" pid=903 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1679gitlab # [ 198.743108] gitaly[903]: time="2026-09-04T07:42:41.534Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAS5817K2NS76KQRZYYA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.527" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1680gitlab # [ 198.747644] gitaly[903]: time="2026-09-04T07:42:41.536Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAS5817K2NS76KQRZYYA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.527" grpc.time_ms=8.771 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1681gitlab # [ 198.749847] gitlab-workhorse[829]: time="2026-09-04T07:42:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131682gitlab # [ 198.753293] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 911683gitlab # [ 198.789822] gitaly[903]: time="2026-09-04T07:42:41.581Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:41.580" grpc.time_ms=0.634 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1684gitlab # [ 198.807670] gitaly[903]: time="2026-09-04T07:42:41.599Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAW56E1ZD80WK0NSFA5A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.580" pid=903 remote_ip="2001:db8:1::1" request_sha=a625ec6cb642b4f76683e5d5a8647932317fe09c response_bytes=418 span.kind=server system=grpc1685gitlab # [ 198.808135] gitaly[903]: time="2026-09-04T07:42:41.599Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAW56E1ZD80WK0NSFA5A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.580" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1686gitlab # [ 198.808842] gitaly[903]: time="2026-09-04T07:42:41.599Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAW56E1ZD80WK0NSFA5A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.580" grpc.time_ms=19.229 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1687gitlab # [ 198.809443] gitlab-workhorse[829]: time="2026-09-04T07:42:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4181688gitlab # [ 198.809911] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 581689gitlab # [ 198.875710] gitaly[903]: time="2026-09-04T07:42:41.666Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NNXAK02VJF4G8TB9F02H46 duration_ms=54ns method=POST pid=903 status=200 url="http://unix/api/v4/internal/post_receive"1690gitlab # [ 198.879144] gitaly[903]: time="2026-09-04T07:42:41.667Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4802 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:41.611" grpc.time_ms=55.074 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1691gitlab # [ 198.890262] gitaly[903]: time="2026-09-04T07:42:41.679Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 diskcache=1932715e-0de7-42d9-90e5-b75159506057 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.301" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1692gitlab # To http://gitlab/root/test-flake.git1693gitlab # d5695ff..ce82117 [ 198.899919] gitlab-workhorse[829]: time="2026-09-04T07:42:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521694gitlab # [ 198.900610] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4311695gitlab # [ 198.901101] gitaly[903]: time="2026-09-04T07:42:41.679Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=124 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13090 command.oublock=32 command.real_time_ms=368 command.spawn_token_fork_ms=0 command.system_time_ms=78 command.user_time_ms=46 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.301" grpc.time_ms=378.513 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1696gitlab # master -> master1697gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.66 seconds)1698gitlab: must succeed: git -C /tmp/test-flake rev-parse master1699gitlab # [ 198.925085] gitaly[903]: time="2026-09-04T07:42:41.716Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXB07ZXVMVKRJH57SW0FN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.709" grpc.time_ms=6.999 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1700gitlab # [ 198.925618] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 451701gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1702gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1703gitlab # [ 198.994539] gitaly[903]: time="2026-09-04T07:42:41.785Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXB23RN41RNH9T51PHRXS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.778" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1704gitlab # [ 198.994786] gitaly[903]: time="2026-09-04T07:42:41.786Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXB23RN41RNH9T51PHRXS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.778" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1705gitlab # [ 198.996431] gitaly[903]: time="2026-09-04T07:42:41.787Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXB23RN41RNH9T51PHRXS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.778" grpc.time_ms=9.438 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1706gitlab # [ 199.002638] nixbot[2613]: INFO: ::ffff:127.0.0.1:43392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1707gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.08 seconds)1708gitlab # [ 199.029858] gitlab-workhorse[829]: time="2026-09-04T07:42:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671709gitlab # [ 199.032195] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 901710gitlab # [ 199.099186] gitaly[903]: time="2026-09-04T07:42:41.890Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXB5SMMN74KBXQAKYX5X1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.882" grpc.time_ms=8.086 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1711gitlab # [ 199.111053] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 411712gitlab # [ 199.152079] gitaly[903]: time="2026-09-04T07:42:41.943Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXB74FKSZ2CBHAFCGCMV0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.931" pid=903 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1713gitlab # [ 199.152745] gitaly[903]: time="2026-09-04T07:42:41.943Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXB74FKSZ2CBHAFCGCMV0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.931" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1714gitlab # [ 199.153733] gitaly[903]: time="2026-09-04T07:42:41.944Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1167 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXB74FKSZ2CBHAFCGCMV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:41.931" grpc.time_ms=12.7 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1715gitlab # [ 199.154725] gitlab-workhorse[829]: time="2026-09-04T07:42:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091716gitlab # [ 199.155920] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 511717gitlab # [ 199.272063] gitaly[903]: time="2026-09-04T07:42:42.063Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:12.061" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:42.062" grpc.time_ms=0.882 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1718gitlab # [ 199.341603] gitaly[903]: time="2026-09-04T07:42:42.133Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:43:12.121" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:42.121" grpc.time_ms=11.493 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1719gitlab # [ 199.389975] gitaly[903]: time="2026-09-04T07:42:42.181Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:52.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:42.174" grpc.time_ms=6.962 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720gitlab # [ 199.431123] gitaly[903]: time="2026-09-04T07:42:42.222Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:42:52.042" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:42.212" grpc.time_ms=9.336 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1721gitlab # [ 199.524901] gitaly[903]: time="2026-09-04T07:42:42.316Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:42:52.144" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:42.315" grpc.time_ms=0.519 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1722gitlab # [ 199.571698] gitaly[903]: time="2026-09-04T07:42:42.363Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:42:52.178" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:42.349" grpc.time_ms=12.939 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1723gitlab # [ 199.656470] gitaly[903]: time="2026-09-04T07:42:42.447Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4147 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:42.447" grpc.time_ms=0.62 pid=903 span.kind=server system=grpc1724gitlab # [ 199.713982] gitaly[903]: time="2026-09-04T07:42:42.505Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:42:42.504" grpc.time_ms=0.69 pid=903 span.kind=server system=grpc1725gitlab # [ 199.746222] gitaly[903]: time="2026-09-04T07:42:42.537Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG diskcache=ea55cf61-2959-4d25-abff-14d3bcb968df grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:42:52.223" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:42.394" pid=903 ref=refs/keep-around/d5695ff3e818035e88fdb465ea1101d1c1794775 remote_ip="2001:db8:1::1" revision=d5695ff3e818035e88fdb465ea1101d1c1794775 span.kind=server system=grpc username=root1726gitlab # [ 199.746590] gitaly[903]: time="2026-09-04T07:42:42.538Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=101 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5107 command.oublock=8 command.real_time_ms=134 command.spawn_token_fork_ms=0 command.system_time_ms=63 command.user_time_ms=38 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:42:52.223" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:42:42.394" grpc.time_ms=143.444 pid=903 ref=refs/keep-around/d5695ff3e818035e88fdb465ea1101d1c1794775 remote_ip="2001:db8:1::1" revision=d5695ff3e818035e88fdb465ea1101d1c1794775 span.kind=server system=grpc username=root1727gitlab # [ 199.780993] gitaly[903]: time="2026-09-04T07:42:42.572Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:12.571" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:42.572" grpc.time_ms=0.324 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1728gitlab # [ 199.955521] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 7331729gitlab # [ 199.962403] nixbot[2613]: {"ts": "2026-09-04T07:42:42.753Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 \"HTTP/1.1 201 Created\""}1730gitlab # [ 199.979751] nixbot[2613]: {"ts": "2026-09-04T07:42:42.771Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-d5695ff3e818-0"}1731gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1732gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1733gitlab # [ 200.070527] nixbot[2613]: INFO: ::ffff:127.0.0.1:43404 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1734gitlab # [ 200.180756] nixbot[2613]: {"ts": "2026-09-04T07:42:42.972Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-d5695ff3e818-0", "argv0": "bwrap"}1735gitlab # [ 200.303396] systemd[1]: Started Nix Daemon.1736gitlab # [ 200.361359] nix-daemon[2842]: accepted connection from pid 2837, user nixbot1737gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1738gitlab # [ 201.110692] nixbot[2613]: INFO: ::ffff:127.0.0.1:43406 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1739gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1740gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1741gitlab # [ 202.150377] nixbot[2613]: INFO: ::ffff:127.0.0.1:43412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1742gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1743gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1744gitlab # [ 203.189482] nixbot[2613]: INFO: ::ffff:127.0.0.1:48536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1745gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1746gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1747gitlab # [ 204.230569] nixbot[2613]: INFO: ::ffff:127.0.0.1:48544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1748gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1749gitlab # [ 204.779706] nix-daemon[2842]: accepted connection from pid 2865, user nixbot1750gitlab # [ 204.793378] nix-daemon[2842]: accepted connection from pid 2837, user nixbot1751gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1752gitlab # [ 205.273709] nixbot[2613]: INFO: ::ffff:127.0.0.1:48558 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1753gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1754gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1755gitlab # [ 206.314854] nixbot[2613]: INFO: ::ffff:127.0.0.1:48566 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1756gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1757gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1758gitlab # [ 207.358435] nixbot[2613]: INFO: ::ffff:127.0.0.1:48578 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1759gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1760gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1761gitlab # [ 208.401688] nixbot[2613]: INFO: ::ffff:127.0.0.1:48584 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1762gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1763gitlab # [ 209.387359] nix-daemon[2842]: accepted connection from pid 2837, user nixbot1764gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1765gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.05 seconds)1766gitlab # [ 209.456882] nixbot[2613]: INFO: ::ffff:127.0.0.1:48598 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1767gitlab # [ 209.489133] nix-daemon[2842]: accepted connection from pid 2902, user nixbot1768gitlab # [ 209.537939] gitaly[903]: time="2026-09-04T07:42:52.328Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXNB9DAZMBQNANT20ZR71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:22.326" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:52.327" grpc.time_ms=0.852 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 209.588727] gitaly[903]: time="2026-09-04T07:42:52.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXNB9DAZMBQNANT20ZR71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:02.200" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:52.371" grpc.time_ms=8.906 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 209.658228] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1821771gitlab # [ 209.664692] nixbot[2613]: {"ts": "2026-09-04T07:42:52.456Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 \"HTTP/1.1 201 Created\""}1772gitlab # [ 209.727946] gitaly[903]: time="2026-09-04T07:42:52.519Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXNHKMYREGJQQJPTZ7YE9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:22.517" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:52.518" grpc.time_ms=1.093 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 209.798754] gitaly[903]: time="2026-09-04T07:42:52.590Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=618 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXNHKMYREGJQQJPTZ7YE9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:02.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:52.577" grpc.time_ms=12.134 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 209.939916] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2631775gitlab # [ 209.941393] nixbot[2613]: {"ts": "2026-09-04T07:42:52.732Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 \"HTTP/1.1 201 Created\""}1776gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1777gitlab # [ 210.495557] nixbot[2613]: INFO: ::ffff:127.0.0.1:48606 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1778gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1779gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1780gitlab # [ 211.534358] nixbot[2613]: INFO: ::ffff:127.0.0.1:48614 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1781gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1782gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1783gitlab # [ 212.574295] nixbot[2613]: INFO: ::ffff:127.0.0.1:48624 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1784gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1785gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1786gitlab # [ 213.614535] nixbot[2613]: INFO: ::ffff:127.0.0.1:55136 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1787gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1788gitlab # [ 213.970984] nix-daemon[2842]: accepted connection from pid 2940, user nixbot1789gitlab # [ 214.047927] gitaly[903]: time="2026-09-04T07:42:56.839Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXSRQGXDSXQG5SRZF9YK7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:43:26.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:42:56.838" grpc.time_ms=0.76 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 214.297484] gitaly[903]: time="2026-09-04T07:42:57.088Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXSRQGXDSXQG5SRZF9YK7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:07.046" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:42:57.077" grpc.time_ms=11.197 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 214.380140] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3781792gitlab # [ 214.386056] nixbot[2613]: {"ts": "2026-09-04T07:42:57.171Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 \"HTTP/1.1 201 Created\""}1793gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1794gitlab # [ 214.655936] gitaly[903]: time="2026-09-04T07:42:57.447Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXTB6TMKWGYY184K1S5PG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.439" grpc.time_ms=7.257 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1795gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.06 seconds)1796gitlab # [ 214.681077] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651797gitlab # [ 214.685325] nixbot[2613]: INFO: ::ffff:127.0.0.1:55148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1798gitlab # [ 214.749313] gitaly[903]: time="2026-09-04T07:42:57.540Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTDPSF41RHH32TS81MXF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.530" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1799gitlab # [ 214.771359] gitaly[903]: time="2026-09-04T07:42:57.540Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTDPSF41RHH32TS81MXF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.530" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1800gitlab # [ 214.771565] gitlab-workhorse[829]: time="2026-09-04T07:42:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671801gitlab # [ 214.772662] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 791802gitlab # [ 214.773773] gitaly[903]: time="2026-09-04T07:42:57.541Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTDPSF41RHH32TS81MXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.530" grpc.time_ms=10.802 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1803gitlab # [ 214.885104] gitaly[903]: time="2026-09-04T07:42:57.676Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXTJQQRNHGCW2S0FBF6SY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.667" grpc.time_ms=8.606 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1804gitlab # [ 214.897628] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 641805gitlab # [ 214.956553] gitaly[903]: time="2026-09-04T07:42:57.748Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTMV77MT79X8S3CEKRJH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.739" pid=903 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1806gitlab # [ 214.956796] gitaly[903]: time="2026-09-04T07:42:57.748Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTMV77MT79X8S3CEKRJH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.739" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1807gitlab # [ 214.977746] gitaly[903]: time="2026-09-04T07:42:57.769Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTMV77MT79X8S3CEKRJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.739" grpc.time_ms=29.995 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1808gitlab # [ 214.991365] gitlab-workhorse[829]: time="2026-09-04T07:42:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671809gitlab # [ 214.991729] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 901810gitlab # [ 215.069816] gitaly[903]: time="2026-09-04T07:42:57.860Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXTRP8488GM1AP5VA2YV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.854" grpc.time_ms=6.326 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1811gitlab # [ 215.070100] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 471812gitlab # [ 215.133817] gitaly[903]: time="2026-09-04T07:42:57.925Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTT7N9NJYHNAAA475W2Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.908" pid=903 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1813gitlab # [ 215.134602] gitaly[903]: time="2026-09-04T07:42:57.925Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTT7N9NJYHNAAA475W2Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.908" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1814gitlab # [ 215.135869] gitlab-workhorse[829]: time="2026-09-04T07:42:57Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161815gitlab # [ 215.136785] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:42:57 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 621816gitlab # [ 215.138677] gitaly[903]: time="2026-09-04T07:42:57.925Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXTT7N9NJYHNAAA475W2Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:42:57.908" grpc.time_ms=17.246 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc1817gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1818gitlab # [ 215.721906] nixbot[2613]: INFO: ::ffff:127.0.0.1:55156 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1819gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1820gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1821gitlab # [ 216.761548] nixbot[2613]: INFO: ::ffff:127.0.0.1:55166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1822gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1823gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1824gitlab # [ 217.788430] nixbot[2613]: INFO: ::ffff:127.0.0.1:55182 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.03 seconds)1826gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1827gitlab # [ 218.829202] nixbot[2613]: INFO: ::ffff:127.0.0.1:55196 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1829gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1830gitlab # [ 219.870688] nixbot[2613]: INFO: ::ffff:127.0.0.1:55198 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1832gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1833gitlab # [ 220.909141] nixbot[2613]: INFO: ::ffff:127.0.0.1:55214 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1834gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1835gitlab # [ 221.716921] sidekiq-cluster[2582]: 2026-09-04T07:43:04.507Z pid=2582 tid=xby INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2582, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434724864}1836gitlab # [ 221.892474] sidekiq-cluster[2582]: W, [2026-09-04T07:43:04.683874 #2582] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1837gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1838gitlab # [ 221.932740] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:04.724Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1839gitlab # [ 221.951484] nixbot[2613]: INFO: ::ffff:127.0.0.1:55216 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1840gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1841gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1842gitlab # [ 222.992287] nixbot[2613]: INFO: ::ffff:127.0.0.1:36704 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1844gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1845gitlab # [ 224.019375] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:06.810Z","message":"GitLab reliable fetch activated!"}1846gitlab # [ 224.020451] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:06.810Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1847gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1848gitlab # [ 224.032556] nixbot[2613]: INFO: ::ffff:127.0.0.1:36710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1849gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1850gitlab # [ 225.068890] nixbot[2613]: INFO: ::ffff:127.0.0.1:36712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1852gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1853gitlab # [ 226.109774] nixbot[2613]: INFO: ::ffff:127.0.0.1:36714 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1854gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1855gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1856gitlab # [ 227.148946] nixbot[2613]: INFO: ::ffff:127.0.0.1:36726 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1857gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1858gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1859gitlab # [ 228.189882] nixbot[2613]: INFO: ::ffff:127.0.0.1:36728 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1860gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1861gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1862gitlab # [ 229.232236] nixbot[2613]: INFO: ::ffff:127.0.0.1:36740 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1863gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1864gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1865gitlab # [ 230.276075] nixbot[2613]: INFO: ::ffff:127.0.0.1:36746 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1866gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1867gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1868gitlab # [ 231.316593] nixbot[2613]: INFO: ::ffff:127.0.0.1:36760 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1869gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1870gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1871gitlab # [ 232.357388] nixbot[2613]: INFO: ::ffff:127.0.0.1:36766 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1872gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1873gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1874gitlab # [ 233.398757] nixbot[2613]: INFO: ::ffff:127.0.0.1:42776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1875gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1876gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1877gitlab # [ 234.437765] nixbot[2613]: INFO: ::ffff:127.0.0.1:42784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1879gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1880gitlab # [ 235.476095] nixbot[2613]: INFO: ::ffff:127.0.0.1:42792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1881gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1882gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1883gitlab # [ 236.513537] nixbot[2613]: INFO: ::ffff:127.0.0.1:42802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1884gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1885gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1886gitlab # [ 237.550237] nixbot[2613]: INFO: ::ffff:127.0.0.1:42812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1887gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1888gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1889gitlab # [ 238.587555] nixbot[2613]: INFO: ::ffff:127.0.0.1:42824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1890gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1891gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1892gitlab # [ 239.624853] nixbot[2613]: INFO: ::ffff:127.0.0.1:42832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1893gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1894gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1895gitlab # [ 240.663122] nixbot[2613]: INFO: ::ffff:127.0.0.1:42834 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1896gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1897gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1898gitlab # [ 241.697978] nixbot[2613]: INFO: ::ffff:127.0.0.1:42836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.03 seconds)1900gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1901gitlab # [ 242.736381] nixbot[2613]: INFO: ::ffff:127.0.0.1:42844 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1903gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1904gitlab # [ 243.773772] nixbot[2613]: INFO: ::ffff:127.0.0.1:49254 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1905gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1906gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1907gitlab # [ 244.803101] nixbot[2613]: INFO: ::ffff:127.0.0.1:49268 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1908gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.03 seconds)1909gitlab # [ 245.600944] postgres[3140]: [3140] ERROR: relation "table_without_models" does not exist1910gitlab # [ 245.602066] postgres[3140]: [3140] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1911gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1912gitlab # [ 245.841450] nixbot[2613]: INFO: ::ffff:127.0.0.1:49284 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1914gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1915gitlab # [ 246.882469] nixbot[2613]: INFO: ::ffff:127.0.0.1:49290 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1916gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1917gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1918gitlab # [ 247.923151] nixbot[2613]: INFO: ::ffff:127.0.0.1:49296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1919gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1920gitlab # [ 248.185849] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:30.976Z","message":"Booted Rails 7.2.3.1 application in production environment"}1921gitlab # [ 248.186718] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:30.977Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1922gitlab # [ 248.187565] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:30.977Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1923gitlab # [ 248.188691] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:30.977Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1924gitlab # [ 248.189442] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:30.980Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1925gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1926gitlab # [ 248.962964] nixbot[2613]: INFO: ::ffff:127.0.0.1:49310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1927gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1928gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1929gitlab # [ 250.003583] nixbot[2613]: INFO: ::ffff:127.0.0.1:49326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1931gitlab # [ 250.060280] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:32.850Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"928c10f8f60edcc28694a388","created_at":"2026-09-04T07:42:35.828Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:35.853Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-928c10f8f60edcc28694a388: start","job_status":"start","queue_duration_s":56.996372,"scheduling_latency_s":56.996459}1932gitlab # [ 250.311853] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.102Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"928c10f8f60edcc28694a388","created_at":"2026-09-04T07:42:35.828Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:35.853Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-928c10f8f60edcc28694a388: done: 0.252832 sec","job_status":"done","queue_duration_s":56.996372,"scheduling_latency_s":56.996459,"redis_calls":23,"redis_duration_s":0.007625,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003838,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002119,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001668,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.110868281,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.252832,"completed_at":"2026-09-04T07:43:33.102Z","load_balancing_strategy":"primary","db_duration_s":0.062684,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1933gitlab # [ 250.385114] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.104Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"0143ac3e85c5f29a3aa8d54a","created_at":"2026-09-04T07:42:35.861Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:35.865Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-0143ac3e85c5f29a3aa8d54a: start","job_status":"start","queue_duration_s":57.239094,"scheduling_latency_s":57.239114}1934gitlab # [ 250.400746] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.192Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"0143ac3e85c5f29a3aa8d54a","created_at":"2026-09-04T07:42:35.861Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:35.865Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-0143ac3e85c5f29a3aa8d54a: done: 0.087561 sec","job_status":"done","queue_duration_s":57.239094,"scheduling_latency_s":57.239114,"redis_calls":14,"redis_duration_s":0.003904,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000746,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001663,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001495,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.068234929,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.087561,"completed_at":"2026-09-04T07:43:33.191Z","load_balancing_strategy":"primary","db_duration_s":0.025473,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1935gitlab # [ 250.422104] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.193Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7e0575dc1a18e94f24d084b0","created_at":"2026-09-04T07:42:36.448Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:36.453Z","job_size_bytes":5,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7e0575dc1a18e94f24d084b0: start","job_status":"start","queue_duration_s":56.739584,"scheduling_latency_s":56.739599}1936gitlab # [ 250.530554] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.321Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7e0575dc1a18e94f24d084b0","created_at":"2026-09-04T07:42:36.448Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:36.453Z","job_size_bytes":5,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7e0575dc1a18e94f24d084b0: done: 0.128143 sec","job_status":"done","queue_duration_s":56.739584,"scheduling_latency_s":56.739599,"redis_calls":12,"redis_duration_s":0.003115,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000702,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001958,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000455,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036988,"duration_s":0.128143,"completed_at":"2026-09-04T07:43:33.321Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02704,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1937gitlab # [ 250.600417] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.391Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"fd4cf7f919ae950ec5f44d8f","created_at":"2026-09-04T07:42:36.476Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:36.479Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-fd4cf7f919ae950ec5f44d8f: start","job_status":"start","queue_duration_s":56.911819,"scheduling_latency_s":56.911879}1938gitlab # [ 250.814589] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.605Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"fd4cf7f919ae950ec5f44d8f","created_at":"2026-09-04T07:42:36.476Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:36.479Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-fd4cf7f919ae950ec5f44d8f: done: 0.214717 sec","job_status":"done","queue_duration_s":56.911819,"scheduling_latency_s":56.911879,"redis_calls":11,"redis_duration_s":0.0034690000000000003,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00102,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001904,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000545,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.163,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.163,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341943,"duration_s":0.214717,"completed_at":"2026-09-04T07:43:33.605Z","load_balancing_strategy":"primary","db_duration_s":0.079035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1939gitlab # [ 250.896316] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.686Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"21030c401637c2520d5344af","created_at":"2026-09-04T07:42:36.481Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:36.484Z","job_size_bytes":89,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-21030c401637c2520d5344af: start","job_status":"start","queue_duration_s":57.202136,"scheduling_latency_s":57.202178}1940gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1941gitlab # [ 250.964719] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.755Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"21030c401637c2520d5344af","created_at":"2026-09-04T07:42:36.481Z","trace_propagation_headers":{"sentry-trace":"86edf308ce35409c9531a30b9c8c3c20-f56f0b08c2264307","baggage":"sentry-trace_id=86edf308ce35409c9531a30b9c8c3c20,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX4BF6F9C183R54FJSB9A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:36.484Z","job_size_bytes":89,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-21030c401637c2520d5344af: done: 0.06871 sec","job_status":"done","queue_duration_s":57.202136,"scheduling_latency_s":57.202178,"redis_calls":11,"redis_duration_s":0.003134,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000806,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000487772,"duration_s":0.06871,"completed_at":"2026-09-04T07:43:33.755Z","load_balancing_strategy":"primary","db_duration_s":0.007704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1942gitlab # [ 251.027768] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.818Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 d5695ff3e818035e88fdb465ea1101d1c1794775 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d588c0d0248e8d6328680753","created_at":"2026-09-04T07:42:38.183Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-8216fd3869bd47f7","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:38.186Z","job_size_bytes":185,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d588c0d0248e8d6328680753: start","job_status":"start","queue_duration_s":55.632222,"scheduling_latency_s":55.632278}1943gitlab # [ 251.052776] nixbot[2613]: INFO: ::ffff:127.0.0.1:49336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1944gitlab # [ 251.056240] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:33.847Z","message":"changes: \"0000000000000000000000000000000000000000 d5695ff3e818035e88fdb465ea1101d1c1794775 refs/heads/master\\n\""}1945gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.05 seconds)1946gitlab # [ 251.108190] gitaly[903]: time="2026-09-04T07:43:33.898Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:43.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:33.886" grpc.time_ms=12.379 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1947gitlab # [ 251.142435] gitaly[903]: time="2026-09-04T07:43:33.933Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:43:43.044" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:33.924" grpc.time_ms=8.848 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 251.212170] gitaly[903]: time="2026-09-04T07:43:34.003Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:43:43.110" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:33.991" grpc.time_ms=12.165 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 251.285331] gitaly[903]: time="2026-09-04T07:43:34.076Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3930 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:34.076" grpc.time_ms=0.544 pid=903 span.kind=server system=grpc1950gitlab # [ 251.346597] gitaly[903]: time="2026-09-04T07:43:34.137Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:34.136" grpc.time_ms=0.822 pid=903 span.kind=server system=grpc1951gitlab # [ 251.377660] gitaly[903]: time="2026-09-04T07:43:34.169Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP diskcache=30da7250-ab80-4472-b1d9-4bc0299abe62 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:43:44.020" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:34.031" pid=903 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1952gitlab # [ 251.395930] gitaly[903]: time="2026-09-04T07:43:34.187Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=115 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5229 command.oublock=8 command.real_time_ms=129 command.spawn_token_fork_ms=0 command.system_time_ms=64 command.user_time_ms=51 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:43:44.020" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:34.031" grpc.time_ms=138.226 pid=903 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1953gitlab # [ 251.421772] gitaly[903]: time="2026-09-04T07:43:34.213Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:43:44.202" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:34.212" grpc.time_ms=0.274 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954gitlab # [ 251.453526] gitaly[903]: time="2026-09-04T07:43:34.244Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=941 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:43:44.217" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:34.227" grpc.time_ms=16.757 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 251.580155] gitaly[903]: time="2026-09-04T07:43:34.371Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=340 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-04T07:44:04.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:34.363" grpc.time_ms=8.168 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 251.653965] gitaly[903]: time="2026-09-04T07:43:34.445Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:43:44.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:34.444" grpc.time_ms=0.407 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1957gitlab # [ 251.689460] gitaly[903]: time="2026-09-04T07:43:34.480Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:43:44.032" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:43:34.472" grpc.time_ms=7.863 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 251.719550] gitaly[903]: time="2026-09-04T07:43:34.510Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:44.058" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:34.498" grpc.time_ms=12.181 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1959gitlab # [ 251.755224] gitaly[903]: time="2026-09-04T07:43:34.546Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:44.095" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:34.535" grpc.time_ms=10.594 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 251.794216] gitaly[903]: time="2026-09-04T07:43:34.585Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:44:04.265" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:34.565" grpc.time_ms=19.47 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1962gitlab # [ 252.098561] nixbot[2613]: INFO: ::ffff:127.0.0.1:49344 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1963gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)1964gitlab # [ 252.238403] gitaly[903]: time="2026-09-04T07:43:35.029Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:43:45.016" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:35.027" grpc.time_ms=1.598 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1965gitlab # [ 252.267947] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.058Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 d5695ff3e818035e88fdb465ea1101d1c1794775 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d588c0d0248e8d6328680753","created_at":"2026-09-04T07:42:38.183Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-8216fd3869bd47f7","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:38.186Z","job_size_bytes":185,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d588c0d0248e8d6328680753: done: 1.240115 sec","job_status":"done","queue_duration_s":55.632222,"scheduling_latency_s":55.632278,"gitaly_calls":13,"gitaly_duration_s":0.38946,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.07978,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.004646,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.007568,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001943,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00587,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.048152,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.011601,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.184,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.212,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.667345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000778031,"exclusive_lock_hold_duration_s":0.03785118,"duration_s":1.240115,"completed_at":"2026-09-04T07:43:35.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.105311,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1966gitlab # [ 252.281684] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.060Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","d5695ff3e818035e88fdb465ea1101d1c1794775 ce8211762f9fb7bcd02357af6f8baff7df09b47d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"00d5b19bcd2179ab15f3bea9","created_at":"2026-09-04T07:42:41.655Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-939aff68a1cd4f6d","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:41.657Z","job_size_bytes":185,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-00d5b19bcd2179ab15f3bea9: start","job_status":"start","queue_duration_s":53.403033,"scheduling_latency_s":53.40305}1967gitlab # [ 252.308217] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.070Z","message":"changes: \"d5695ff3e818035e88fdb465ea1101d1c1794775 ce8211762f9fb7bcd02357af6f8baff7df09b47d refs/heads/master\\n\""}1968gitlab # [ 252.310706] gitaly[903]: time="2026-09-04T07:43:35.091Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:45.073" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:35.084" grpc.time_ms=6.976 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 252.322689] gitaly[903]: time="2026-09-04T07:43:35.100Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:43:45.084" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:35.095" grpc.time_ms=5.284 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1970gitlab # [ 252.334933] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.107Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"605da29ae8f0cf5b7ac0ae09","created_at":"2026-09-04T07:43:35.104Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-0f6fe3e27fbd46e0","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"b7916828410c763f2b470c96","job_size_bytes":46,"pid":2582,"job_status":"deduplicated","message":"ProjectCacheWorker JID-605da29ae8f0cf5b7ac0ae09: deduplicated: until executing","deduplication.type":"until executing"}1971gitlab # [ 252.348789] gitaly[903]: time="2026-09-04T07:43:35.132Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:43:45.112" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:35.122" grpc.time_ms=9.692 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1972gitlab # [ 252.360919] gitaly[903]: time="2026-09-04T07:43:35.144Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-04T07:44:05.036" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:35.136" grpc.time_ms=8.552 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 252.410973] gitaly[903]: time="2026-09-04T07:43:35.153Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:43:45.140" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:43:35.150" grpc.time_ms=3.073 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974gitlab # [ 252.411666] gitaly[903]: time="2026-09-04T07:43:35.162Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:45.148" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:35.158" grpc.time_ms=4.466 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 252.430896] gitaly[903]: time="2026-09-04T07:43:35.222Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:43:45.211" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:35.221" grpc.time_ms=0.938 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 252.447373] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.238Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","d5695ff3e818035e88fdb465ea1101d1c1794775 ce8211762f9fb7bcd02357af6f8baff7df09b47d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"00d5b19bcd2179ab15f3bea9","created_at":"2026-09-04T07:42:41.655Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-939aff68a1cd4f6d","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:42:41.657Z","job_size_bytes":185,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-00d5b19bcd2179ab15f3bea9: done: 0.178415 sec","job_status":"done","queue_duration_s":53.403033,"scheduling_latency_s":53.40305,"gitaly_calls":7,"gitaly_duration_s":0.051115,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.017316,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.001557,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000704,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003127,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.006502,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.005426,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.018,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000503695,"exclusive_lock_hold_duration_s":0.014757741,"duration_s":0.178415,"completed_at":"2026-09-04T07:43:35.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017849,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1977gitlab # [ 252.492090] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.240Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7139d01f72c6f6df277c86e5","created_at":"2026-09-04T07:42:42.582Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9b8933def12b43a6","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:42.591Z","job_size_bytes":65,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7139d01f72c6f6df277c86e5: start","job_status":"start","queue_duration_s":52.64837,"scheduling_latency_s":52.648395}1978gitlab # [ 252.516886] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.308Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7139d01f72c6f6df277c86e5","created_at":"2026-09-04T07:42:42.582Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9b8933def12b43a6","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:42.591Z","job_size_bytes":65,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7139d01f72c6f6df277c86e5: done: 0.068223 sec","job_status":"done","queue_duration_s":52.64837,"scheduling_latency_s":52.648395,"redis_calls":16,"redis_duration_s":0.002634,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001361,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000245562,"duration_s":0.068223,"completed_at":"2026-09-04T07:43:35.308Z","load_balancing_strategy":"primary","db_duration_s":0.022729,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1979gitlab # [ 252.517925] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.309Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"497bc1c8cec74a7aadaa6a0f","created_at":"2026-09-04T07:42:42.592Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9b8933def12b43a6","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:42.597Z","job_size_bytes":65,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-497bc1c8cec74a7aadaa6a0f: start","job_status":"start","queue_duration_s":52.711467,"scheduling_latency_s":52.711483}1980gitlab # [ 252.590594] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.381Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"497bc1c8cec74a7aadaa6a0f","created_at":"2026-09-04T07:42:42.592Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9b8933def12b43a6","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:42.597Z","job_size_bytes":65,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-497bc1c8cec74a7aadaa6a0f: done: 0.072499 sec","job_status":"done","queue_duration_s":52.711467,"scheduling_latency_s":52.711483,"redis_calls":21,"redis_duration_s":0.00381,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00159,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000239136,"duration_s":0.072499,"completed_at":"2026-09-04T07:43:35.381Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1981gitlab # [ 252.591672] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.383Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"53a82b6cbf037153d16744b2","created_at":"2026-09-04T07:42:42.728Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9b8933def12b43a6","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:42.732Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-53a82b6cbf037153d16744b2: start","job_status":"start","queue_duration_s":52.650409,"scheduling_latency_s":52.650423}1982gitlab # [ 252.715100] gitaly[903]: time="2026-09-04T07:43:35.506Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:35.505" grpc.time_ms=0.514 pid=903 span.kind=server system=grpc1983gitlab # [ 252.764878] gitaly[903]: time="2026-09-04T07:43:35.556Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:35.555" grpc.time_ms=0.925 pid=903 span.kind=server system=grpc1984gitlab # [ 252.818808] gitaly[903]: time="2026-09-04T07:43:35.610Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:35.609" grpc.time_ms=0.598 pid=903 span.kind=server system=grpc1985gitlab # [ 252.845281] gitaly[903]: time="2026-09-04T07:43:35.636Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG diskcache=2b30b27a-a924-44a1-9595-1d629d5a56d2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:05.173" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:35.474" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1986gitlab # [ 252.845852] gitaly[903]: time="2026-09-04T07:43:35.637Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=146 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7353 command.oublock=0 command.real_time_ms=153 command.spawn_token_fork_ms=0 command.system_time_ms=85 command.user_time_ms=61 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:05.173" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:35.474" grpc.time_ms=162.745 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1987gitlab # [ 252.994274] gitaly[903]: time="2026-09-04T07:43:35.785Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:44:05.483" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:35.784" grpc.time_ms=1.386 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 253.071446] gitaly[903]: time="2026-09-04T07:43:35.862Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:05.560" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:35.861" grpc.time_ms=1.085 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1989gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'1990gitlab # [ 253.090728] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.881Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"53a82b6cbf037153d16744b2","created_at":"2026-09-04T07:42:42.728Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9b8933def12b43a6","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:42.732Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2582,"job_status":"rescheduled","message":"PipelineProcessWorker JID-53a82b6cbf037153d16744b2: rescheduled"}1991gitlab # [ 253.105150] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.896Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"53a82b6cbf037153d16744b2","created_at":"2026-09-04T07:42:42.728Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9b8933def12b43a6","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:42:42.732Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-53a82b6cbf037153d16744b2: done: 0.512934 sec","job_status":"done","queue_duration_s":52.650409,"scheduling_latency_s":52.650423,"gitaly_calls":3,"gitaly_duration_s":0.221931,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.030526,"redis_read_bytes":462,"redis_write_bytes":29289,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00081,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001812,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.010339,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.005139,"redis_queues_read_bytes":39,"redis_queues_write_bytes":15576,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007583,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000556,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000845,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002632,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.021,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203886,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.458198737,"duration_s":0.512934,"completed_at":"2026-09-04T07:43:35.896Z","load_balancing_strategy":"primary","db_duration_s":0.068195,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1992gitlab # [ 253.161262] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:35.898Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b7916828410c763f2b470c96","created_at":"2026-09-04T07:43:33.937Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:33.962Z","job_size_bytes":46,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b7916828410c763f2b470c96: start","job_status":"start","queue_duration_s":1.936109,"scheduling_latency_s":1.936137}1993gitlab # [ 253.161996] gitaly[903]: time="2026-09-04T07:43:35.943Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-04T13:43:35.937" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:35.937" grpc.time_ms=5.583 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994gitlab # [ 253.170810] gitaly[903]: time="2026-09-04T07:43:35.962Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:44:05.649" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:35.950" grpc.time_ms=11.975 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.13 seconds)1996gitlab # [ 253.213142] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:36.004Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b7916828410c763f2b470c96","created_at":"2026-09-04T07:43:33.937Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:33.962Z","job_size_bytes":46,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b7916828410c763f2b470c96: done: 0.105892 sec","job_status":"done","queue_duration_s":1.936109,"scheduling_latency_s":1.936137,"gitaly_calls":2,"gitaly_duration_s":0.022704,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007892,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001604,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000576,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003124,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000822,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000414299,"duration_s":0.105892,"completed_at":"2026-09-04T07:43:36.003Z","load_balancing_strategy":"primary","db_duration_s":0.014436,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1997gitlab # [ 253.235058] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:36.006Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"60b7448d2edf6d2266b0addc","created_at":"2026-09-04T07:43:33.980Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:33.985Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-60b7448d2edf6d2266b0addc: start","job_status":"start","queue_duration_s":2.020457,"scheduling_latency_s":2.020488}1998gitlab # [ 253.236166] nixbot[2613]: INFO: ::ffff:127.0.0.1:37090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK1999gitlab # [ 253.268592] gitaly[903]: time="2026-09-04T07:43:36.059Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP diskcache=d3c96164-97c6-40f6-b817-7d872fc1ee1b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:43:36.033" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:36.033" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2000gitlab # [ 253.269307] gitaly[903]: time="2026-09-04T07:43:36.060Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:43:36.033" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:36.033" grpc.time_ms=26.242 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 253.329700] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:36.120Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"60b7448d2edf6d2266b0addc","created_at":"2026-09-04T07:43:33.980Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:33.985Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-60b7448d2edf6d2266b0addc: done: 0.114484 sec","job_status":"done","queue_duration_s":2.020457,"scheduling_latency_s":2.020488,"gitaly_calls":1,"gitaly_duration_s":0.056605,"redis_calls":15,"redis_duration_s":0.00749,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000434,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005024,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.088407045,"duration_s":0.114484,"completed_at":"2026-09-04T07:43:36.120Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2002gitlab # [ 253.373387] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:36.164Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"47f8a236b36bec2844ac5cc2","created_at":"2026-09-04T07:43:34.204Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:34.208Z","job_size_bytes":23,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-47f8a236b36bec2844ac5cc2: start","job_status":"start","queue_duration_s":1.955904,"scheduling_latency_s":1.955953}2003gitlab # [ 253.425044] gitaly[903]: time="2026-09-04T07:43:36.216Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:44:06.105" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:36.205" grpc.time_ms=10.441 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 253.437908] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:36.228Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"47f8a236b36bec2844ac5cc2","created_at":"2026-09-04T07:43:34.204Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:34.208Z","job_size_bytes":23,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-47f8a236b36bec2844ac5cc2: done: 0.064839 sec","job_status":"done","queue_duration_s":1.955904,"scheduling_latency_s":1.955953,"gitaly_calls":1,"gitaly_duration_s":0.013836,"redis_calls":16,"redis_duration_s":0.006316,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000425,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001967,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002661,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064839,"completed_at":"2026-09-04T07:43:36.228Z","load_balancing_strategy":"primary","db_duration_s":0.004023,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2005gitlab # [ 253.439869] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:36.231Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"aa2644bf83d18b085d94c589","created_at":"2026-09-04T07:43:34.817Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:340e83754264f37e252c671ba1b5ceb328d49d67ab803068602b734f5c13abe8","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:34.821Z","job_size_bytes":467,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-aa2644bf83d18b085d94c589: start","job_status":"start","queue_duration_s":1.409123,"scheduling_latency_s":1.409153}2006gitlab # [ 253.464683] gitaly[903]: time="2026-09-04T07:43:36.256Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:06.154" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:36.255" grpc.time_ms=0.863 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 253.477819] gitaly[903]: time="2026-09-04T07:43:36.269Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:43:46.247" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:36.258" grpc.time_ms=10.554 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2008gitlab # [ 253.580620] gitaly[903]: time="2026-09-04T07:43:36.372Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:44:06.070" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:36.370" grpc.time_ms=1.247 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009gitlab # [ 253.604091] gitaly[903]: time="2026-09-04T07:43:36.379Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=31 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:44:06.075" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:36.375" grpc.time_ms=3.764 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 253.661387] gitaly[903]: time="2026-09-04T07:43:36.452Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:46.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:36.442" grpc.time_ms=9.597 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 254.161904] gitaly[903]: time="2026-09-04T07:43:36.953Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:44:06.633" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:36.934" grpc.time_ms=18.919 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012gitlab # [ 254.213838] gitaly[903]: time="2026-09-04T07:43:37.005Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNX6Z90318NPVEB8RP55TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:44:06.689" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:36.989" grpc.time_ms=15.175 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'2014gitlab # [ 254.257119] sidekiq-cluster[2582]: {"severity":"WARN","time":"2026-09-04T07:43:37.048Z","class":"CreatePipelineWorker","correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"d5695ff3e818035e88fdb465ea1101d1c1794775","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"d5695ff3e818035e88fdb465ea1101d1c1794775","ref":"refs/heads/master"},"retry":0}2015gitlab # [ 254.267588] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.058Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"aa2644bf83d18b085d94c589","created_at":"2026-09-04T07:43:34.817Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:340e83754264f37e252c671ba1b5ceb328d49d67ab803068602b734f5c13abe8","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:34.821Z","job_size_bytes":467,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-aa2644bf83d18b085d94c589: done: 0.82739 sec","job_status":"done","queue_duration_s":1.409123,"scheduling_latency_s":1.409153,"gitaly_calls":7,"gitaly_duration_s":0.112899,"redis_calls":51,"redis_duration_s":0.011691,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000922,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005088,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002687,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.648991,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000573257,"duration_s":0.82739,"completed_at":"2026-09-04T07:43:37.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050618,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2016gitlab # [ 254.277588] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.060Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"faa83e7d-2d0e-4a03-b4dd-cf31eff79984\"}"],"class":"WebHookWorker","jid":"c7678a446529337716712862","created_at":"2026-09-04T07:43:34.999Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f7144e0fcaeca05faeefb60f89f48c95e9a79b2617e99487902621f14c0a4387","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.006Z","job_size_bytes":1751,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c7678a446529337716712862: start","job_status":"start","queue_duration_s":2.054357,"scheduling_latency_s":2.054435}2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.15 seconds)2018gitlab # [ 254.384251] nixbot[2613]: INFO: ::ffff:127.0.0.1:37110 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK2019gitlab # [ 254.389814] nixbot[2613]: INFO: ::ffff:127.0.0.1:37100 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2020gitlab # [ 254.408418] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.198Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"faa83e7d-2d0e-4a03-b4dd-cf31eff79984\"}"],"class":"WebHookWorker","jid":"c7678a446529337716712862","created_at":"2026-09-04T07:43:34.999Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-334b72881f3b4bf1","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f7144e0fcaeca05faeefb60f89f48c95e9a79b2617e99487902621f14c0a4387","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.006Z","job_size_bytes":1751,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c7678a446529337716712862: done: 0.138352 sec","job_status":"done","queue_duration_s":2.054357,"scheduling_latency_s":2.054435,"redis_calls":19,"redis_duration_s":0.003311,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000846,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000306,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001554,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05836049000001253,"cpu_s":0.067755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000262883,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.138352,"completed_at":"2026-09-04T07:43:37.198Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021gitlab # [ 254.416426] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.200Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a6193db9db59b75f4e2b64c4","created_at":"2026-09-04T07:43:35.115Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-0f6fe3e27fbd46e0","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"60b7448d2edf6d2266b0addc","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.118Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a6193db9db59b75f4e2b64c4: start","job_status":"start","queue_duration_s":2.082235,"scheduling_latency_s":2.082249}2022gitlab # [ 254.504367] gitaly[903]: time="2026-09-04T07:43:37.295Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 diskcache=58d56cb2-24a9-4421-bcb4-9da6fe409bf4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:43:37.281" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:37.282" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2023gitlab # [ 254.505180] gitaly[903]: time="2026-09-04T07:43:37.295Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:43:37.281" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:37.282" grpc.time_ms=13.041 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab # [ 254.551240] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.342Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a6193db9db59b75f4e2b64c4","created_at":"2026-09-04T07:43:35.115Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-0f6fe3e27fbd46e0","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"60b7448d2edf6d2266b0addc","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.118Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a6193db9db59b75f4e2b64c4: done: 0.141793 sec","job_status":"done","queue_duration_s":2.082235,"scheduling_latency_s":2.082249,"gitaly_calls":1,"gitaly_duration_s":0.036624,"redis_calls":12,"redis_duration_s":0.0046,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00297,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000614,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001016,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.054859766,"duration_s":0.141793,"completed_at":"2026-09-04T07:43:37.341Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 254.573550] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.344Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ae0c99c05b33b0c0f39b6ae2","created_at":"2026-09-04T07:43:35.198Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-0f6fe3e27fbd46e0","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4939d56a2e4159444dc7337e9d187aa726fa914e7c0806c90bada823ab0b7d7e","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.200Z","job_size_bytes":467,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ae0c99c05b33b0c0f39b6ae2: start","job_status":"start","queue_duration_s":2.143424,"scheduling_latency_s":2.143456}2026gitlab # [ 254.574590] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1522027gitlab # [ 254.575126] gitaly[903]: time="2026-09-04T07:43:37.360Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ17R477M65YPW5ZGCD09 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:37.351" grpc.time_ms=8.096 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2028gitlab # [ 254.582693] gitaly[903]: time="2026-09-04T07:43:37.373Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:07.072" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:37.373" grpc.time_ms=0.629 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab # [ 254.630198] gitaly[903]: time="2026-09-04T07:43:37.380Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:43:47.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:37.375" grpc.time_ms=5.083 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030gitlab # [ 254.630906] gitaly[903]: time="2026-09-04T07:43:37.404Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:44:07.103" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:37.403" grpc.time_ms=0.592 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2031gitlab # [ 254.631562] gitaly[903]: time="2026-09-04T07:43:37.408Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=38 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:44:07.106" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:37.406" grpc.time_ms=1.692 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2032gitlab # [ 254.644711] gitaly[903]: time="2026-09-04T07:43:37.436Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:47.060" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:37.430" grpc.time_ms=5.441 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2033gitlab # [ 254.702026] gitaly[903]: time="2026-09-04T07:43:37.493Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ1CJ9VH9BHQ7EMSFZ6WS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:37.485" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2034gitlab # [ 254.702297] gitaly[903]: time="2026-09-04T07:43:37.493Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ1CJ9VH9BHQ7EMSFZ6WS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:37.485" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2035gitlab # [ 254.702906] gitaly[903]: time="2026-09-04T07:43:37.494Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ1CJ9VH9BHQ7EMSFZ6WS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:37.485" grpc.time_ms=8.003 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2036gitlab # [ 254.703570] gitlab-workhorse[829]: time="2026-09-04T07:43:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672037gitlab # [ 254.704072] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1322038gitlab # [ 254.754625] nixbot[2613]: {"ts": "2026-09-04T07:43:37.546Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2039gitlab # [ 254.840737] gitaly[903]: time="2026-09-04T07:43:37.632Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ1JPDYET4N6JC9A3D321 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:07.530" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:37.630" grpc.time_ms=1.068 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2040gitlab # [ 254.891818] gitaly[903]: time="2026-09-04T07:43:37.683Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ1JPDYET4N6JC9A3D321 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:47.165" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:37.675" grpc.time_ms=7.542 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 254.932123] gitaly[903]: time="2026-09-04T07:43:37.722Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:44:07.412" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:37.712" grpc.time_ms=10.26 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 254.942867] gitaly[903]: time="2026-09-04T07:43:37.734Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXAK02VJF4G8TB9F02H46 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:44:07.426" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:37.726" grpc.time_ms=7.787 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2043gitlab # [ 254.955701] sidekiq-cluster[2582]: {"severity":"WARN","time":"2026-09-04T07:43:37.747Z","class":"CreatePipelineWorker","correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"d5695ff3e818035e88fdb465ea1101d1c1794775","after":"ce8211762f9fb7bcd02357af6f8baff7df09b47d","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"ce8211762f9fb7bcd02357af6f8baff7df09b47d","ref":"refs/heads/master"},"retry":0}2044gitlab # [ 254.960417] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ae0c99c05b33b0c0f39b6ae2","created_at":"2026-09-04T07:43:35.198Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-0f6fe3e27fbd46e0","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4939d56a2e4159444dc7337e9d187aa726fa914e7c0806c90bada823ab0b7d7e","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.200Z","job_size_bytes":467,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ae0c99c05b33b0c0f39b6ae2: done: 0.407237 sec","job_status":"done","queue_duration_s":2.143424,"scheduling_latency_s":2.143456,"gitaly_calls":7,"gitaly_duration_s":0.045438,"redis_calls":33,"redis_duration_s":0.005294,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000456,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00188,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.341099,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.407237,"completed_at":"2026-09-04T07:43:37.751Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01563,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2045gitlab # [ 255.000078] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.753Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"489b9dcf-fdfb-4563-bebd-f9069a76b1ca\"}"],"class":"WebHookWorker","jid":"345b39caffbfbb19c6c7fbce","created_at":"2026-09-04T07:43:35.212Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-0f6fe3e27fbd46e0","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1999bcde2b818a867733e4f1e2ec9d46bfa69e7ed0ad3cf6a6a77518b6b0614d","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.213Z","job_size_bytes":1749,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-345b39caffbfbb19c6c7fbce: start","job_status":"start","queue_duration_s":2.540161,"scheduling_latency_s":2.540183}2046gitlab # [ 255.049748] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2822047gitlab # [ 255.052370] nixbot[2613]: {"ts": "2026-09-04T07:43:37.843Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 \"HTTP/1.1 201 Created\""}2048gitlab # [ 255.079463] nixbot[2613]: INFO: ::ffff:127.0.0.1:37126 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2049gitlab # [ 255.094892] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.885Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"489b9dcf-fdfb-4563-bebd-f9069a76b1ca\"}"],"class":"WebHookWorker","jid":"345b39caffbfbb19c6c7fbce","created_at":"2026-09-04T07:43:35.212Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-0f6fe3e27fbd46e0","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1999bcde2b818a867733e4f1e2ec9d46bfa69e7ed0ad3cf6a6a77518b6b0614d","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.213Z","job_size_bytes":1749,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-345b39caffbfbb19c6c7fbce: done: 0.132397 sec","job_status":"done","queue_duration_s":2.540161,"scheduling_latency_s":2.540183,"redis_calls":14,"redis_duration_s":0.005096,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000552,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002652,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001892,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.007258463999988862,"cpu_s":0.111704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.132397,"completed_at":"2026-09-04T07:43:37.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2050gitlab # [ 255.099600] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.890Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"20ee1c55a249816c1674b25a","created_at":"2026-09-04T07:43:35.462Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.465Z","job_size_bytes":23,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-20ee1c55a249816c1674b25a: start","job_status":"start","queue_duration_s":2.424562,"scheduling_latency_s":2.4246}2051gitlab # [ 255.149892] gitaly[903]: time="2026-09-04T07:43:37.910Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ1VS5Q1BX8F481S06GEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:07.109" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:37.909" grpc.time_ms=0.685 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 255.153201] gitaly[903]: time="2026-09-04T07:43:37.944Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ1VS5Q1BX8F481S06GEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:47.138" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:37.938" grpc.time_ms=6.311 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 255.174061] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.964Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"20ee1c55a249816c1674b25a","created_at":"2026-09-04T07:43:35.462Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.465Z","job_size_bytes":23,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-20ee1c55a249816c1674b25a: done: 0.07433 sec","job_status":"done","queue_duration_s":2.424562,"scheduling_latency_s":2.4246,"redis_calls":10,"redis_duration_s":0.005495,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001125,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002861,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001509,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000762946,"duration_s":0.07433,"completed_at":"2026-09-04T07:43:37.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012725,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2054gitlab # [ 255.176493] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.968Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"29559e64721a9fd472f79654","created_at":"2026-09-04T07:43:35.663Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.669Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-29559e64721a9fd472f79654: start","job_status":"start","queue_duration_s":2.298474,"scheduling_latency_s":2.29849}2055gitlab # [ 255.192781] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1342056gitlab # [ 255.194264] nixbot[2613]: {"ts": "2026-09-04T07:43:37.985Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 \"HTTP/1.1 201 Created\""}2057gitlab # [ 255.208424] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:37.999Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"29559e64721a9fd472f79654","created_at":"2026-09-04T07:43:35.663Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.669Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-29559e64721a9fd472f79654: done: 0.031519 sec","job_status":"done","queue_duration_s":2.298474,"scheduling_latency_s":2.29849,"redis_calls":10,"redis_duration_s":0.0040160000000000005,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000683,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000656,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022014,"duration_s":0.031519,"completed_at":"2026-09-04T07:43:37.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2058gitlab # [ 255.249083] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.000Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ac4803bac171fc41c167d3d9","created_at":"2026-09-04T07:43:35.683Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.693Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ac4803bac171fc41c167d3d9: start","job_status":"start","queue_duration_s":2.306924,"scheduling_latency_s":2.306936}2059gitlab # [ 255.250340] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.023Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ac4803bac171fc41c167d3d9","created_at":"2026-09-04T07:43:35.683Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.693Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ac4803bac171fc41c167d3d9: done: 0.022581 sec","job_status":"done","queue_duration_s":2.306924,"scheduling_latency_s":2.306936,"redis_calls":10,"redis_duration_s":0.003029,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000764,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000325,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022461,"duration_s":0.022581,"completed_at":"2026-09-04T07:43:38.023Z","load_balancing_strategy":"primary","db_duration_s":0.003213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2060gitlab # [ 255.298717] gitaly[903]: time="2026-09-04T07:43:38.030Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ206T2NEHENF6N9QMWSV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:08.028" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:38.029" grpc.time_ms=0.666 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 255.301182] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.024Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b880684d3bc1d2e47f2ab5a0","created_at":"2026-09-04T07:43:35.713Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.719Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b880684d3bc1d2e47f2ab5a0: start","job_status":"start","queue_duration_s":2.304626,"scheduling_latency_s":2.304639}2062gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'2063gitlab # [ 255.342179] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.052Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b880684d3bc1d2e47f2ab5a0","created_at":"2026-09-04T07:43:35.713Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.719Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b880684d3bc1d2e47f2ab5a0: done: 0.028215 sec","job_status":"done","queue_duration_s":2.304626,"scheduling_latency_s":2.304639,"redis_calls":13,"redis_duration_s":0.004119,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000996,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000979,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000426032,"duration_s":0.028215,"completed_at":"2026-09-04T07:43:38.052Z","load_balancing_strategy":"primary","db_duration_s":0.005077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2064gitlab # [ 255.356171] gitaly[903]: time="2026-09-04T07:43:38.061Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ206T2NEHENF6N9QMWSV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:48.024" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:38.054" grpc.time_ms=7.063 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 255.367932] nixbot[2613]: {"ts": "2026-09-04T07:43:38.101Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 \"HTTP/1.1 201 Created\""}2066gitlab # [ 255.370691] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d5695ff3e818035e88fdb465ea1101d1c1794775 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1082067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)2068gitlab # [ 255.373268] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.053Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"da943058e9d16fb6f19bde6f","created_at":"2026-09-04T07:43:35.720Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.725Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-da943058e9d16fb6f19bde6f: start","job_status":"start","queue_duration_s":2.32743,"scheduling_latency_s":2.327446}2069gitlab # [ 255.418163] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.081Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"da943058e9d16fb6f19bde6f","created_at":"2026-09-04T07:43:35.720Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.725Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-da943058e9d16fb6f19bde6f: done: 0.027679 sec","job_status":"done","queue_duration_s":2.32743,"scheduling_latency_s":2.327446,"redis_calls":10,"redis_duration_s":0.0031850000000000003,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001242,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000265397,"duration_s":0.027679,"completed_at":"2026-09-04T07:43:38.080Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2070gitlab # [ 255.459090] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.084Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4984e0e8f85998466026fa6c","created_at":"2026-09-04T07:43:35.726Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.732Z","job_size_bytes":19,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4984e0e8f85998466026fa6c: start","job_status":"start","queue_duration_s":2.351494,"scheduling_latency_s":2.351513}2071gitlab # [ 255.459761] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4984e0e8f85998466026fa6c","created_at":"2026-09-04T07:43:35.726Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.732Z","job_size_bytes":19,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4984e0e8f85998466026fa6c: done: 0.022569 sec","job_status":"done","queue_duration_s":2.351494,"scheduling_latency_s":2.351513,"redis_calls":11,"redis_duration_s":0.0025069999999999997,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000641,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001599,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000208686,"duration_s":0.022569,"completed_at":"2026-09-04T07:43:38.106Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2072gitlab # [ 255.516126] nixbot[2613]: INFO: ::ffff:127.0.0.1:37134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK2073gitlab # [ 255.516763] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.107Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ee477274539972b36ba50260","created_at":"2026-09-04T07:43:35.736Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.741Z","job_size_bytes":66,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ee477274539972b36ba50260: start","job_status":"start","queue_duration_s":2.366006,"scheduling_latency_s":2.36602}2074gitlab # [ 255.517487] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.152Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ee477274539972b36ba50260","created_at":"2026-09-04T07:43:35.736Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.741Z","job_size_bytes":66,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ee477274539972b36ba50260: done: 0.044552 sec","job_status":"done","queue_duration_s":2.366006,"scheduling_latency_s":2.36602,"redis_calls":10,"redis_duration_s":0.001428,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231593,"duration_s":0.044552,"completed_at":"2026-09-04T07:43:38.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2075gitlab # [ 255.570852] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"92c87a07220d285f10008d04","created_at":"2026-09-04T07:43:35.742Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.747Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-92c87a07220d285f10008d04: start","job_status":"start","queue_duration_s":2.405521,"scheduling_latency_s":2.405534}2076gitlab # [ 255.571575] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.181Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"92c87a07220d285f10008d04","created_at":"2026-09-04T07:43:35.742Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.747Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-92c87a07220d285f10008d04: done: 0.028142 sec","job_status":"done","queue_duration_s":2.405521,"scheduling_latency_s":2.405534,"redis_calls":10,"redis_duration_s":0.001359,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000205892,"duration_s":0.028142,"completed_at":"2026-09-04T07:43:38.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2077gitlab # [ 255.625477] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.182Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5bdcd64887ce6e47e23eff05","created_at":"2026-09-04T07:43:35.755Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.758Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5bdcd64887ce6e47e23eff05: start","job_status":"start","queue_duration_s":2.42408,"scheduling_latency_s":2.424093}2078gitlab # [ 255.626199] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.207Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5bdcd64887ce6e47e23eff05","created_at":"2026-09-04T07:43:35.755Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.758Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5bdcd64887ce6e47e23eff05: done: 0.024955 sec","job_status":"done","queue_duration_s":2.42408,"scheduling_latency_s":2.424093,"redis_calls":10,"redis_duration_s":0.001377,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206171,"duration_s":0.024955,"completed_at":"2026-09-04T07:43:38.207Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007812,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079gitlab # [ 255.681694] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.208Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"48366c41bc25eab6a751c9a5","created_at":"2026-09-04T07:43:35.758Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.761Z","job_size_bytes":6,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-48366c41bc25eab6a751c9a5: start","job_status":"start","queue_duration_s":2.4467,"scheduling_latency_s":2.446714}2080gitlab # [ 255.682571] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.226Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"48366c41bc25eab6a751c9a5","created_at":"2026-09-04T07:43:35.758Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.761Z","job_size_bytes":6,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-48366c41bc25eab6a751c9a5: done: 0.017994 sec","job_status":"done","queue_duration_s":2.4467,"scheduling_latency_s":2.446714,"redis_calls":10,"redis_duration_s":0.001977,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201701,"duration_s":0.017994,"completed_at":"2026-09-04T07:43:38.226Z","load_balancing_strategy":"primary","db_duration_s":0.001368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2081gitlab # [ 255.725097] gitaly[903]: time="2026-09-04T07:43:38.421Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:38.420" grpc.time_ms=0.278 pid=903 span.kind=server system=grpc2082gitlab # [ 255.725845] gitaly[903]: time="2026-09-04T07:43:38.459Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:38.443" grpc.time_ms=15.432 pid=903 span.kind=server system=grpc2083gitlab # [ 255.726539] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.227Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e90edd470313aad3c350c015","created_at":"2026-09-04T07:43:35.762Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.764Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e90edd470313aad3c350c015: start","job_status":"start","queue_duration_s":2.46235,"scheduling_latency_s":2.462363}2084gitlab # [ 255.767810] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.249Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e90edd470313aad3c350c015","created_at":"2026-09-04T07:43:35.762Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.764Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e90edd470313aad3c350c015: done: 0.022351 sec","job_status":"done","queue_duration_s":2.46235,"scheduling_latency_s":2.462363,"redis_calls":10,"redis_duration_s":0.0013549999999999999,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013589,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227683,"duration_s":0.022351,"completed_at":"2026-09-04T07:43:38.249Z","load_balancing_strategy":"primary","db_duration_s":0.00499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2085gitlab # [ 255.771301] gitaly[903]: time="2026-09-04T07:43:38.480Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:38.479" grpc.time_ms=0.308 pid=903 span.kind=server system=grpc2086gitlab # [ 255.779979] gitaly[903]: time="2026-09-04T07:43:38.488Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG diskcache=6ef358e9-99ce-4ba1-8d91-e6c163c75d69 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:08.097" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:38.398" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 255.788949] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.250Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"75d5fcb430b1c18f89ba18cf","created_at":"2026-09-04T07:43:35.770Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.773Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-75d5fcb430b1c18f89ba18cf: start","job_status":"start","queue_duration_s":2.477116,"scheduling_latency_s":2.477129}2088gitlab # [ 255.803870] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.291Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"75d5fcb430b1c18f89ba18cf","created_at":"2026-09-04T07:43:35.770Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.773Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-75d5fcb430b1c18f89ba18cf: done: 0.041072 sec","job_status":"done","queue_duration_s":2.477116,"scheduling_latency_s":2.477129,"redis_calls":14,"redis_duration_s":0.002809,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341384,"duration_s":0.041072,"completed_at":"2026-09-04T07:43:38.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2089gitlab # [ 255.871749] gitaly[903]: time="2026-09-04T07:43:38.489Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7140 command.oublock=0 command.real_time_ms=84 command.spawn_token_fork_ms=0 command.system_time_ms=45 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:08.097" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:38.398" grpc.time_ms=90.897 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 255.872523] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.292Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2022c451ee7f3029ea58b140","created_at":"2026-09-04T07:43:35.882Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.885Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2022c451ee7f3029ea58b140: start","job_status":"start","queue_duration_s":2.406825,"scheduling_latency_s":2.406839}2091gitlab # [ 255.873158] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.569Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2022c451ee7f3029ea58b140","created_at":"2026-09-04T07:43:35.882Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.885Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2582,"job_status":"rescheduled","message":"PipelineProcessWorker JID-2022c451ee7f3029ea58b140: rescheduled"}2092gitlab # [ 255.882990] gitaly[903]: time="2026-09-04T07:43:38.542Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=12 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=12 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:44:08.228" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:38.528" grpc.time_ms=13.308 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 255.923768] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.574Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2022c451ee7f3029ea58b140","created_at":"2026-09-04T07:43:35.882Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9bc300e32d274cc5","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.885Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2022c451ee7f3029ea58b140: done: 0.281833 sec","job_status":"done","queue_duration_s":2.406825,"scheduling_latency_s":2.406839,"gitaly_calls":3,"gitaly_duration_s":0.11048,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008737,"redis_read_bytes":149,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000472,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000703,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.001977,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003215,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000174,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000565,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001159,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.066,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.066,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084167,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.259168973,"duration_s":0.281833,"completed_at":"2026-09-04T07:43:38.574Z","load_balancing_strategy":"primary","db_duration_s":0.083732,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2094gitlab # [ 255.940127] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.575Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ef2ae7e01bd08c06fed113c9","created_at":"2026-09-04T07:43:35.978Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-2c5e0a0a179e484e","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.986Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ef2ae7e01bd08c06fed113c9: start","job_status":"start","queue_duration_s":2.588434,"scheduling_latency_s":2.588451}2095gitlab # [ 255.954621] gitaly[903]: time="2026-09-04T07:43:38.563Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNXBAWQNX5TS1VY8KHAWPG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:08.262" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:38.563" grpc.time_ms=0.564 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 255.966149] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.607Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ef2ae7e01bd08c06fed113c9","created_at":"2026-09-04T07:43:35.978Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-2c5e0a0a179e484e","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:35.986Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ef2ae7e01bd08c06fed113c9: done: 0.032421 sec","job_status":"done","queue_duration_s":2.588434,"scheduling_latency_s":2.588451,"redis_calls":19,"redis_duration_s":0.0026579999999999998,"redis_read_bytes":22,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000583,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000337,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004901461,"duration_s":0.032421,"completed_at":"2026-09-04T07:43:38.607Z","load_balancing_strategy":"primary","db_duration_s":0.005213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2097gitlab # [ 256.030045] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.608Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c7678a446529337716712862"],"class":"WebHooks::LogExecutionWorker","jid":"06c2bc0ec8f90dec70eaef40","created_at":"2026-09-04T07:43:37.185Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-971b227924374583","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:402eb3f3057dab3292bfeac2edae1d57028500108d3bed9ea5cf881343d24107","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:37.193Z","job_size_bytes":2593,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-06c2bc0ec8f90dec70eaef40: start","job_status":"start","queue_duration_s":1.415958,"scheduling_latency_s":1.415973}2098gitlab # [ 256.030811] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.640Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c7678a446529337716712862"],"class":"WebHooks::LogExecutionWorker","jid":"06c2bc0ec8f90dec70eaef40","created_at":"2026-09-04T07:43:37.185Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-971b227924374583","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:402eb3f3057dab3292bfeac2edae1d57028500108d3bed9ea5cf881343d24107","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:37.193Z","job_size_bytes":2593,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-06c2bc0ec8f90dec70eaef40: done: 0.031193 sec","job_status":"done","queue_duration_s":1.415958,"scheduling_latency_s":1.415973,"redis_calls":10,"redis_duration_s":0.001466,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000872,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225168,"duration_s":0.031193,"completed_at":"2026-09-04T07:43:38.640Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2099gitlab # [ 256.077817] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.641Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","345b39caffbfbb19c6c7fbce"],"class":"WebHooks::LogExecutionWorker","jid":"27ff80472707801a2533387f","created_at":"2026-09-04T07:43:37.872Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-102f35a27e9446f3","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c07f8e4092a39a3ac496cb36d5ad90497dee96e039bfbb75b1078bc691c459e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:37.874Z","job_size_bytes":2591,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-27ff80472707801a2533387f: start","job_status":"start","queue_duration_s":0.766357,"scheduling_latency_s":0.766371}2100gitlab # [ 256.078735] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.657Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","345b39caffbfbb19c6c7fbce"],"class":"WebHooks::LogExecutionWorker","jid":"27ff80472707801a2533387f","created_at":"2026-09-04T07:43:37.872Z","trace_propagation_headers":{"sentry-trace":"039ab3755f5946d9812233af38d5804d-102f35a27e9446f3","baggage":"sentry-trace_id=039ab3755f5946d9812233af38d5804d,sentry-release=Unknown"},"correlation_id":"01M1NNXAK02VJF4G8TB9F02H46","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c07f8e4092a39a3ac496cb36d5ad90497dee96e039bfbb75b1078bc691c459e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:37.874Z","job_size_bytes":2591,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-27ff80472707801a2533387f: done: 0.016396 sec","job_status":"done","queue_duration_s":0.766357,"scheduling_latency_s":0.766371,"redis_calls":7,"redis_duration_s":0.001009,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016396,"completed_at":"2026-09-04T07:43:38.657Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2101gitlab # [ 256.121055] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.658Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9feb11252ea28bb0fa0cfc5c","created_at":"2026-09-04T07:43:38.392Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.394Z","job_size_bytes":23,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9feb11252ea28bb0fa0cfc5c: start","job_status":"start","queue_duration_s":0.264532,"scheduling_latency_s":0.264546}2102gitlab # [ 256.129872] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.685Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9feb11252ea28bb0fa0cfc5c","created_at":"2026-09-04T07:43:38.392Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.394Z","job_size_bytes":23,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9feb11252ea28bb0fa0cfc5c: done: 0.027435 sec","job_status":"done","queue_duration_s":0.264532,"scheduling_latency_s":0.264546,"redis_calls":7,"redis_duration_s":0.001075,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027435,"completed_at":"2026-09-04T07:43:38.685Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004702,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2103gitlab # [ 256.186526] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.687Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e6f025b3a608b8207736255d","created_at":"2026-09-04T07:43:38.494Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.497Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e6f025b3a608b8207736255d: start","job_status":"start","queue_duration_s":0.18951,"scheduling_latency_s":0.189526}2104gitlab # [ 256.187293] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.704Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e6f025b3a608b8207736255d","created_at":"2026-09-04T07:43:38.494Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.497Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e6f025b3a608b8207736255d: done: 0.017016 sec","job_status":"done","queue_duration_s":0.18951,"scheduling_latency_s":0.189526,"redis_calls":7,"redis_duration_s":0.001044,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017016,"completed_at":"2026-09-04T07:43:38.703Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2105gitlab # [ 256.222729] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.704Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5eebcd7581730838ab77e8af","created_at":"2026-09-04T07:43:38.503Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.504Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5eebcd7581730838ab77e8af: start","job_status":"start","queue_duration_s":0.200266,"scheduling_latency_s":0.200282}2106gitlab # [ 256.236827] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.722Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"5eebcd7581730838ab77e8af","created_at":"2026-09-04T07:43:38.503Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.504Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-5eebcd7581730838ab77e8af: done: 0.017659 sec","job_status":"done","queue_duration_s":0.200266,"scheduling_latency_s":0.200282,"redis_calls":7,"redis_duration_s":0.000996,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017659,"completed_at":"2026-09-04T07:43:38.722Z","load_balancing_strategy":"primary","db_duration_s":0.002704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2107gitlab # [ 256.280187] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.723Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"246e6ac53d5f328aae5df2d3","created_at":"2026-09-04T07:43:38.510Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.511Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-246e6ac53d5f328aae5df2d3: start","job_status":"start","queue_duration_s":0.212134,"scheduling_latency_s":0.212149}2108gitlab # [ 256.287692] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.742Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"246e6ac53d5f328aae5df2d3","created_at":"2026-09-04T07:43:38.510Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.511Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-246e6ac53d5f328aae5df2d3: done: 0.019273 sec","job_status":"done","queue_duration_s":0.212134,"scheduling_latency_s":0.212149,"redis_calls":10,"redis_duration_s":0.001403,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00043,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019273,"completed_at":"2026-09-04T07:43:38.742Z","load_balancing_strategy":"primary","db_duration_s":0.002791,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2109gitlab # [ 256.331692] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.744Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9505d3f98c31936087ae3f45","created_at":"2026-09-04T07:43:38.511Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.512Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9505d3f98c31936087ae3f45: start","job_status":"start","queue_duration_s":0.231367,"scheduling_latency_s":0.231382}2110gitlab # [ 256.340786] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.761Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9505d3f98c31936087ae3f45","created_at":"2026-09-04T07:43:38.511Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.512Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9505d3f98c31936087ae3f45: done: 0.017139 sec","job_status":"done","queue_duration_s":0.231367,"scheduling_latency_s":0.231382,"redis_calls":7,"redis_duration_s":0.0010249999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017139,"completed_at":"2026-09-04T07:43:38.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002435,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'2112gitlab # [ 256.384692] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.762Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"901e15aa4e73eb42bd8247af","created_at":"2026-09-04T07:43:38.513Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.514Z","job_size_bytes":19,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-901e15aa4e73eb42bd8247af: start","job_status":"start","queue_duration_s":0.247587,"scheduling_latency_s":0.247602}2113gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.04 seconds)2114gitlab # [ 256.392806] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.778Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"901e15aa4e73eb42bd8247af","created_at":"2026-09-04T07:43:38.513Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.514Z","job_size_bytes":19,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-901e15aa4e73eb42bd8247af: done: 0.016464 sec","job_status":"done","queue_duration_s":0.247587,"scheduling_latency_s":0.247602,"redis_calls":8,"redis_duration_s":0.001163,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016464,"completed_at":"2026-09-04T07:43:38.778Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115gitlab # [ 256.434393] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.779Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3b58a072e5bb18b6b1211f04","created_at":"2026-09-04T07:43:38.515Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.516Z","job_size_bytes":66,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3b58a072e5bb18b6b1211f04: start","job_status":"start","queue_duration_s":0.263285,"scheduling_latency_s":0.263299}2116gitlab # [ 256.474110] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.794Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3b58a072e5bb18b6b1211f04","created_at":"2026-09-04T07:43:38.515Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.516Z","job_size_bytes":66,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3b58a072e5bb18b6b1211f04: done: 0.014766 sec","job_status":"done","queue_duration_s":0.263285,"scheduling_latency_s":0.263299,"redis_calls":7,"redis_duration_s":0.000977,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014766,"completed_at":"2026-09-04T07:43:38.794Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001576,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2117gitlab # [ 256.518737] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.795Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"53a6cd51691d6b148b4ae764","created_at":"2026-09-04T07:43:38.516Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.517Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-53a6cd51691d6b148b4ae764: start","job_status":"start","queue_duration_s":0.27768,"scheduling_latency_s":0.277695}2118gitlab # [ 256.519924] nixbot[2613]: INFO: ::ffff:127.0.0.1:37142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK2119gitlab # [ 256.520557] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.813Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"53a6cd51691d6b148b4ae764","created_at":"2026-09-04T07:43:38.516Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.517Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-53a6cd51691d6b148b4ae764: done: 0.017721 sec","job_status":"done","queue_duration_s":0.27768,"scheduling_latency_s":0.277695,"redis_calls":7,"redis_duration_s":0.001093,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017721,"completed_at":"2026-09-04T07:43:38.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003771,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2120gitlab # [ 256.571936] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.814Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"7a975fc8ef93f8d291cd9800","created_at":"2026-09-04T07:43:38.518Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.519Z","job_size_bytes":6,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-7a975fc8ef93f8d291cd9800: start","job_status":"start","queue_duration_s":0.295417,"scheduling_latency_s":0.29543}2121gitlab # [ 256.572765] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"7a975fc8ef93f8d291cd9800","created_at":"2026-09-04T07:43:38.518Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.519Z","job_size_bytes":6,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-7a975fc8ef93f8d291cd9800: done: 0.009775 sec","job_status":"done","queue_duration_s":0.295417,"scheduling_latency_s":0.29543,"redis_calls":7,"redis_duration_s":0.000988,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009775,"completed_at":"2026-09-04T07:43:38.824Z","load_balancing_strategy":"primary","db_duration_s":0.00032,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2122gitlab # [ 256.588508] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.825Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ec97a8a459b5572ae6f59646","created_at":"2026-09-04T07:43:38.519Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.520Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ec97a8a459b5572ae6f59646: start","job_status":"start","queue_duration_s":0.305402,"scheduling_latency_s":0.305415}2123gitlab # [ 256.602457] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.840Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ec97a8a459b5572ae6f59646","created_at":"2026-09-04T07:43:38.519Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.520Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ec97a8a459b5572ae6f59646: done: 0.015011 sec","job_status":"done","queue_duration_s":0.305402,"scheduling_latency_s":0.305415,"redis_calls":7,"redis_duration_s":0.001002,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000738,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015011,"completed_at":"2026-09-04T07:43:38.840Z","load_balancing_strategy":"primary","db_duration_s":0.002035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 256.651289] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.842Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"31f0da1fcd0ad1e4175e7e43","created_at":"2026-09-04T07:43:38.569Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.570Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-31f0da1fcd0ad1e4175e7e43: start","job_status":"start","queue_duration_s":0.271404,"scheduling_latency_s":0.271418}2125gitlab # [ 256.652189] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.859Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"31f0da1fcd0ad1e4175e7e43","created_at":"2026-09-04T07:43:38.569Z","trace_propagation_headers":{"sentry-trace":"d8f3bace4e0c45318c615de4bc2ee36a-9574839a10194815","baggage":"sentry-trace_id=d8f3bace4e0c45318c615de4bc2ee36a,sentry-release=Unknown"},"correlation_id":"01M1NNXBAWQNX5TS1VY8KHAWPG","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.570Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-31f0da1fcd0ad1e4175e7e43: done: 0.017075 sec","job_status":"done","queue_duration_s":0.271404,"scheduling_latency_s":0.271418,"redis_calls":8,"redis_duration_s":0.001121,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017075,"completed_at":"2026-09-04T07:43:38.859Z","load_balancing_strategy":"primary","db_duration_s":0.002191,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2126gitlab # [ 256.701805] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1ac7bb6d00e79f14652b2af0","created_at":"2026-09-04T07:43:38.598Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-2d9ea8cc49b14200","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.602Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1ac7bb6d00e79f14652b2af0: start","job_status":"start","queue_duration_s":0.258403,"scheduling_latency_s":0.258418}2127gitlab # [ 256.704121] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:38.932Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1ac7bb6d00e79f14652b2af0","created_at":"2026-09-04T07:43:38.598Z","trace_propagation_headers":{"sentry-trace":"d8fd5e6bf63d410c8d33bd5c38bf2388-2d9ea8cc49b14200","baggage":"sentry-trace_id=d8fd5e6bf63d410c8d33bd5c38bf2388,sentry-release=Unknown"},"correlation_id":"01M1NNX6Z90318NPVEB8RP55TP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:38.602Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1ac7bb6d00e79f14652b2af0: done: 0.07189 sec","job_status":"done","queue_duration_s":0.258403,"scheduling_latency_s":0.258418,"redis_calls":11,"redis_duration_s":0.0017989999999999998,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222933,"duration_s":0.07189,"completed_at":"2026-09-04T07:43:38.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016981,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2128gitlab # [ 256.849086] gitaly[903]: time="2026-09-04T07:43:39.639Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ3HXNERP9FWAQ48G98XM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:39.627" grpc.time_ms=11.533 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2129gitlab # [ 256.850482] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 592130gitlab # [ 256.924057] gitaly[903]: time="2026-09-04T07:43:39.715Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ3M6140B4GG4NF4PKG96 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:39.703" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2131gitlab # [ 256.924331] gitaly[903]: time="2026-09-04T07:43:39.715Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ3M6140B4GG4NF4PKG96 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:39.703" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2132gitlab # [ 256.925094] gitaly[903]: time="2026-09-04T07:43:39.716Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ3M6140B4GG4NF4PKG96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:39.703" grpc.time_ms=12.742 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2133gitlab # [ 256.925912] gitlab-workhorse[829]: time="2026-09-04T07:43:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672134gitlab # [ 256.927037] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 622135gitlab # [ 257.065774] gitaly[903]: time="2026-09-04T07:43:39.857Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ3RTKNVKPM6MTA2MNJNY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:39.848" grpc.time_ms=8.381 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2136gitlab # [ 257.078565] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 672137gitlab # [ 257.166986] gitaly[903]: time="2026-09-04T07:43:39.958Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ3V1J4EZP6E4PCEFFY1Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:39.945" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2138gitlab # [ 257.167936] gitaly[903]: time="2026-09-04T07:43:39.958Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ3V1J4EZP6E4PCEFFY1Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:39.945" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2139gitlab # [ 257.169459] gitaly[903]: time="2026-09-04T07:43:39.958Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ3V1J4EZP6E4PCEFFY1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:39.945" grpc.time_ms=12.971 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2140gitlab # [ 257.170166] gitlab-workhorse[829]: time="2026-09-04T07:43:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672141gitlab # [ 257.171810] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 852142gitlab # [ 257.276934] gitaly[903]: time="2026-09-04T07:43:40.068Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:10.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:40.067" grpc.time_ms=0.904 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 257.302596] gitaly[903]: time="2026-09-04T07:43:40.083Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:44:10.075" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:40.075" grpc.time_ms=8.273 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144gitlab # [ 257.305784] gitaly[903]: time="2026-09-04T07:43:40.097Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:50.057" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:40.088" grpc.time_ms=9.106 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 257.337431] gitaly[903]: time="2026-09-04T07:43:40.128Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:43:50.097" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:40.128" grpc.time_ms=0.378 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 257.362305] gitaly[903]: time="2026-09-04T07:43:40.153Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:43:50.113" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:40.144" grpc.time_ms=9.641 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 257.403825] gitaly[903]: time="2026-09-04T07:43:40.195Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4147 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:40.194" grpc.time_ms=1.169 pid=903 span.kind=server system=grpc2148gitlab # [ 257.447524] gitaly[903]: time="2026-09-04T07:43:40.238Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:40.238" grpc.time_ms=0.4 pid=903 span.kind=server system=grpc2149gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d'2150gitlab # [ 257.465273] gitaly[903]: time="2026-09-04T07:43:40.256Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 diskcache=191bb4bd-7e35-4e34-9a57-aaab18e0d303 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:43:50.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:40.156" pid=903 ref=refs/keep-around/ce8211762f9fb7bcd02357af6f8baff7df09b47d remote_ip="2001:db8:1::1" revision=ce8211762f9fb7bcd02357af6f8baff7df09b47d span.kind=server system=grpc username=root2151gitlab # [ 257.465927] gitaly[903]: time="2026-09-04T07:43:40.257Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=82 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5469 command.oublock=8 command.real_time_ms=92 command.spawn_token_fork_ms=0 command.system_time_ms=50 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:43:50.125" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:43:40.156" grpc.time_ms=100.72 pid=903 ref=refs/keep-around/ce8211762f9fb7bcd02357af6f8baff7df09b47d remote_ip="2001:db8:1::1" revision=ce8211762f9fb7bcd02357af6f8baff7df09b47d span.kind=server system=grpc username=root2152gitlab # [ 257.470987] gitaly[903]: time="2026-09-04T07:43:40.262Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:10.261" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:40.261" grpc.time_ms=0.579 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 257.488222] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:40.278Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8f9c6475d24eee0756240171","created_at":"2026-09-04T07:43:40.266Z","trace_propagation_headers":{"sentry-trace":"03fea0e5c66f4475a9a802c3b83330b8-ca187129b2c2471d","baggage":"sentry-trace_id=03fea0e5c66f4475a9a802c3b83330b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNZ401ZTQASA0SM41ES2W9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:40.271Z","job_size_bytes":65,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8f9c6475d24eee0756240171: start","job_status":"start","queue_duration_s":0.006731,"scheduling_latency_s":0.006789}2154gitlab # [ 257.523187] nixbot[2613]: INFO: ::ffff:127.0.0.1:37152 - "GET /api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 200 OK2155gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=ce8211762f9fb7bcd02357af6f8baff7df09b47d', in 0.06 seconds)2156(finished: subtest: push delivers the webhook, in 59.26 seconds)2157subtest: eval and build post commit statuses2158gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses2159gitlab # [ 257.533167] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:40.324Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"8f9c6475d24eee0756240171","created_at":"2026-09-04T07:43:40.266Z","trace_propagation_headers":{"sentry-trace":"03fea0e5c66f4475a9a802c3b83330b8-ca187129b2c2471d","baggage":"sentry-trace_id=03fea0e5c66f4475a9a802c3b83330b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNZ401ZTQASA0SM41ES2W9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:40.271Z","job_size_bytes":65,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-8f9c6475d24eee0756240171: done: 0.046049 sec","job_status":"done","queue_duration_s":0.006731,"scheduling_latency_s":0.006789,"redis_calls":7,"redis_duration_s":0.002742,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046049,"completed_at":"2026-09-04T07:43:40.324Z","load_balancing_strategy":"primary","db_duration_s":0.008156,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2160gitlab # [ 257.553770] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:40.327Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e7fca23998194c8deb17a767","created_at":"2026-09-04T07:43:40.275Z","trace_propagation_headers":{"sentry-trace":"03fea0e5c66f4475a9a802c3b83330b8-ca187129b2c2471d","baggage":"sentry-trace_id=03fea0e5c66f4475a9a802c3b83330b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNZ401ZTQASA0SM41ES2W9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:40.278Z","job_size_bytes":65,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e7fca23998194c8deb17a767: start","job_status":"start","queue_duration_s":0.048919,"scheduling_latency_s":0.048942}2161gitlab # [ 257.575216] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3302162gitlab # [ 257.575938] nixbot[2613]: {"ts": "2026-09-04T07:43:40.365Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce8211762f9fb7bcd02357af6f8baff7df09b47d \"HTTP/1.1 201 Created\""}2163gitlab # [ 257.594380] nixbot[2613]: {"ts": "2026-09-04T07:43:40.385Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-ce8211762f9f-5"}2164gitlab # [ 257.597493] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:40.388Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e7fca23998194c8deb17a767","created_at":"2026-09-04T07:43:40.275Z","trace_propagation_headers":{"sentry-trace":"03fea0e5c66f4475a9a802c3b83330b8-ca187129b2c2471d","baggage":"sentry-trace_id=03fea0e5c66f4475a9a802c3b83330b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNZ401ZTQASA0SM41ES2W9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:40.278Z","job_size_bytes":65,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e7fca23998194c8deb17a767: done: 0.061239 sec","job_status":"done","queue_duration_s":0.048919,"scheduling_latency_s":0.048942,"redis_calls":10,"redis_duration_s":0.0029189999999999997,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001279,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061239,"completed_at":"2026-09-04T07:43:40.388Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 257.600838] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:40.390Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"67d18172c57f015c3bdeea28","created_at":"2026-09-04T07:43:40.343Z","trace_propagation_headers":{"sentry-trace":"03fea0e5c66f4475a9a802c3b83330b8-ca187129b2c2471d","baggage":"sentry-trace_id=03fea0e5c66f4475a9a802c3b83330b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNZ401ZTQASA0SM41ES2W9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:40.347Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-67d18172c57f015c3bdeea28: start","job_status":"start","queue_duration_s":0.043163,"scheduling_latency_s":0.043186}2166gitlab # [ 257.611646] gitaly[903]: time="2026-09-04T07:43:40.403Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ49VY443NH62JRRR9CQG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:10.399" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:40.400" grpc.time_ms=2.687 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 257.643065] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 862168gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses, in 0.14 seconds)2169gitlab # [ 257.692059] gitaly[903]: time="2026-09-04T07:43:40.483Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:44:10.182" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:40.482" grpc.time_ms=0.803 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab # [ 257.727977] nixbot[2613]: {"ts": "2026-09-04T07:43:40.519Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-ce8211762f9f-5", "argv0": "bwrap"}2171gitlab # [ 257.732404] gitaly[903]: time="2026-09-04T07:43:40.523Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ401ZTQASA0SM41ES2W9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:10.222" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:40.523" grpc.time_ms=0.531 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 257.747115] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:40.538Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"67d18172c57f015c3bdeea28","created_at":"2026-09-04T07:43:40.343Z","trace_propagation_headers":{"sentry-trace":"03fea0e5c66f4475a9a802c3b83330b8-ca187129b2c2471d","baggage":"sentry-trace_id=03fea0e5c66f4475a9a802c3b83330b8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNZ401ZTQASA0SM41ES2W9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:40.347Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-67d18172c57f015c3bdeea28: done: 0.147377 sec","job_status":"done","queue_duration_s":0.043163,"scheduling_latency_s":0.043186,"gitaly_calls":2,"gitaly_duration_s":0.017608,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.012474,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.003902,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000827,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000225,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001135,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00019,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000351,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081134,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.107153283,"duration_s":0.147377,"completed_at":"2026-09-04T07:43:40.538Z","load_balancing_strategy":"primary","db_duration_s":0.045619,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2173gitlab # [ 257.768061] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:40.539Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c9303a9e5abe14564d8279e1","created_at":"2026-09-04T07:43:40.469Z","trace_propagation_headers":{"sentry-trace":"03fea0e5c66f4475a9a802c3b83330b8-1ed68181f33144d0","baggage":"sentry-trace_id=03fea0e5c66f4475a9a802c3b83330b8,sentry-release=Unknown"},"correlation_id":"01M1NNZ401ZTQASA0SM41ES2W9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:40.471Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c9303a9e5abe14564d8279e1: start","job_status":"start","queue_duration_s":0.06824,"scheduling_latency_s":0.068255}2174gitlab # [ 257.776152] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:40.567Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c9303a9e5abe14564d8279e1","created_at":"2026-09-04T07:43:40.469Z","trace_propagation_headers":{"sentry-trace":"03fea0e5c66f4475a9a802c3b83330b8-1ed68181f33144d0","baggage":"sentry-trace_id=03fea0e5c66f4475a9a802c3b83330b8,sentry-release=Unknown"},"correlation_id":"01M1NNZ401ZTQASA0SM41ES2W9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:40.471Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c9303a9e5abe14564d8279e1: done: 0.028044 sec","job_status":"done","queue_duration_s":0.06824,"scheduling_latency_s":0.068255,"redis_calls":7,"redis_duration_s":0.0010170000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028044,"completed_at":"2026-09-04T07:43:40.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2175gitlab # [ 257.889382] nix-daemon[2842]: accepted connection from pid 3458, user nixbot2176gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses2177gitlab # [ 258.775541] gitaly[903]: time="2026-09-04T07:43:41.566Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ5DS5ZRJ4T64AW8FTB4W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:11.564" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:41.565" grpc.time_ms=0.936 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 258.810507] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1032179gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses, in 0.15 seconds)2180gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses2181gitlab # [ 259.920425] gitaly[903]: time="2026-09-04T07:43:42.711Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ6HN5QRJA1WAFKGQ0RND grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:12.709" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:42.709" grpc.time_ms=0.875 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2182gitlab # [ 259.964420] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1092183gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses, in 0.15 seconds)2184gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses2185gitlab # [ 261.069555] gitaly[903]: time="2026-09-04T07:43:43.860Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ7NPF3BH3M8K4P9GYCJ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:13.858" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:43.858" grpc.time_ms=0.934 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab # [ 261.103570] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 952187gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses, in 0.14 seconds)2188gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses2189gitlab # [ 262.212434] gitaly[903]: time="2026-09-04T07:43:45.003Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ8SCSYRT6M6YN86T05W1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:15.001" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:45.001" grpc.time_ms=1.066 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2190gitlab # [ 262.247623] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 972191gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses, in 0.15 seconds)2192gitlab # [ 262.286211] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.076Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5909aa6190b52de7b74b9b08","created_at":"2026-09-04T07:43:45.062Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44ef75efdee1a12900ba4dbf6976156a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:43:45.073Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5909aa6190b52de7b74b9b08: start","job_status":"start","queue_duration_s":0.002985,"scheduling_latency_s":0.003039}2193gitlab # [ 262.376751] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.167Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5909aa6190b52de7b74b9b08","created_at":"2026-09-04T07:43:45.062Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44ef75efdee1a12900ba4dbf6976156a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:43:45.073Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5909aa6190b52de7b74b9b08: done: 0.091248 sec","job_status":"done","queue_duration_s":0.002985,"scheduling_latency_s":0.003039,"redis_calls":9,"redis_duration_s":0.025082,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001869,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.021977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03143,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.091248,"completed_at":"2026-09-04T07:43:45.167Z","load_balancing_strategy":"primary","db_duration_s":0.005648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2194gitlab # [ 262.449092] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7aaebd41dee75c6593df2505","created_at":"2026-09-04T07:43:45.084Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"936f6ff0d420a4418d22efe32fe962ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.097Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7aaebd41dee75c6593df2505: start","job_status":"start","queue_duration_s":0.142354,"scheduling_latency_s":0.142406}2195gitlab # [ 262.522769] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7aaebd41dee75c6593df2505","created_at":"2026-09-04T07:43:45.084Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"936f6ff0d420a4418d22efe32fe962ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.097Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7aaebd41dee75c6593df2505: done: 0.073545 sec","job_status":"done","queue_duration_s":0.142354,"scheduling_latency_s":0.142406,"redis_calls":11,"redis_duration_s":0.016392,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00301,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003706,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.073545,"completed_at":"2026-09-04T07:43:45.313Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2196gitlab # [ 262.580072] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9734b04ec6877d32714f9f33","created_at":"2026-09-04T07:43:45.129Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21b6570661bc1545b0eb5cc02d441fa7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.246Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9734b04ec6877d32714f9f33: start","job_status":"start","queue_duration_s":0.075667,"scheduling_latency_s":0.075707}2197gitlab # [ 262.596435] nix-daemon[2842]: accepted connection from pid 3495, user nixbot2198gitlab # [ 262.607680] nix-daemon[2842]: accepted connection from pid 3458, user nixbot2199gitlab # [ 262.650263] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9734b04ec6877d32714f9f33","created_at":"2026-09-04T07:43:45.129Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21b6570661bc1545b0eb5cc02d441fa7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.246Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9734b04ec6877d32714f9f33: done: 0.119158 sec","job_status":"done","queue_duration_s":0.075667,"scheduling_latency_s":0.075707,"redis_calls":13,"redis_duration_s":0.031266,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.016979,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003637,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00147393,"exclusive_lock_hold_duration_s":0.048066724,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.119158,"completed_at":"2026-09-04T07:43:45.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2200gitlab # [ 262.655377] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.445Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9bbb6c4f384444c5716ef228","created_at":"2026-09-04T07:43:45.254Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bccc258674d557fa083a12c5826f907","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.273Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9bbb6c4f384444c5716ef228: start","job_status":"start","queue_duration_s":0.172204,"scheduling_latency_s":0.172227}2201gitlab # [ 262.697649] gitaly[903]: time="2026-09-04T07:43:45.472Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:15.471" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:45.472" grpc.time_ms=0.726 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2202gitlab # [ 262.708308] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.499Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9bbb6c4f384444c5716ef228","created_at":"2026-09-04T07:43:45.254Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1bccc258674d557fa083a12c5826f907","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.273Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9bbb6c4f384444c5716ef228: done: 0.053599 sec","job_status":"done","queue_duration_s":0.172204,"scheduling_latency_s":0.172227,"redis_calls":9,"redis_duration_s":0.0027900000000000004,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053599,"completed_at":"2026-09-04T07:43:45.499Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2203gitlab # [ 262.714554] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.503Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cc6c70d5b8f9a379b28f66c4","created_at":"2026-09-04T07:43:45.292Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14abd08fc574bf23e1aed40215e0b42f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.310Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cc6c70d5b8f9a379b28f66c4: start","job_status":"start","queue_duration_s":0.192505,"scheduling_latency_s":0.192523}2204gitlab # [ 262.742743] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cc6c70d5b8f9a379b28f66c4","created_at":"2026-09-04T07:43:45.292Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14abd08fc574bf23e1aed40215e0b42f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.310Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cc6c70d5b8f9a379b28f66c4: done: 0.030958 sec","job_status":"done","queue_duration_s":0.192505,"scheduling_latency_s":0.192523,"redis_calls":11,"redis_duration_s":0.001765,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000326019,"exclusive_lock_hold_duration_s":0.010508039,"duration_s":0.030958,"completed_at":"2026-09-04T07:43:45.534Z","load_balancing_strategy":"primary","db_duration_s":0.014095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205gitlab # [ 262.795984] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"31f29e288182ad4e67911c56","created_at":"2026-09-04T07:43:45.323Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73d9806fb8778d2aec9392a0334c76f8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.339Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-31f29e288182ad4e67911c56: start","job_status":"start","queue_duration_s":0.195615,"scheduling_latency_s":0.195628}2206gitlab # [ 262.796695] gitaly[903]: time="2026-09-04T07:43:45.572Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=8 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:55.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:45.561" grpc.time_ms=10.63 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab # [ 262.818454] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1742208gitlab # [ 262.822465] nixbot[2613]: {"ts": "2026-09-04T07:43:45.611Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce8211762f9fb7bcd02357af6f8baff7df09b47d \"HTTP/1.1 201 Created\""}2209gitlab # [ 262.855829] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.647Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"31f29e288182ad4e67911c56","created_at":"2026-09-04T07:43:45.323Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73d9806fb8778d2aec9392a0334c76f8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.339Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-31f29e288182ad4e67911c56: done: 0.11212 sec","job_status":"done","queue_duration_s":0.195615,"scheduling_latency_s":0.195628,"redis_calls":9,"redis_duration_s":0.081976,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.080367,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001348,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.11212,"completed_at":"2026-09-04T07:43:45.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009727,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2210gitlab # [ 262.860523] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.651Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6e28f9525fb9003c60a7d66e","created_at":"2026-09-04T07:43:45.366Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c524d02ef5fe9f6a5fa50a1c82ea45e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:43:45.379Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6e28f9525fb9003c60a7d66e: start","job_status":"start","queue_duration_s":0.272669,"scheduling_latency_s":0.272701}2211gitlab # [ 262.887462] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.679Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2212gitlab # [ 262.898201] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6e28f9525fb9003c60a7d66e","created_at":"2026-09-04T07:43:45.366Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c524d02ef5fe9f6a5fa50a1c82ea45e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:43:45.379Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6e28f9525fb9003c60a7d66e: done: 0.037809 sec","job_status":"done","queue_duration_s":0.272669,"scheduling_latency_s":0.272701,"redis_calls":9,"redis_duration_s":0.004784,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000724,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002553,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037809,"completed_at":"2026-09-04T07:43:45.689Z","load_balancing_strategy":"primary","db_duration_s":0.009063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2213gitlab # [ 262.905804] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"56e1a6ef0d3b1696cf70ece0","created_at":"2026-09-04T07:43:45.391Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a1e9a6363a7bc3e2c78d25849ac6c95","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.402Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-56e1a6ef0d3b1696cf70ece0: start","job_status":"start","queue_duration_s":0.289062,"scheduling_latency_s":0.289078}2214gitlab # [ 262.946927] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.730Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"56e1a6ef0d3b1696cf70ece0","created_at":"2026-09-04T07:43:45.391Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a1e9a6363a7bc3e2c78d25849ac6c95","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.402Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-56e1a6ef0d3b1696cf70ece0: done: 0.039312 sec","job_status":"done","queue_duration_s":0.289062,"scheduling_latency_s":0.289078,"redis_calls":9,"redis_duration_s":0.001514,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000313,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.039312,"completed_at":"2026-09-04T07:43:45.730Z","load_balancing_strategy":"primary","db_duration_s":0.005946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2215gitlab # [ 262.955797] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"15b2e17678ee0e7d8df4b792","created_at":"2026-09-04T07:43:45.414Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.424Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-15b2e17678ee0e7d8df4b792: start","job_status":"start","queue_duration_s":0.307546,"scheduling_latency_s":0.307564}2216gitlab # [ 263.022987] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.814Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"15b2e17678ee0e7d8df4b792","created_at":"2026-09-04T07:43:45.414Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.424Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-15b2e17678ee0e7d8df4b792: done: 0.082058 sec","job_status":"done","queue_duration_s":0.307546,"scheduling_latency_s":0.307564,"redis_calls":70,"redis_duration_s":0.010934,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001549,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000598,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.008209,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000578,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.082058,"completed_at":"2026-09-04T07:43:45.814Z","load_balancing_strategy":"primary","db_duration_s":0.005179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2217gitlab # [ 263.024499] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.815Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"204fa56b8f7ebe037a87e247","created_at":"2026-09-04T07:43:45.433Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c208167eb40db97f730997c0def8635b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.443Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-204fa56b8f7ebe037a87e247: start","job_status":"start","queue_duration_s":0.371858,"scheduling_latency_s":0.371886}2218gitlab # [ 263.051495] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.842Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"204fa56b8f7ebe037a87e247","created_at":"2026-09-04T07:43:45.433Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c208167eb40db97f730997c0def8635b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.443Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-204fa56b8f7ebe037a87e247: done: 0.027278 sec","job_status":"done","queue_duration_s":0.371858,"scheduling_latency_s":0.371886,"redis_calls":18,"redis_duration_s":0.004028,"redis_read_bytes":20,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000894,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000387,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00194,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027278,"completed_at":"2026-09-04T07:43:45.842Z","load_balancing_strategy":"primary","db_duration_s":0.001516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2219gitlab # [ 263.098129] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.843Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5d09ee123fb74095d455840c","created_at":"2026-09-04T07:43:45.459Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9774c0178fd01cac8a4e971f94278aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.470Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5d09ee123fb74095d455840c: start","job_status":"start","queue_duration_s":0.373602,"scheduling_latency_s":0.37362}2220gitlab # [ 263.099230] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.851Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2221gitlab # [ 263.100069] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"5d09ee123fb74095d455840c","created_at":"2026-09-04T07:43:45.459Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9774c0178fd01cac8a4e971f94278aa9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.470Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-5d09ee123fb74095d455840c: done: 0.012727 sec","job_status":"done","queue_duration_s":0.373602,"scheduling_latency_s":0.37362,"redis_calls":9,"redis_duration_s":0.0012339999999999999,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012727,"completed_at":"2026-09-04T07:43:45.856Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2222gitlab # [ 263.144618] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d4731124b8f9fa29295c47c9","created_at":"2026-09-04T07:43:45.478Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"391d3d1c9cd9abf27d5c6b4dcb48b8ae","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.489Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d4731124b8f9fa29295c47c9: start","job_status":"start","queue_duration_s":0.368061,"scheduling_latency_s":0.368077}2223gitlab # [ 263.145751] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d4731124b8f9fa29295c47c9","created_at":"2026-09-04T07:43:45.478Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"391d3d1c9cd9abf27d5c6b4dcb48b8ae","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.489Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d4731124b8f9fa29295c47c9: done: 0.02265 sec","job_status":"done","queue_duration_s":0.368061,"scheduling_latency_s":0.368077,"redis_calls":12,"redis_duration_s":0.002456,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000405,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001139,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006949207,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.02265,"completed_at":"2026-09-04T07:43:45.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002513,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2224gitlab # [ 263.182309] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.881Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ba451c362b798b6f2001518c","created_at":"2026-09-04T07:43:45.494Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e87cc2bda464a55a7700840fb039d964","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.500Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ba451c362b798b6f2001518c: start","job_status":"start","queue_duration_s":0.380838,"scheduling_latency_s":0.380854}2225gitlab # [ 263.229713] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.889Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2226gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses2227gitlab # [ 263.230675] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ba451c362b798b6f2001518c","created_at":"2026-09-04T07:43:45.494Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e87cc2bda464a55a7700840fb039d964","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.500Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ba451c362b798b6f2001518c: done: 0.013864 sec","job_status":"done","queue_duration_s":0.380838,"scheduling_latency_s":0.380854,"redis_calls":9,"redis_duration_s":0.002015,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000513,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013864,"completed_at":"2026-09-04T07:43:45.895Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2228gitlab # [ 263.237741] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:45.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7558890557885c59b5fce733","created_at":"2026-09-04T07:43:45.502Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dee273c07678b487bdaa75672d36c52e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.511Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7558890557885c59b5fce733: start","job_status":"start","queue_duration_s":0.386705,"scheduling_latency_s":0.386787}2229gitlab # [ 263.308564] gitaly[903]: time="2026-09-04T07:43:46.099Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ9EGSE2HK1Q7J5GZFY51 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:16.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:46.097" grpc.time_ms=0.925 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2230gitlab # [ 263.348891] gitaly[903]: time="2026-09-04T07:43:46.140Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ9EGSE2HK1Q7J5GZFY51 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:56.103" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:46.133" grpc.time_ms=6.45 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2231gitlab # [ 263.360758] gitaly[903]: time="2026-09-04T07:43:46.152Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ9XYR19SWYFTVYJPGRC0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:16.150" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:46.151" grpc.time_ms=0.789 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2232gitlab # [ 263.376647] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 572233gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses, in 0.12 seconds)2234gitlab # [ 263.392436] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7558890557885c59b5fce733","created_at":"2026-09-04T07:43:45.502Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dee273c07678b487bdaa75672d36c52e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.511Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7558890557885c59b5fce733: done: 0.285808 sec","job_status":"done","queue_duration_s":0.386705,"scheduling_latency_s":0.386787,"redis_calls":564,"redis_duration_s":0.09153800000000001,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001052,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.090005,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.285808,"completed_at":"2026-09-04T07:43:46.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2235gitlab # [ 263.414920] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1aa0c9fa1d43a6ded5595db4","created_at":"2026-09-04T07:43:45.515Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2fab9d50a319de8e9a7cfdf8c66306e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.521Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1aa0c9fa1d43a6ded5595db4: start","job_status":"start","queue_duration_s":0.6627,"scheduling_latency_s":0.66272}2236gitlab # [ 263.415758] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.192Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2237gitlab # [ 263.416355] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1aa0c9fa1d43a6ded5595db4","created_at":"2026-09-04T07:43:45.515Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2fab9d50a319de8e9a7cfdf8c66306e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.521Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1aa0c9fa1d43a6ded5595db4: done: 0.012046 sec","job_status":"done","queue_duration_s":0.6627,"scheduling_latency_s":0.66272,"redis_calls":9,"redis_duration_s":0.001286,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012046,"completed_at":"2026-09-04T07:43:46.196Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2238gitlab # [ 263.458588] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 5892239gitlab # [ 263.459231] nixbot[2613]: {"ts": "2026-09-04T07:43:46.203Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce8211762f9fb7bcd02357af6f8baff7df09b47d \"HTTP/1.1 201 Created\""}2240gitlab # [ 263.459717] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e208d983c1fe6858a48babbc","created_at":"2026-09-04T07:43:45.526Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf48d9c9dd90e7b77119756b2f257297","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.535Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e208d983c1fe6858a48babbc: start","job_status":"start","queue_duration_s":0.661769,"scheduling_latency_s":0.661783}2241gitlab # [ 263.463794] gitaly[903]: time="2026-09-04T07:43:46.250Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZA17T0CPT3V59RTNBY02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:16.249" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:46.250" grpc.time_ms=0.514 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2242gitlab # [ 263.506818] gitaly[903]: time="2026-09-04T07:43:46.278Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZA17T0CPT3V59RTNBY02 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:43:56.241" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:46.272" grpc.time_ms=6.161 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2243gitlab # [ 263.524627] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/ce8211762f9fb7bcd02357af6f8baff7df09b47d HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1002244gitlab # [ 263.525628] nixbot[2613]: {"ts": "2026-09-04T07:43:46.317Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/ce8211762f9fb7bcd02357af6f8baff7df09b47d \"HTTP/1.1 201 Created\""}2245gitlab # [ 263.544743] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e208d983c1fe6858a48babbc","created_at":"2026-09-04T07:43:45.526Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bf48d9c9dd90e7b77119756b2f257297","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.535Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e208d983c1fe6858a48babbc: done: 0.138102 sec","job_status":"done","queue_duration_s":0.661769,"scheduling_latency_s":0.661783,"redis_calls":11,"redis_duration_s":0.002267,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.121,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.121,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000302832,"exclusive_lock_hold_duration_s":0.121548967,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.138102,"completed_at":"2026-09-04T07:43:46.335Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.120487,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2246gitlab # [ 263.565605] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b0a193ae53b633d2c3e2e17b","created_at":"2026-09-04T07:43:45.539Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6598846d36e4c062d13f932705323e68","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.548Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b0a193ae53b633d2c3e2e17b: start","job_status":"start","queue_duration_s":0.789605,"scheduling_latency_s":0.789636}2247gitlab # [ 263.573693] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b0a193ae53b633d2c3e2e17b","created_at":"2026-09-04T07:43:45.539Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6598846d36e4c062d13f932705323e68","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.548Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b0a193ae53b633d2c3e2e17b: done: 0.027201 sec","job_status":"done","queue_duration_s":0.789605,"scheduling_latency_s":0.789636,"redis_calls":11,"redis_duration_s":0.001849,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000689,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000379657,"exclusive_lock_hold_duration_s":0.007355683,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.027201,"completed_at":"2026-09-04T07:43:46.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006907,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2248gitlab # [ 263.629149] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.369Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ebdcbec1329887bb9a67a7f6","created_at":"2026-09-04T07:43:45.550Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7923b708203fd6fa1e79710de140b214","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.559Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ebdcbec1329887bb9a67a7f6: start","job_status":"start","queue_duration_s":0.809801,"scheduling_latency_s":0.809827}2249gitlab # [ 263.629840] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.379Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2250gitlab # [ 263.630441] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"ebdcbec1329887bb9a67a7f6","created_at":"2026-09-04T07:43:45.550Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7923b708203fd6fa1e79710de140b214","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.559Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-ebdcbec1329887bb9a67a7f6: done: 0.014404 sec","job_status":"done","queue_duration_s":0.809801,"scheduling_latency_s":0.809827,"redis_calls":9,"redis_duration_s":0.0012410000000000001,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000311,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014404,"completed_at":"2026-09-04T07:43:46.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2251gitlab # [ 263.671709] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.385Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"728ff52de66fdbffbd1c69bc","created_at":"2026-09-04T07:43:45.594Z","trace_propagation_headers":{"sentry-trace":"fd6470d724f648b49fa22539ed20763f-a219153da2d148b9","baggage":"sentry-trace_id=fd6470d724f648b49fa22539ed20763f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNZ98TR2ZD32W53NW5ASTR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.597Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-728ff52de66fdbffbd1c69bc: start","job_status":"start","queue_duration_s":0.787597,"scheduling_latency_s":0.787612}2252gitlab # [ 263.672641] gitaly[903]: time="2026-09-04T07:43:46.459Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:46.458" grpc.time_ms=0.351 pid=903 span.kind=server system=grpc2253gitlab # [ 263.689023] gitaly[903]: time="2026-09-04T07:43:46.480Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3889 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:46.479" grpc.time_ms=0.862 pid=903 span.kind=server system=grpc2254gitlab # [ 263.710483] gitaly[903]: time="2026-09-04T07:43:46.502Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:43:46.501" grpc.time_ms=0.289 pid=903 span.kind=server system=grpc2255gitlab # [ 263.714234] gitaly[903]: time="2026-09-04T07:43:46.505Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:16.137" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:46.437" operations="[repack_refs]" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2256gitlab # [ 263.715981] gitaly[903]: time="2026-09-04T07:43:46.507Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:16.137" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:46.437" pid=903 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-04 07:42:35.741025583 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2257gitlab # [ 263.719949] gitaly[903]: time="2026-09-04T07:43:46.511Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR diskcache=c415eb9e-69f4-4361-a78e-3d51ccd0ee2c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:16.137" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:46.437" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab # [ 263.721549] gitaly[903]: time="2026-09-04T07:43:46.513Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=77 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7503 command.oublock=0 command.real_time_ms=70 command.spawn_token_fork_ms=0 command.system_time_ms=53 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:16.137" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:46.437" grpc.time_ms=75.254 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2259gitlab # [ 263.769099] gitaly[903]: time="2026-09-04T07:43:46.524Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:16.137" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:46.437" pid=903 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2260gitlab # [ 263.769690] gitaly[903]: time="2026-09-04T07:43:46.524Z" level=info msg="optimized repository" clean_stale_data_time=16.285589ms clean_work_trees_time="72.635µs" commit_graph_time="3.352µs" correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=903 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=16.463545ms2261gitlab # [ 263.770205] gitaly[903]: time="2026-09-04T07:43:46.524Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:44:16.137" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:43:46.437" pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 263.777336] gitaly[903]: time="2026-09-04T07:43:46.568Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:44:16.267" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:46.568" grpc.time_ms=0.717 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2263gitlab # [ 263.799263] gitaly[903]: time="2026-09-04T07:43:46.590Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZ98TR2ZD32W53NW5ASTR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:44:16.289" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:43:46.589" grpc.time_ms=0.554 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2264gitlab # [ 263.805462] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.596Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"728ff52de66fdbffbd1c69bc","created_at":"2026-09-04T07:43:45.594Z","trace_propagation_headers":{"sentry-trace":"fd6470d724f648b49fa22539ed20763f-a219153da2d148b9","baggage":"sentry-trace_id=fd6470d724f648b49fa22539ed20763f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNZ98TR2ZD32W53NW5ASTR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.597Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2582,"job_status":"rescheduled","message":"PipelineProcessWorker JID-728ff52de66fdbffbd1c69bc: rescheduled"}2265gitlab # [ 263.810631] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.601Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"728ff52de66fdbffbd1c69bc","created_at":"2026-09-04T07:43:45.594Z","trace_propagation_headers":{"sentry-trace":"fd6470d724f648b49fa22539ed20763f-a219153da2d148b9","baggage":"sentry-trace_id=fd6470d724f648b49fa22539ed20763f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NNZ98TR2ZD32W53NW5ASTR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.597Z","job_size_bytes":3,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-728ff52de66fdbffbd1c69bc: done: 0.216753 sec","job_status":"done","queue_duration_s":0.787597,"scheduling_latency_s":0.787612,"gitaly_calls":3,"gitaly_duration_s":0.085857,"redis_calls":76,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010898999999999999,"redis_read_bytes":168,"redis_write_bytes":21330,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000663,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001174,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002768,"redis_queues_read_bytes":37,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":20,"redis_queues_metadata_duration_s":0.00374,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3301,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000189,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000452,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00125,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100026,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.191363148,"duration_s":0.216753,"completed_at":"2026-09-04T07:43:46.601Z","load_balancing_strategy":"primary","db_duration_s":0.023447,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2266gitlab # [ 263.852944] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"2dcae9141e60b8c0846f10a5","created_at":"2026-09-04T07:43:45.639Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a604c3640c7b755849375f39a2457bc0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.650Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-2dcae9141e60b8c0846f10a5: start","job_status":"start","queue_duration_s":0.952574,"scheduling_latency_s":0.952591}2267gitlab # [ 263.853653] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"2dcae9141e60b8c0846f10a5","created_at":"2026-09-04T07:43:45.639Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a604c3640c7b755849375f39a2457bc0","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.650Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-2dcae9141e60b8c0846f10a5: done: 0.019094 sec","job_status":"done","queue_duration_s":0.952574,"scheduling_latency_s":0.952591,"redis_calls":12,"redis_duration_s":0.002929,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001958,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000320431,"exclusive_lock_hold_duration_s":0.005229994,"duration_s":0.019094,"completed_at":"2026-09-04T07:43:46.622Z","load_balancing_strategy":"primary","db_duration_s":0.0018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2268gitlab # [ 263.891989] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9c8dcb20cb167df45f52be76","created_at":"2026-09-04T07:43:45.656Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44196784dd666442ed378576b409d412","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.664Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9c8dcb20cb167df45f52be76: start","job_status":"start","queue_duration_s":0.958501,"scheduling_latency_s":0.958515}2269gitlab # [ 263.984265] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"9c8dcb20cb167df45f52be76","created_at":"2026-09-04T07:43:45.656Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44196784dd666442ed378576b409d412","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.664Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-9c8dcb20cb167df45f52be76: done: 0.151967 sec","job_status":"done","queue_duration_s":0.958501,"scheduling_latency_s":0.958515,"redis_calls":11,"redis_duration_s":0.0019249999999999998,"redis_read_bytes":9,"redis_write_bytes":1292,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000269,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000319035,"exclusive_lock_hold_duration_s":0.135634278,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.151967,"completed_at":"2026-09-04T07:43:46.775Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048524,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2270gitlab # [ 263.985616] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1360ebfe53e10ec52f721854","created_at":"2026-09-04T07:43:45.676Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"819d71dc0c553b3a920f014aca80b668","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.681Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1360ebfe53e10ec52f721854: start","job_status":"start","queue_duration_s":1.095073,"scheduling_latency_s":1.0951}2271gitlab # [ 264.026812] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1360ebfe53e10ec52f721854","created_at":"2026-09-04T07:43:45.676Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"819d71dc0c553b3a920f014aca80b668","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.681Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1360ebfe53e10ec52f721854: done: 0.015827 sec","job_status":"done","queue_duration_s":1.095073,"scheduling_latency_s":1.0951,"redis_calls":9,"redis_duration_s":0.001419,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015827,"completed_at":"2026-09-04T07:43:46.792Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2272gitlab # [ 264.036101] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0d1c445225cbdd1139d48254","created_at":"2026-09-04T07:43:45.687Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcb0a87981cb38c92b4516697977fdb5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:43:45.693Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0d1c445225cbdd1139d48254: start","job_status":"start","queue_duration_s":1.100594,"scheduling_latency_s":1.100611}2273gitlab # [ 264.049108] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.802Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2274gitlab # [ 264.052782] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"0d1c445225cbdd1139d48254","created_at":"2026-09-04T07:43:45.687Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-1c9bde79cc974b54","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcb0a87981cb38c92b4516697977fdb5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:43:45.693Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-0d1c445225cbdd1139d48254: done: 0.014783 sec","job_status":"done","queue_duration_s":1.100594,"scheduling_latency_s":1.100611,"redis_calls":9,"redis_duration_s":0.0016489999999999999,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000372,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000329,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014783,"completed_at":"2026-09-04T07:43:46.808Z","load_balancing_strategy":"primary","db_duration_s":0.001114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2275gitlab # [ 264.096858] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06d2ff814d139314da83c4b4","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06d2ff814d139314da83c4b4: start","job_status":"start","queue_duration_s":1.005717,"scheduling_latency_s":1.005734}2276gitlab # [ 264.102437] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06d2ff814d139314da83c4b4","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06d2ff814d139314da83c4b4: done: 0.016357 sec","job_status":"done","queue_duration_s":1.005717,"scheduling_latency_s":1.005734,"redis_calls":15,"redis_duration_s":0.0023639999999999998,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001318,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016357,"completed_at":"2026-09-04T07:43:46.826Z","load_balancing_strategy":"primary","db_duration_s":0.000793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 264.143619] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a315cf091e2b5d9ac3cce1b","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a315cf091e2b5d9ac3cce1b: start","job_status":"start","queue_duration_s":1.023326,"scheduling_latency_s":1.023343}2278gitlab # [ 264.153913] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a315cf091e2b5d9ac3cce1b","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a315cf091e2b5d9ac3cce1b: done: 0.010506 sec","job_status":"done","queue_duration_s":1.023326,"scheduling_latency_s":1.023343,"redis_calls":13,"redis_duration_s":0.001741,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001154,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010506,"completed_at":"2026-09-04T07:43:46.838Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2279gitlab # [ 264.196135] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04fdcabd088b852ee8d2926d","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04fdcabd088b852ee8d2926d: start","job_status":"start","queue_duration_s":1.034965,"scheduling_latency_s":1.03498}2280gitlab # [ 264.198467] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04fdcabd088b852ee8d2926d","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04fdcabd088b852ee8d2926d: done: 0.010329 sec","job_status":"done","queue_duration_s":1.034965,"scheduling_latency_s":1.03498,"redis_calls":13,"redis_duration_s":0.001682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010329,"completed_at":"2026-09-04T07:43:46.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2281gitlab # [ 264.235557] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9626dadcf77ea9dc759828dd","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9626dadcf77ea9dc759828dd: start","job_status":"start","queue_duration_s":1.046444,"scheduling_latency_s":1.046459}2282gitlab # [ 264.276279] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 502283gitlab # [ 264.276577] gitlab-workhorse[829]: time="2026-09-04T07:43:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672284gitlab # [ 264.277065] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 612285gitlab # [ 264.277571] gitaly[903]: time="2026-09-04T07:43:46.948Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZAPH39B7SYFW42G2N5XK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:46.935" grpc.time_ms=12.53 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2286gitlab # [ 264.278227] gitaly[903]: time="2026-09-04T07:43:47.010Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZAR5A3H87B19JV33BNNE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:47.003" pid=903 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2287gitlab # [ 264.278944] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9626dadcf77ea9dc759828dd","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9626dadcf77ea9dc759828dd: done: 0.010307 sec","job_status":"done","queue_duration_s":1.046444,"scheduling_latency_s":1.046459,"redis_calls":13,"redis_duration_s":0.001658,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010307,"completed_at":"2026-09-04T07:43:46.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2288gitlab # [ 264.332822] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccc42a6643a38d8dab062c18","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccc42a6643a38d8dab062c18: start","job_status":"start","queue_duration_s":1.058037,"scheduling_latency_s":1.058052}2289gitlab # [ 264.333942] gitaly[903]: time="2026-09-04T07:43:47.010Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZAR5A3H87B19JV33BNNE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:47.003" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2290gitlab # [ 264.334827] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 792291gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses2292gitlab # [ 264.335633] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccc42a6643a38d8dab062c18","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccc42a6643a38d8dab062c18: done: 0.01629 sec","job_status":"done","queue_duration_s":1.058037,"scheduling_latency_s":1.058052,"redis_calls":13,"redis_duration_s":0.0025210000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01629,"completed_at":"2026-09-04T07:43:46.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2293gitlab # [ 264.381093] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3280d5804dbb65827ea84133","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3280d5804dbb65827ea84133: start","job_status":"start","queue_duration_s":1.075977,"scheduling_latency_s":1.076003}2294gitlab # [ 264.382197] gitaly[903]: time="2026-09-04T07:43:47.010Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZAR5A3H87B19JV33BNNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:47.003" grpc.time_ms=7.707 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2295gitlab # [ 264.429327] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3280d5804dbb65827ea84133","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3280d5804dbb65827ea84133: done: 0.013766 sec","job_status":"done","queue_duration_s":1.075977,"scheduling_latency_s":1.076003,"redis_calls":13,"redis_duration_s":0.001931,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013766,"completed_at":"2026-09-04T07:43:46.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/ce8211762f9fb7bcd02357af6f8baff7df09b47d/statuses, in 0.10 seconds)2297gitlab # [ 264.430522] sidekiq-cluster[2582]: {"severity":"INFO","time":"2026-09-04T07:43:46.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf6c4fb92c362a09ecf2f8d","created_at":"2026-09-04T07:43:45.751Z","trace_propagation_headers":{"sentry-trace":"039708b515da45ff87769d746c05aad5-5ee127a7436a41a3","baggage":"sentry-trace_id=039708b515da45ff87769d746c05aad5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"4cf42be6e2d1ba0fd38cfa7f08a1d499","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:43:45.804Z","job_size_bytes":2,"pid":2582,"sidekiq_tid":"m83i","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf6c4fb92c362a09ecf2f8d: start","job_status":"start","queue_duration_s":1.090966,"scheduling_latency_s":1.090981}2298(finished: subtest: eval and build post commit statuses, in 6.95 seconds)2299gitlab # [ 264.471333] gitlab-workhorse[829]: time="2026-09-04T07:43:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672300(finished: run the VM test script, in 339.12 seconds)2301gitlab # [ 264.472075] gitlab-workhorse[829]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:47 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 542302gitlab # [ 264.472599] gitaly[903]: time="2026-09-04T07:43:47.115Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=29 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NNZATVXF125WG6KP8HQ745 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:43:47.077" grpc.time_ms=38.044 pid=903 remote_ip="2001:db8:1::1" span.kind=server system=grpc2303test script finished in 339.15s2304cleanup2305kill QemuMachine (pid 46)2306gitlab # [ 264.473267] gitaly[903]: time="2026-09-04T07:43:47.170Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NNZAXDN4FNFB9PADE6KD2F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb78qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2307gitlab # 72308(finished: cleanup, in 1.21 seconds)2309additionally exposed symbols:2310 gitlab,2311 vlan1,2312 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2313[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-04T07:42:40.851Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2314[]2315[]2316[]2317[]2318[]2319[]2320[]2321[]2322[]2323[]2324[]2325[]2326[]2327[]2328[]2329[]2330[]2331[]2332[]2333[]2334[]2335[]2336[]2337[]2338[]2339[]2340[]2341[]2342[]2343[]2344[]2345[]2346[]2347[]2348[]2349[]2350[]2351[]2352[]2353[]2354[]2355[]2356[]2357[]2358[]2359[]2360[]2361[]2362[]2363[]2364[]2365[]2366[]2367[]2368[]2369[]2370[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'ce8211762f9fb7bcd02357af6f8baff7df09b47d', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-04T07:43:40.026480Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]2371[{'id': 5, 'sha': 'ce8211762f9fb7bcd02357af6f8baff7df09b47d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:43:40.337Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2372[{'id': 5, 'sha': 'ce8211762f9fb7bcd02357af6f8baff7df09b47d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:43:40.337Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2373[{'id': 5, 'sha': 'ce8211762f9fb7bcd02357af6f8baff7df09b47d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:43:40.337Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2374[{'id': 5, 'sha': 'ce8211762f9fb7bcd02357af6f8baff7df09b47d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:43:40.337Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2375[{'id': 5, 'sha': 'ce8211762f9fb7bcd02357af6f8baff7df09b47d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:43:40.337Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2376[{'id': 5, 'sha': 'ce8211762f9fb7bcd02357af6f8baff7df09b47d', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-09-04T07:43:40.337Z', 'started_at': None, 'finished_at': '2026-09-04T07:43:45.588Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2377[{'id': 5, 'sha': 'ce8211762f9fb7bcd02357af6f8baff7df09b47d', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-09-04T07:43:40.337Z', 'started_at': None, 'finished_at': '2026-09-04T07:43:45.588Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'ce8211762f9fb7bcd02357af6f8baff7df09b47d', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-04T07:43:46.185Z', 'started_at': None, 'finished_at': '2026-09-04T07:43:46.297Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]