1this derivation will be built:2 /nix/store/mijas64707xi8sp7ym7j8lkzjg7zxpy6-vm-test-run-nixbot-gitlab.drv3building '/nix/store/mijas64707xi8sp7ym7j8lkzjg7zxpy6-vm-test-run-nixbot-gitlab.drv'4vm-test-run-nixbot-gitlab> tribuchet: building on jamie5vm-test-run-nixbot-gitlab> Machine state will be reset. To keep it, pass --keep-machine-state6vm-test-run-nixbot-gitlab> start all VLans7vm-test-run-nixbot-gitlab> (finished: start all VLans, in 0.00 seconds)8vm-test-run-nixbot-gitlab> Test will time out and terminate in 3600 seconds9vm-test-run-nixbot-gitlab> run the VM test script10vm-test-run-nixbot-gitlab> start all VMs11vm-test-run-nixbot-gitlab> gitlab: starting vm12vm-test-run-nixbot-gitlab> gitlab: QEMU running (pid 13)13vm-test-run-nixbot-gitlab> gitlab # Disk image does not exist, creating the virtualisation disk image...14vm-test-run-nixbot-gitlab> gitlab # Formatting '/build/vm-state-gitlab/tmp.Z2LlWOpUXK', fmt=raw size=107374182415vm-test-run-nixbot-gitlab> gitlab # mke2fs 1.47.3 (8-Jul-2025)16vm-test-run-nixbot-gitlab> (finished: start all VMs, in 53.71 seconds)17vm-test-run-nixbot-gitlab> gitlab # Discarding device blocks: 0/262144 done18vm-test-run-nixbot-gitlab> gitlab: waiting for unit setup-gitlab.service19vm-test-run-nixbot-gitlab> gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes20vm-test-run-nixbot-gitlab> gitlab: waiting for the VM to finish booting21vm-test-run-nixbot-gitlab> gitlab # Filesystem UUID: 4b88c64d-1795-465e-9189-f521a4da02ae22vm-test-run-nixbot-gitlab> gitlab # Superblock backups stored on blocks:23vm-test-run-nixbot-gitlab> gitlab # 32768, 98304, 163840, 22937624vm-test-run-nixbot-gitlab> gitlab # 25vm-test-run-nixbot-gitlab> gitlab # Allocating group tables: 0/8 done26vm-test-run-nixbot-gitlab> gitlab # Writing inode tables: 0/8 done27vm-test-run-nixbot-gitlab> gitlab # Creating journal (8192 blocks): done28vm-test-run-nixbot-gitlab> gitlab # Writing superblocks and filesystem accounting information: 0/8 done29vm-test-run-nixbot-gitlab> gitlab # 30vm-test-run-nixbot-gitlab> gitlab # Virtualisation disk image created.31vm-test-run-nixbot-gitlab> gitlab # Creating Nix store image...32vm-test-run-nixbot-gitlab> gitlab # Created Nix store image.33vm-test-run-nixbot-gitlab> gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)34vm-test-run-nixbot-gitlab> gitlab # 35vm-test-run-nixbot-gitlab> gitlab # 36vm-test-run-nixbot-gitlab> gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0037vm-test-run-nixbot-gitlab> gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...38vm-test-run-nixbot-gitlab> gitlab # 39vm-test-run-nixbot-gitlab> gitlab # 40vm-test-run-nixbot-gitlab> gitlab # 41vm-test-run-nixbot-gitlab> gitlab # 42vm-test-run-nixbot-gitlab> gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0043vm-test-run-nixbot-gitlab> gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...44vm-test-run-nixbot-gitlab> gitlab # 45vm-test-run-nixbot-gitlab> gitlab # 46vm-test-run-nixbot-gitlab> gitlab # Booting from ROM...47vm-test-run-nixbot-gitlab> gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Jun 1 15:51:08 UTC 202648vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cpf0kazf2kcxx4g1ba4j13nxf3662fk5-nixos-system-gitlab-test/init regInfo=/nix/store/hjcs8ya8cdvv17b7p69j81qxlwy582dq-closure-info/registration console=ttyS0,115200n8 console=tty049vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-provided physical RAM map:50vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable51vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved52vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved53vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable54vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved55vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved56vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved57vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable58vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved59vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] NX (Execute Disable) protection: active60vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] APIC: Static calls initialized61vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] SMBIOS 2.8 present.62vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201463vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] DMI: Memory slots populated: 1/164vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Hypervisor detected: KVM65vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000066vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0067vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] kvm-clock: using sched offset of 517397835 cycles68vm-test-run-nixbot-gitlab> gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns69vm-test-run-nixbot-gitlab> gitlab # [ 0.000005] tsc: Detected 2400.006 MHz processor70vm-test-run-nixbot-gitlab> gitlab # [ 0.000804] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000071vm-test-run-nixbot-gitlab> gitlab # [ 0.000830] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs72vm-test-run-nixbot-gitlab> gitlab # [ 0.000833] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT73vm-test-run-nixbot-gitlab> gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000074vm-test-run-nixbot-gitlab> gitlab # [ 0.002732] found SMP MP-table at [mem 0x000f5470-0x000f547f]75vm-test-run-nixbot-gitlab> gitlab # [ 0.002742] Using GB pages for direct mapping76vm-test-run-nixbot-gitlab> gitlab # [ 0.002816] RAMDISK: [mem 0xbe4e0000-0xbffcffff]77vm-test-run-nixbot-gitlab> gitlab # [ 0.002824] ACPI: Early table checksum verification disabled78vm-test-run-nixbot-gitlab> gitlab # [ 0.002827] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )79vm-test-run-nixbot-gitlab> gitlab # [ 0.002830] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)80vm-test-run-nixbot-gitlab> gitlab # [ 0.002835] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)81vm-test-run-nixbot-gitlab> gitlab # [ 0.002841] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)82vm-test-run-nixbot-gitlab> gitlab # [ 0.002847] ACPI: FACS 0x00000000BFFE0000 00004083vm-test-run-nixbot-gitlab> gitlab # [ 0.002849] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)84vm-test-run-nixbot-gitlab> gitlab # [ 0.002850] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)85vm-test-run-nixbot-gitlab> gitlab # [ 0.002852] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)86vm-test-run-nixbot-gitlab> gitlab # [ 0.002853] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]87vm-test-run-nixbot-gitlab> gitlab # [ 0.002854] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]88vm-test-run-nixbot-gitlab> gitlab # [ 0.002855] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]89vm-test-run-nixbot-gitlab> gitlab # [ 0.002855] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]90vm-test-run-nixbot-gitlab> gitlab # [ 0.002856] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]91vm-test-run-nixbot-gitlab> gitlab # [ 0.002856] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]92vm-test-run-nixbot-gitlab> gitlab # [ 0.003067] No NUMA configuration found93vm-test-run-nixbot-gitlab> gitlab # [ 0.003068] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]94vm-test-run-nixbot-gitlab> gitlab # [ 0.003070] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]95vm-test-run-nixbot-gitlab> gitlab # [ 0.005403] Zone ranges:96vm-test-run-nixbot-gitlab> gitlab # [ 0.005404] DMA [mem 0x0000000000001000-0x0000000000ffffff]97vm-test-run-nixbot-gitlab> gitlab # [ 0.005405] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]98vm-test-run-nixbot-gitlab> gitlab # [ 0.005406] Normal [mem 0x0000000100000000-0x00000001bfffffff]99vm-test-run-nixbot-gitlab> gitlab # [ 0.005407] Device empty100vm-test-run-nixbot-gitlab> gitlab # [ 0.005408] Movable zone start for each node101vm-test-run-nixbot-gitlab> gitlab # [ 0.005409] Early memory node ranges102vm-test-run-nixbot-gitlab> gitlab # [ 0.005409] node 0: [mem 0x0000000000001000-0x000000000009efff]103vm-test-run-nixbot-gitlab> gitlab # [ 0.005410] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]104vm-test-run-nixbot-gitlab> gitlab # [ 0.005411] node 0: [mem 0x0000000100000000-0x00000001bfffffff]105vm-test-run-nixbot-gitlab> gitlab # [ 0.005412] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]106vm-test-run-nixbot-gitlab> gitlab # [ 0.005432] On node 0, zone DMA: 1 pages in unavailable ranges107vm-test-run-nixbot-gitlab> gitlab # [ 0.005703] On node 0, zone DMA: 97 pages in unavailable ranges108vm-test-run-nixbot-gitlab> gitlab # [ 0.117291] On node 0, zone Normal: 40 pages in unavailable ranges109vm-test-run-nixbot-gitlab> gitlab # [ 0.117713] ACPI: PM-Timer IO Port: 0x608110vm-test-run-nixbot-gitlab> gitlab # [ 0.117728] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])111vm-test-run-nixbot-gitlab> gitlab # [ 0.117759] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23112vm-test-run-nixbot-gitlab> gitlab # [ 0.117762] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)113vm-test-run-nixbot-gitlab> gitlab # [ 0.117763] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)114vm-test-run-nixbot-gitlab> gitlab # [ 0.117765] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)115vm-test-run-nixbot-gitlab> gitlab # [ 0.117766] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)116vm-test-run-nixbot-gitlab> gitlab # [ 0.117766] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)117vm-test-run-nixbot-gitlab> gitlab # [ 0.117769] ACPI: Using ACPI (MADT) for SMP configuration information118vm-test-run-nixbot-gitlab> gitlab # [ 0.117770] ACPI: HPET id: 0x8086a201 base: 0xfed00000119vm-test-run-nixbot-gitlab> gitlab # [ 0.117775] TSC deadline timer available120vm-test-run-nixbot-gitlab> gitlab # [ 0.117779] CPU topo: Max. logical packages: 1121vm-test-run-nixbot-gitlab> gitlab # [ 0.117780] CPU topo: Max. logical dies: 1122vm-test-run-nixbot-gitlab> gitlab # [ 0.117780] CPU topo: Max. dies per package: 1123vm-test-run-nixbot-gitlab> gitlab # [ 0.117784] CPU topo: Max. threads per core: 1124vm-test-run-nixbot-gitlab> gitlab # [ 0.117784] CPU topo: Num. cores per package: 4125vm-test-run-nixbot-gitlab> gitlab # [ 0.117785] CPU topo: Num. threads per package: 4126vm-test-run-nixbot-gitlab> gitlab # [ 0.117785] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs127vm-test-run-nixbot-gitlab> gitlab # [ 0.117809] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()128vm-test-run-nixbot-gitlab> gitlab # [ 0.117826] kvm-guest: KVM setup pv remote TLB flush129vm-test-run-nixbot-gitlab> gitlab # [ 0.117829] kvm-guest: setup PV sched yield130vm-test-run-nixbot-gitlab> gitlab # [ 0.117850] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]131vm-test-run-nixbot-gitlab> gitlab # [ 0.117852] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]132vm-test-run-nixbot-gitlab> gitlab # [ 0.117853] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]133vm-test-run-nixbot-gitlab> gitlab # [ 0.117854] [mem 0xc0000000-0xfeffbfff] available for PCI devices134vm-test-run-nixbot-gitlab> gitlab # [ 0.117856] Booting paravirtualized kernel on KVM135vm-test-run-nixbot-gitlab> gitlab # [ 0.117859] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns136vm-test-run-nixbot-gitlab> gitlab # [ 0.122374] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1137vm-test-run-nixbot-gitlab> gitlab # [ 0.124692] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288138vm-test-run-nixbot-gitlab> gitlab # [ 0.124741] kvm-guest: PV spinlocks enabled139vm-test-run-nixbot-gitlab> gitlab # [ 0.124743] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)140vm-test-run-nixbot-gitlab> gitlab # [ 0.124745] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cpf0kazf2kcxx4g1ba4j13nxf3662fk5-nixos-system-gitlab-test/init regInfo=/nix/store/hjcs8ya8cdvv17b7p69j81qxlwy582dq-closure-info/registration console=ttyS0,115200n8 console=tty0141vm-test-run-nixbot-gitlab> gitlab # [ 0.124855] Unknown kernel command line parameters "regInfo=/nix/store/hjcs8ya8cdvv17b7p69j81qxlwy582dq-closure-info/registration", will be passed to user space.142vm-test-run-nixbot-gitlab> gitlab # [ 0.124868] random: crng init done143vm-test-run-nixbot-gitlab> gitlab # [ 0.124869] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes144vm-test-run-nixbot-gitlab> gitlab # [ 0.134029] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)145vm-test-run-nixbot-gitlab> gitlab # [ 0.138411] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)146vm-test-run-nixbot-gitlab> gitlab # [ 0.138488] software IO TLB: area num 4.147vm-test-run-nixbot-gitlab> gitlab # [ 0.215555] Fallback order for Node 0: 0148vm-test-run-nixbot-gitlab> gitlab # [ 0.215563] Built 1 zonelists, mobility grouping on. Total pages: 1572726149vm-test-run-nixbot-gitlab> gitlab # [ 0.215566] Policy zone: Normal150vm-test-run-nixbot-gitlab> gitlab # [ 0.218116] mem auto-init: stack:all(zero), heap alloc:on, heap free:off151vm-test-run-nixbot-gitlab> gitlab # [ 0.228126] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1152vm-test-run-nixbot-gitlab> gitlab # [ 0.241970] allocated 12582912 bytes of page_ext153vm-test-run-nixbot-gitlab> gitlab # [ 0.251966] ftrace: allocating 48565 entries in 192 pages154vm-test-run-nixbot-gitlab> gitlab # [ 0.251967] ftrace: allocated 192 pages with 2 groups155vm-test-run-nixbot-gitlab> gitlab # [ 0.252814] Dynamic Preempt: lazy156vm-test-run-nixbot-gitlab> gitlab # [ 0.252996] rcu: Preemptible hierarchical RCU implementation.157vm-test-run-nixbot-gitlab> gitlab # [ 0.252997] rcu: RCU event tracing is enabled.158vm-test-run-nixbot-gitlab> gitlab # [ 0.252998] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.159vm-test-run-nixbot-gitlab> gitlab # [ 0.252999] Trampoline variant of Tasks RCU enabled.160vm-test-run-nixbot-gitlab> gitlab # [ 0.252999] Rude variant of Tasks RCU enabled.161vm-test-run-nixbot-gitlab> gitlab # [ 0.253000] Tracing variant of Tasks RCU enabled.162vm-test-run-nixbot-gitlab> gitlab # [ 0.253001] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.163vm-test-run-nixbot-gitlab> gitlab # [ 0.253001] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4164vm-test-run-nixbot-gitlab> gitlab # [ 0.253027] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.165vm-test-run-nixbot-gitlab> gitlab # [ 0.253028] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.166vm-test-run-nixbot-gitlab> gitlab # [ 0.253029] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.167vm-test-run-nixbot-gitlab> gitlab # [ 0.257376] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16168vm-test-run-nixbot-gitlab> gitlab # [ 0.257713] rcu: srcu_init: Setting srcu_struct sizes based on contention.169vm-test-run-nixbot-gitlab> gitlab # [ 0.257833] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)170vm-test-run-nixbot-gitlab> gitlab # [ 0.261339] Console: colour VGA+ 80x25171vm-test-run-nixbot-gitlab> gitlab # [ 0.261342] printk: legacy console [tty0] enabled172vm-test-run-nixbot-gitlab> gitlab # [ 0.291740] printk: legacy console [ttyS0] enabled173vm-test-run-nixbot-gitlab> gitlab # [ 0.388236] ACPI: Core revision 20250807174vm-test-run-nixbot-gitlab> gitlab # [ 0.389095] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns175vm-test-run-nixbot-gitlab> gitlab # [ 0.390620] APIC: Switch to symmetric I/O mode setup176vm-test-run-nixbot-gitlab> gitlab # [ 0.391582] x2apic enabled177vm-test-run-nixbot-gitlab> gitlab # [ 0.392350] APIC: Switched APIC routing to: physical x2apic178vm-test-run-nixbot-gitlab> gitlab # [ 0.393199] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()179vm-test-run-nixbot-gitlab> gitlab # [ 0.394324] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()180vm-test-run-nixbot-gitlab> gitlab # [ 0.395774] kvm-guest: setup PV IPIs181vm-test-run-nixbot-gitlab> gitlab # [ 0.397294] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1182vm-test-run-nixbot-gitlab> gitlab # [ 0.398276] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983d4fda2, max_idle_ns: 440795302975 ns183vm-test-run-nixbot-gitlab> gitlab # [ 0.399930] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400006)184vm-test-run-nixbot-gitlab> gitlab # [ 0.401013] x86/cpu: User Mode Instruction Prevention (UMIP) activated185vm-test-run-nixbot-gitlab> gitlab # [ 0.402051] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127186vm-test-run-nixbot-gitlab> gitlab # [ 0.403612] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0187vm-test-run-nixbot-gitlab> gitlab # [ 0.404695] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto188vm-test-run-nixbot-gitlab> gitlab # [ 0.405927] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl189vm-test-run-nixbot-gitlab> gitlab # [ 0.407928] Transient Scheduler Attacks: Vulnerable: No microcode190vm-test-run-nixbot-gitlab> gitlab # [ 0.408927] Spectre V2 : Mitigation: Enhanced / Automatic IBRS191vm-test-run-nixbot-gitlab> gitlab # [ 0.409927] Speculative Return Stack Overflow: Mitigation: Safe RET192vm-test-run-nixbot-gitlab> gitlab # [ 0.410927] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization193vm-test-run-nixbot-gitlab> gitlab # [ 0.411932] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier194vm-test-run-nixbot-gitlab> gitlab # [ 0.412928] active return thunk: srso_alias_return_thunk195vm-test-run-nixbot-gitlab> gitlab # [ 0.413783] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'196vm-test-run-nixbot-gitlab> gitlab # [ 0.414928] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'197vm-test-run-nixbot-gitlab> gitlab # [ 0.415927] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'198vm-test-run-nixbot-gitlab> gitlab # [ 0.416927] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'199vm-test-run-nixbot-gitlab> gitlab # [ 0.417927] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'200vm-test-run-nixbot-gitlab> gitlab # [ 0.418927] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'201vm-test-run-nixbot-gitlab> gitlab # [ 0.419927] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'202vm-test-run-nixbot-gitlab> gitlab # [ 0.420928] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256203vm-test-run-nixbot-gitlab> gitlab # [ 0.421927] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64204vm-test-run-nixbot-gitlab> gitlab # [ 0.422927] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512205vm-test-run-nixbot-gitlab> gitlab # [ 0.423927] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024206vm-test-run-nixbot-gitlab> gitlab # [ 0.424927] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8207vm-test-run-nixbot-gitlab> gitlab # [ 0.425927] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.208vm-test-run-nixbot-gitlab> gitlab # [ 0.455624] Freeing SMP alternatives memory: 44K209vm-test-run-nixbot-gitlab> gitlab # [ 0.455931] pid_max: default: 32768 minimum: 301210vm-test-run-nixbot-gitlab> gitlab # [ 0.457021] LSM: initializing lsm=capability,landlock,yama,bpf,ima211vm-test-run-nixbot-gitlab> gitlab # [ 0.458033] landlock: Up and running.212vm-test-run-nixbot-gitlab> gitlab # [ 0.458928] Yama: becoming mindful.213vm-test-run-nixbot-gitlab> gitlab # [ 0.459723] LSM support for eBPF active214vm-test-run-nixbot-gitlab> gitlab # [ 0.460621] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215vm-test-run-nixbot-gitlab> gitlab # [ 0.462075] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)216vm-test-run-nixbot-gitlab> gitlab # [ 0.464569] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)217vm-test-run-nixbot-gitlab> gitlab # [ 0.465919] Performance Events: Fam17h+ core perfctr, AMD PMU driver.218vm-test-run-nixbot-gitlab> gitlab # [ 0.466931] ... version: 2219vm-test-run-nixbot-gitlab> gitlab # [ 0.467623] ... bit width: 48220vm-test-run-nixbot-gitlab> gitlab # [ 0.467984] ... generic counters: 6221vm-test-run-nixbot-gitlab> gitlab # [ 0.468706] ... generic bitmap: 000000000000003f222vm-test-run-nixbot-gitlab> gitlab # [ 0.468930] ... fixed-purpose counters: 0223vm-test-run-nixbot-gitlab> gitlab # [ 0.469615] ... fixed-purpose bitmap: 0000000000000000224vm-test-run-nixbot-gitlab> gitlab # [ 0.469929] ... value mask: 0000ffffffffffff225vm-test-run-nixbot-gitlab> gitlab # [ 0.470795] ... max period: 00007fffffffffff226vm-test-run-nixbot-gitlab> gitlab # [ 0.471618] ... global_ctrl mask: 000000000000003f227vm-test-run-nixbot-gitlab> gitlab # [ 0.472045] signal: max sigframe size: 3376228vm-test-run-nixbot-gitlab> gitlab # [ 0.472822] rcu: Hierarchical SRCU implementation.229vm-test-run-nixbot-gitlab> gitlab # [ 0.473526] rcu: Max phase no-delay instances is 400.230vm-test-run-nixbot-gitlab> gitlab # [ 0.474112] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level231vm-test-run-nixbot-gitlab> gitlab # [ 0.479322] smp: Bringing up secondary CPUs ...232vm-test-run-nixbot-gitlab> gitlab # [ 0.480368] smpboot: x86: Booting SMP configuration:233vm-test-run-nixbot-gitlab> gitlab # [ 0.480938] .... node #0, CPUs: #1 #2 #3234vm-test-run-nixbot-gitlab> gitlab # [ 0.483068] smp: Brought up 1 node, 4 CPUs235vm-test-run-nixbot-gitlab> gitlab # [ 0.484930] smpboot: Total of 4 processors activated (19200.04 BogoMIPS)236vm-test-run-nixbot-gitlab> gitlab # [ 0.486308] Memory: 6013364K/6290904K available (17098K kernel code, 2721K rwdata, 13520K rodata, 3644K init, 3008K bss, 258300K reserved, 0K cma-reserved)237vm-test-run-nixbot-gitlab> gitlab # [ 0.487309] devtmpfs: initialized238vm-test-run-nixbot-gitlab> gitlab # [ 0.488169] x86/mm: Memory block size: 128MB239vm-test-run-nixbot-gitlab> gitlab # [ 0.491105] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns240vm-test-run-nixbot-gitlab> gitlab # [ 0.491976] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)241vm-test-run-nixbot-gitlab> gitlab # [ 0.493013] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).242vm-test-run-nixbot-gitlab> gitlab # [ 0.494017] pinctrl core: initialized pinctrl subsystem243vm-test-run-nixbot-gitlab> gitlab # [ 0.495140] PM: RTC time: 07:13:42, date: 2026-07-25244vm-test-run-nixbot-gitlab> gitlab # [ 0.498985] NET: Registered PF_NETLINK/PF_ROUTE protocol family245vm-test-run-nixbot-gitlab> gitlab # [ 0.501277] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations246vm-test-run-nixbot-gitlab> gitlab # [ 0.501986] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations247vm-test-run-nixbot-gitlab> gitlab # [ 0.504052] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations248vm-test-run-nixbot-gitlab> gitlab # [ 0.504941] audit: initializing netlink subsys (disabled)249vm-test-run-nixbot-gitlab> gitlab # [ 0.505991] audit: type=2000 audit(1784963622.324:1): state=initialized audit_enabled=0 res=1250vm-test-run-nixbot-gitlab> gitlab # [ 0.506204] thermal_sys: Registered thermal governor 'fair_share'251vm-test-run-nixbot-gitlab> gitlab # [ 0.507930] thermal_sys: Registered thermal governor 'bang_bang'252vm-test-run-nixbot-gitlab> gitlab # [ 0.508889] thermal_sys: Registered thermal governor 'step_wise'253vm-test-run-nixbot-gitlab> gitlab # [ 0.509931] thermal_sys: Registered thermal governor 'user_space'254vm-test-run-nixbot-gitlab> gitlab # [ 0.510911] thermal_sys: Registered thermal governor 'power_allocator'255vm-test-run-nixbot-gitlab> gitlab # [ 0.511692] cpuidle: using governor menu256vm-test-run-nixbot-gitlab> gitlab # [ 0.513340] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5257vm-test-run-nixbot-gitlab> gitlab # [ 0.514209] PCI: Using configuration type 1 for base access258vm-test-run-nixbot-gitlab> gitlab # [ 0.514931] PCI: Using configuration type 1 for extended access259vm-test-run-nixbot-gitlab> gitlab # [ 0.516035] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.260vm-test-run-nixbot-gitlab> gitlab # [ 0.518201] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages261vm-test-run-nixbot-gitlab> gitlab # [ 0.519755] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page262vm-test-run-nixbot-gitlab> gitlab # [ 0.520727] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages263vm-test-run-nixbot-gitlab> gitlab # [ 0.521756] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page264vm-test-run-nixbot-gitlab> gitlab # [ 0.524818] ACPI: Added _OSI(Module Device)265vm-test-run-nixbot-gitlab> gitlab # [ 0.525932] ACPI: Added _OSI(Processor Device)266vm-test-run-nixbot-gitlab> gitlab # [ 0.526691] ACPI: Added _OSI(Processor Aggregator Device)267vm-test-run-nixbot-gitlab> gitlab # [ 0.528901] ACPI: 1 ACPI AML tables successfully acquired and loaded268vm-test-run-nixbot-gitlab> gitlab # [ 0.533960] ACPI: Interpreter enabled269vm-test-run-nixbot-gitlab> gitlab # [ 0.534611] ACPI: PM: (supports S0 S3 S4 S5)270vm-test-run-nixbot-gitlab> gitlab # [ 0.534931] ACPI: Using IOAPIC for interrupt routing271vm-test-run-nixbot-gitlab> gitlab # [ 0.535752] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug272vm-test-run-nixbot-gitlab> gitlab # [ 0.536937] PCI: Using E820 reservations for host bridge windows273vm-test-run-nixbot-gitlab> gitlab # [ 0.537891] ACPI: Enabled 2 GPEs in block 00 to 0F274vm-test-run-nixbot-gitlab> gitlab # [ 0.547865] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])275vm-test-run-nixbot-gitlab> gitlab # [ 0.549946] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]276vm-test-run-nixbot-gitlab> gitlab # [ 0.553833] acpiphp: Slot [3] registered277vm-test-run-nixbot-gitlab> gitlab # [ 0.556017] acpiphp: Slot [4] registered278vm-test-run-nixbot-gitlab> gitlab # [ 0.558002] acpiphp: Slot [5] registered279vm-test-run-nixbot-gitlab> gitlab # [ 0.558984] acpiphp: Slot [6] registered280vm-test-run-nixbot-gitlab> gitlab # [ 0.559980] acpiphp: Slot [7] registered281vm-test-run-nixbot-gitlab> gitlab # [ 0.561998] acpiphp: Slot [8] registered282vm-test-run-nixbot-gitlab> gitlab # [ 0.562984] acpiphp: Slot [9] registered283vm-test-run-nixbot-gitlab> gitlab # [ 0.563983] acpiphp: Slot [10] registered284vm-test-run-nixbot-gitlab> gitlab # [ 0.565982] acpiphp: Slot [11] registered285vm-test-run-nixbot-gitlab> gitlab # [ 0.567001] acpiphp: Slot [12] registered286vm-test-run-nixbot-gitlab> gitlab # [ 0.568011] acpiphp: Slot [13] registered287vm-test-run-nixbot-gitlab> gitlab # [ 0.569973] acpiphp: Slot [14] registered288vm-test-run-nixbot-gitlab> gitlab # [ 0.570993] acpiphp: Slot [15] registered289vm-test-run-nixbot-gitlab> gitlab # [ 0.572972] acpiphp: Slot [16] registered290vm-test-run-nixbot-gitlab> gitlab # [ 0.573971] acpiphp: Slot [17] registered291vm-test-run-nixbot-gitlab> gitlab # [ 0.574971] acpiphp: Slot [18] registered292vm-test-run-nixbot-gitlab> gitlab # [ 0.576001] acpiphp: Slot [19] registered293vm-test-run-nixbot-gitlab> gitlab # [ 0.576702] acpiphp: Slot [20] registered294vm-test-run-nixbot-gitlab> gitlab # [ 0.577950] acpiphp: Slot [21] registered295vm-test-run-nixbot-gitlab> gitlab # [ 0.578663] acpiphp: Slot [22] registered296vm-test-run-nixbot-gitlab> gitlab # [ 0.578960] acpiphp: Slot [23] registered297vm-test-run-nixbot-gitlab> gitlab # [ 0.579666] acpiphp: Slot [24] registered298vm-test-run-nixbot-gitlab> gitlab # [ 0.580950] acpiphp: Slot [25] registered299vm-test-run-nixbot-gitlab> gitlab # [ 0.581644] acpiphp: Slot [26] registered300vm-test-run-nixbot-gitlab> gitlab # [ 0.581958] acpiphp: Slot [27] registered301vm-test-run-nixbot-gitlab> gitlab # [ 0.582692] acpiphp: Slot [28] registered302vm-test-run-nixbot-gitlab> gitlab # [ 0.583951] acpiphp: Slot [29] registered303vm-test-run-nixbot-gitlab> gitlab # [ 0.584641] acpiphp: Slot [30] registered304vm-test-run-nixbot-gitlab> gitlab # [ 0.584949] acpiphp: Slot [31] registered305vm-test-run-nixbot-gitlab> gitlab # [ 0.585701] PCI host bridge to bus 0000:00306vm-test-run-nixbot-gitlab> gitlab # [ 0.585936] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]307vm-test-run-nixbot-gitlab> gitlab # [ 0.586930] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]308vm-test-run-nixbot-gitlab> gitlab # [ 0.587930] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]309vm-test-run-nixbot-gitlab> gitlab # [ 0.589930] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]310vm-test-run-nixbot-gitlab> gitlab # [ 0.590930] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]311vm-test-run-nixbot-gitlab> gitlab # [ 0.591931] pci_bus 0000:00: root bus resource [bus 00-ff]312vm-test-run-nixbot-gitlab> gitlab # [ 0.592967] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint313vm-test-run-nixbot-gitlab> gitlab # [ 0.594403] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint314vm-test-run-nixbot-gitlab> gitlab # [ 0.596352] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint315vm-test-run-nixbot-gitlab> gitlab # [ 0.599715] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]316vm-test-run-nixbot-gitlab> gitlab # [ 0.600601] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk317vm-test-run-nixbot-gitlab> gitlab # [ 0.601931] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk318vm-test-run-nixbot-gitlab> gitlab # [ 0.602940] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk319vm-test-run-nixbot-gitlab> gitlab # [ 0.603934] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk320vm-test-run-nixbot-gitlab> gitlab # [ 0.605433] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint321vm-test-run-nixbot-gitlab> gitlab # [ 0.609397] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]322vm-test-run-nixbot-gitlab> gitlab # [ 0.612082] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint323vm-test-run-nixbot-gitlab> gitlab # [ 0.614193] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI324vm-test-run-nixbot-gitlab> gitlab # [ 0.614936] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB325vm-test-run-nixbot-gitlab> gitlab # [ 0.616148] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint326vm-test-run-nixbot-gitlab> gitlab # [ 0.632015] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]327vm-test-run-nixbot-gitlab> gitlab # [ 0.632941] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]328vm-test-run-nixbot-gitlab> gitlab # [ 0.633918] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]329vm-test-run-nixbot-gitlab> gitlab # [ 0.634873] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]330vm-test-run-nixbot-gitlab> gitlab # [ 0.637689] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint331vm-test-run-nixbot-gitlab> gitlab # [ 0.641938] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]332vm-test-run-nixbot-gitlab> gitlab # [ 0.643937] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]333vm-test-run-nixbot-gitlab> gitlab # [ 0.644906] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]334vm-test-run-nixbot-gitlab> gitlab # [ 0.656896] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]335vm-test-run-nixbot-gitlab> gitlab # [ 0.659153] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint336vm-test-run-nixbot-gitlab> gitlab # [ 0.663961] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]337vm-test-run-nixbot-gitlab> gitlab # [ 0.664833] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]338vm-test-run-nixbot-gitlab> gitlab # [ 0.665696] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]339vm-test-run-nixbot-gitlab> gitlab # [ 0.668079] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint340vm-test-run-nixbot-gitlab> gitlab # [ 0.673961] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]341vm-test-run-nixbot-gitlab> gitlab # [ 0.674865] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]342vm-test-run-nixbot-gitlab> gitlab # [ 0.675657] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]343vm-test-run-nixbot-gitlab> gitlab # [ 0.678771] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint344vm-test-run-nixbot-gitlab> gitlab # [ 0.683939] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]345vm-test-run-nixbot-gitlab> gitlab # [ 0.685599] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]346vm-test-run-nixbot-gitlab> gitlab # [ 0.686976] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]347vm-test-run-nixbot-gitlab> gitlab # [ 0.692647] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint348vm-test-run-nixbot-gitlab> gitlab # [ 0.702045] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]349vm-test-run-nixbot-gitlab> gitlab # [ 0.703961] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]350vm-test-run-nixbot-gitlab> gitlab # [ 0.704976] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]351vm-test-run-nixbot-gitlab> gitlab # [ 0.710909] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint352vm-test-run-nixbot-gitlab> gitlab # [ 0.714964] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]353vm-test-run-nixbot-gitlab> gitlab # [ 0.715819] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]354vm-test-run-nixbot-gitlab> gitlab # [ 0.716674] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]355vm-test-run-nixbot-gitlab> gitlab # [ 0.720203] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint356vm-test-run-nixbot-gitlab> gitlab # [ 0.722955] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]357vm-test-run-nixbot-gitlab> gitlab # [ 0.723807] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]358vm-test-run-nixbot-gitlab> gitlab # [ 0.724646] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]359vm-test-run-nixbot-gitlab> gitlab # [ 0.725819] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]360vm-test-run-nixbot-gitlab> gitlab # [ 0.727885] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint361vm-test-run-nixbot-gitlab> gitlab # [ 0.730951] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]362vm-test-run-nixbot-gitlab> gitlab # [ 0.731908] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]363vm-test-run-nixbot-gitlab> gitlab # [ 0.734031] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint364vm-test-run-nixbot-gitlab> gitlab # [ 0.740206] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]365vm-test-run-nixbot-gitlab> gitlab # [ 0.741653] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]366vm-test-run-nixbot-gitlab> gitlab # [ 0.741952] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]367vm-test-run-nixbot-gitlab> gitlab # [ 0.744453] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint368vm-test-run-nixbot-gitlab> gitlab # [ 0.748961] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]369vm-test-run-nixbot-gitlab> gitlab # [ 0.749838] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]370vm-test-run-nixbot-gitlab> gitlab # [ 0.751952] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]371vm-test-run-nixbot-gitlab> gitlab # [ 0.756535] ACPI: PCI: Interrupt link LNKA configured for IRQ 10372vm-test-run-nixbot-gitlab> gitlab # [ 0.757076] ACPI: PCI: Interrupt link LNKB configured for IRQ 10373vm-test-run-nixbot-gitlab> gitlab # [ 0.758061] ACPI: PCI: Interrupt link LNKC configured for IRQ 11374vm-test-run-nixbot-gitlab> gitlab # [ 0.759055] ACPI: PCI: Interrupt link LNKD configured for IRQ 11375vm-test-run-nixbot-gitlab> gitlab # [ 0.761006] ACPI: PCI: Interrupt link LNKS configured for IRQ 9376vm-test-run-nixbot-gitlab> gitlab # [ 0.763258] iommu: Default domain type: Translated377vm-test-run-nixbot-gitlab> gitlab # [ 0.763932] iommu: DMA domain TLB invalidation policy: lazy mode378vm-test-run-nixbot-gitlab> gitlab # [ 0.765147] ACPI: bus type USB registered379vm-test-run-nixbot-gitlab> gitlab # [ 0.766003] usbcore: registered new interface driver usbfs380vm-test-run-nixbot-gitlab> gitlab # [ 0.766916] usbcore: registered new interface driver hub381vm-test-run-nixbot-gitlab> gitlab # [ 0.767623] usbcore: registered new device driver usb382vm-test-run-nixbot-gitlab> gitlab # [ 0.770237] NetLabel: Initializing383vm-test-run-nixbot-gitlab> gitlab # [ 0.770844] NetLabel: domain hash size = 128384vm-test-run-nixbot-gitlab> gitlab # [ 0.771471] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO385vm-test-run-nixbot-gitlab> gitlab # [ 0.772970] NetLabel: unlabeled traffic allowed by default386vm-test-run-nixbot-gitlab> gitlab # [ 0.773867] PCI: Using ACPI for IRQ routing387vm-test-run-nixbot-gitlab> gitlab # [ 0.775106] pci 0000:00:02.0: vgaarb: setting as boot VGA device388vm-test-run-nixbot-gitlab> gitlab # [ 0.775908] pci 0000:00:02.0: vgaarb: bridge control possible389vm-test-run-nixbot-gitlab> gitlab # [ 0.775926] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none390vm-test-run-nixbot-gitlab> gitlab # [ 0.777932] vgaarb: loaded391vm-test-run-nixbot-gitlab> gitlab # [ 0.778686] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0392vm-test-run-nixbot-gitlab> gitlab # [ 0.779930] hpet0: 3 comparators, 64-bit 100.000000 MHz counter393vm-test-run-nixbot-gitlab> gitlab # [ 0.785051] clocksource: Switched to clocksource kvm-clock394vm-test-run-nixbot-gitlab> gitlab # [ 0.786596] VFS: Disk quotas dquot_6.6.0395vm-test-run-nixbot-gitlab> gitlab # [ 0.787285] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)396vm-test-run-nixbot-gitlab> gitlab # [ 0.788694] pnp: PnP ACPI init397vm-test-run-nixbot-gitlab> gitlab # [ 0.789778] pnp: PnP ACPI: found 6 devices398vm-test-run-nixbot-gitlab> gitlab # [ 0.798587] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns399vm-test-run-nixbot-gitlab> gitlab # [ 0.802175] clocksource: Switched to clocksource acpi_pm400vm-test-run-nixbot-gitlab> gitlab # [ 0.804864] NET: Registered PF_INET protocol family401vm-test-run-nixbot-gitlab> gitlab # [ 0.809853] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)402vm-test-run-nixbot-gitlab> gitlab # [ 0.838260] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)403vm-test-run-nixbot-gitlab> gitlab # [ 0.839742] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)404vm-test-run-nixbot-gitlab> gitlab # [ 0.841040] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)405vm-test-run-nixbot-gitlab> gitlab # [ 0.844936] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)406vm-test-run-nixbot-gitlab> gitlab # [ 0.846254] TCP: Hash tables configured (established 65536 bind 65536)407vm-test-run-nixbot-gitlab> gitlab # [ 0.847392] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)408vm-test-run-nixbot-gitlab> gitlab # [ 0.848970] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)409vm-test-run-nixbot-gitlab> gitlab # [ 0.850356] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)410vm-test-run-nixbot-gitlab> gitlab # [ 0.851650] NET: Registered PF_UNIX/PF_LOCAL protocol family411vm-test-run-nixbot-gitlab> gitlab # [ 0.852612] NET: Registered PF_XDP protocol family412vm-test-run-nixbot-gitlab> gitlab # [ 0.853423] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]413vm-test-run-nixbot-gitlab> gitlab # [ 0.854385] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]414vm-test-run-nixbot-gitlab> gitlab # [ 0.855371] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]415vm-test-run-nixbot-gitlab> gitlab # [ 0.856452] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]416vm-test-run-nixbot-gitlab> gitlab # [ 0.857530] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]417vm-test-run-nixbot-gitlab> gitlab # [ 0.858833] pci 0000:00:01.0: PIIX3: Enabling Passive Release418vm-test-run-nixbot-gitlab> gitlab # [ 0.859778] pci 0000:00:00.0: Limiting direct PCI/PCI transfers419vm-test-run-nixbot-gitlab> gitlab # [ 0.862194] ACPI: \_SB_.LNKD: Enabled at IRQ 11420vm-test-run-nixbot-gitlab> gitlab # [ 0.864748] PCI: CLS 0 bytes, default 64421vm-test-run-nixbot-gitlab> gitlab # [ 0.865497] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)422vm-test-run-nixbot-gitlab> gitlab # [ 0.865788] Trying to unpack rootfs image as initramfs...423vm-test-run-nixbot-gitlab> gitlab # [ 0.866500] software IO TLB: mapped [mem 0x00000000ba4e0000-0x00000000be4e0000] (64MB)424vm-test-run-nixbot-gitlab> gitlab # [ 0.866621] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983d4fda2, max_idle_ns: 440795302975 ns425vm-test-run-nixbot-gitlab> gitlab # [ 0.889146] Initialise system trusted keyrings426vm-test-run-nixbot-gitlab> gitlab # [ 0.890362] workingset: timestamp_bits=40 max_order=21 bucket_order=0427vm-test-run-nixbot-gitlab> gitlab # [ 0.901800] Key type asymmetric registered428vm-test-run-nixbot-gitlab> gitlab # [ 0.902508] Asymmetric key parser 'x509' registered429vm-test-run-nixbot-gitlab> gitlab # [ 0.903354] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)430vm-test-run-nixbot-gitlab> gitlab # [ 0.905059] io scheduler mq-deadline registered431vm-test-run-nixbot-gitlab> gitlab # [ 0.905840] io scheduler kyber registered432vm-test-run-nixbot-gitlab> gitlab # [ 0.909663] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled433vm-test-run-nixbot-gitlab> gitlab # [ 0.910990] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A434vm-test-run-nixbot-gitlab> gitlab # [ 0.913361] Linux agpgart interface v0.103435vm-test-run-nixbot-gitlab> gitlab # [ 0.914102] ACPI: bus type drm_connector registered436vm-test-run-nixbot-gitlab> gitlab # [ 0.916620] usbcore: registered new interface driver usbserial_generic437vm-test-run-nixbot-gitlab> gitlab # [ 0.917695] usbserial: USB Serial support registered for generic438vm-test-run-nixbot-gitlab> gitlab # [ 0.918665] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.439vm-test-run-nixbot-gitlab> gitlab # [ 0.918665] Please enable it if your BIOS has the CPPC option.440vm-test-run-nixbot-gitlab> gitlab # [ 0.920846] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled441vm-test-run-nixbot-gitlab> gitlab # [ 0.922188] drop_monitor: Initializing network drop monitor service442vm-test-run-nixbot-gitlab> gitlab # [ 0.923380] NET: Registered PF_INET6 protocol family443vm-test-run-nixbot-gitlab> gitlab # [ 0.925138] Segment Routing with IPv6444vm-test-run-nixbot-gitlab> gitlab # [ 0.925814] In-situ OAM (IOAM) with IPv6445vm-test-run-nixbot-gitlab> gitlab # [ 0.928519] IPI shorthand broadcast: enabled446vm-test-run-nixbot-gitlab> gitlab # [ 0.933345] sched_clock: Marking stable (799073905, 134205755)->(953292436, -20012776)447vm-test-run-nixbot-gitlab> gitlab # [ 0.935075] registered taskstats version 1448vm-test-run-nixbot-gitlab> gitlab # [ 0.936102] Loading compiled-in X.509 certificates449vm-test-run-nixbot-gitlab> gitlab # [ 0.946172] Demotion targets for Node 0: null450vm-test-run-nixbot-gitlab> gitlab # [ 0.947285] Key type .fscrypt registered451vm-test-run-nixbot-gitlab> gitlab # [ 0.947961] Key type fscrypt-provisioning registered452vm-test-run-nixbot-gitlab> gitlab # [ 0.948922] ima: No TPM chip found, activating TPM-bypass!453vm-test-run-nixbot-gitlab> gitlab # [ 0.950008] ima: Allocated hash algorithm: sha1454vm-test-run-nixbot-gitlab> gitlab # [ 0.950823] ima: No architecture policies found455vm-test-run-nixbot-gitlab> gitlab # [ 0.951855] PM: Magic number: 2:793:218456vm-test-run-nixbot-gitlab> gitlab # [ 0.953481] RAS: Correctable Errors collector initialized.457vm-test-run-nixbot-gitlab> gitlab # [ 0.957867] clk: Disabling unused clocks458vm-test-run-nixbot-gitlab> gitlab # [ 0.958552] PM: genpd: Disabling unused power domains459vm-test-run-nixbot-gitlab> gitlab # [ 1.151452] Freeing initrd memory: 27584K460vm-test-run-nixbot-gitlab> gitlab # [ 1.156295] Freeing unused decrypted memory: 2028K461vm-test-run-nixbot-gitlab> gitlab # [ 1.161292] Freeing unused kernel image (initmem) memory: 3644K462vm-test-run-nixbot-gitlab> gitlab # [ 1.163346] Write protecting the kernel read-only data: 32768k463vm-test-run-nixbot-gitlab> gitlab # [ 1.168126] Freeing unused kernel image (text/rodata gap) memory: 1332K464vm-test-run-nixbot-gitlab> gitlab # [ 1.171908] Freeing unused kernel image (rodata/data gap) memory: 816K465vm-test-run-nixbot-gitlab> gitlab # [ 1.239684] x86/mm: Checked W+X mappings: passed, no W+X pages found.466vm-test-run-nixbot-gitlab> gitlab # [ 1.240797] Run /init as init process467vm-test-run-nixbot-gitlab> gitlab # [ 1.254650] systemd[1]: Inserted module 'autofs4'468vm-test-run-nixbot-gitlab> gitlab # [ 1.277661] fuse: init (API version 7.45)469vm-test-run-nixbot-gitlab> gitlab # [ 1.285801] ACPI: \_SB_.LNKC: Enabled at IRQ 10470vm-test-run-nixbot-gitlab> gitlab # [ 1.292317] ACPI: \_SB_.LNKA: Enabled at IRQ 10471vm-test-run-nixbot-gitlab> gitlab # [ 1.295409] ACPI: \_SB_.LNKB: Enabled at IRQ 11472vm-test-run-nixbot-gitlab> gitlab # [ 1.339047] systemd[1]: Successfully made /usr/ read-only.473vm-test-run-nixbot-gitlab> gitlab # [ 1.676310] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)474vm-test-run-nixbot-gitlab> gitlab # [ 1.688396] systemd[1]: Detected virtualization kvm.475vm-test-run-nixbot-gitlab> gitlab # [ 1.718799] systemd[1]: Detected architecture x86-64.476vm-test-run-nixbot-gitlab> gitlab # [ 1.721062] systemd[1]: Running in initrd.477vm-test-run-nixbot-gitlab> gitlab # [ 1.723788] systemd[1]: Initializing machine ID from random generator.478vm-test-run-nixbot-gitlab> gitlab # [ 1.726676] systemd[1]: Hostname set to <gitlab>.479vm-test-run-nixbot-gitlab> gitlab # [ 1.791494] systemd[1]: Queued start job for default target Initrd Default Target.480vm-test-run-nixbot-gitlab> gitlab # [ 1.919926] systemd[1]: Created slice Slice /system/modprobe.481vm-test-run-nixbot-gitlab> gitlab # [ 1.922726] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.482vm-test-run-nixbot-gitlab> gitlab # [ 1.926023] systemd[1]: Expecting device /dev/disk/by-label/nix-store...483vm-test-run-nixbot-gitlab> gitlab # [ 1.928722] systemd[1]: Expecting device /dev/disk/by-label/nixos...484vm-test-run-nixbot-gitlab> gitlab # [ 1.931379] systemd[1]: Reached target Path Units.485vm-test-run-nixbot-gitlab> gitlab # [ 1.933412] systemd[1]: Reached target Slice Units.486vm-test-run-nixbot-gitlab> gitlab # [ 1.935462] systemd[1]: Reached target Swaps.487vm-test-run-nixbot-gitlab> gitlab # [ 1.937369] systemd[1]: Reached target Timer Units.488vm-test-run-nixbot-gitlab> gitlab # [ 1.939631] systemd[1]: Listening on D-Bus System Message Bus Socket.489vm-test-run-nixbot-gitlab> gitlab # [ 1.942565] systemd[1]: Listening on Journal Socket (/dev/log).490vm-test-run-nixbot-gitlab> gitlab # [ 1.945253] systemd[1]: Listening on Journal Sockets.491vm-test-run-nixbot-gitlab> gitlab # [ 1.947445] systemd[1]: Listening on udev Control Socket.492vm-test-run-nixbot-gitlab> gitlab # [ 1.949377] systemd[1]: Listening on udev Kernel Socket.493vm-test-run-nixbot-gitlab> gitlab # [ 1.951158] systemd[1]: Reached target Socket Units.494vm-test-run-nixbot-gitlab> gitlab # [ 1.955701] systemd[1]: Starting Create List of Static Device Nodes...495vm-test-run-nixbot-gitlab> gitlab # [ 1.969905] systemd[1]: Starting Load Kernel Module 9pnet_virtio...496vm-test-run-nixbot-gitlab> gitlab # [ 1.983735] systemd[1]: Starting Load Kernel Module configfs...497vm-test-run-nixbot-gitlab> gitlab # [ 1.993197] systemd[1]: Starting Journal Service...498vm-test-run-nixbot-gitlab> gitlab # [ 2.000054] systemd[1]: Starting Load Kernel Modules...499vm-test-run-nixbot-gitlab> gitlab # [ 2.002471] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki500vm-test-run-nixbot-gitlab> gitlab # [ 2.033437] systemd[1]: Starting Coldplug All udev Devices...501vm-test-run-nixbot-gitlab> gitlab # [ 2.035363] netfs: FS-Cache loaded502vm-test-run-nixbot-gitlab> gitlab # [ 2.038537] systemd[1]: Finished Create List of Static Device Nodes.503vm-test-run-nixbot-gitlab> gitlab # [ 2.045353] 9pnet: Installing 9P2000 support504vm-test-run-nixbot-gitlab> gitlab # [ 2.046498] systemd[1]: modprobe@configfs.service: Deactivated successfully.505vm-test-run-nixbot-gitlab> gitlab # [ 2.049662] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.506vm-test-run-nixbot-gitlab> gitlab # [ 2.052279] systemd[1]: Finished Load Kernel Module configfs.507vm-test-run-nixbot-gitlab> gitlab # [ 2.052293] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev508vm-test-run-nixbot-gitlab> gitlab # [ 2.057448] systemd-journald[152]: Collecting audit messages is disabled.509vm-test-run-nixbot-gitlab> gitlab # [ 2.058683] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.510vm-test-run-nixbot-gitlab> gitlab # [ 2.061360] systemd[1]: Finished Load Kernel Module 9pnet_virtio.511vm-test-run-nixbot-gitlab> gitlab # [ 2.066099] systemd[1]: Finished Load Kernel Modules.512vm-test-run-nixbot-gitlab> gitlab # [ 2.067510] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config513vm-test-run-nixbot-gitlab> gitlab # [ 2.071232] systemd[1]: Starting Apply Kernel Variables...514vm-test-run-nixbot-gitlab> gitlab # [ 2.073876] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...515vm-test-run-nixbot-gitlab> gitlab # [ 2.085956] systemd[1]: Finished Apply Kernel Variables.516vm-test-run-nixbot-gitlab> gitlab # [ 2.088713] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.517vm-test-run-nixbot-gitlab> gitlab # [ 2.092085] systemd[1]: Starting Create Static Device Nodes in /dev...518vm-test-run-nixbot-gitlab> gitlab # [ 2.101493] systemd[1]: Started Journal Service.519vm-test-run-nixbot-gitlab> gitlab # [ 1.967396] systemd-modules-load[154]: Using 4 probe threads520vm-test-run-nixbot-gitlab> gitlab # [ 1.969345] systemd-modules-load[154]: Inserted module 'virtio_balloon'521vm-test-run-nixbot-gitlab> gitlab # [ 1.970369] systemd-modules-load[154]: Inserted module 'dm_mod'522vm-test-run-nixbot-gitlab> gitlab # [ 1.971281] systemd-modules-load[154]: Inserted module 'virtio_gpu'523vm-test-run-nixbot-gitlab> gitlab # [ 1.973869] systemd[1]: Finished Create Static Device Nodes in /dev.524vm-test-run-nixbot-gitlab> gitlab # [ 1.978132] systemd[1]: Reached target Preparation for Local File Systems.525vm-test-run-nixbot-gitlab> gitlab # [ 1.979147] systemd[1]: Reached target Local File Systems.526vm-test-run-nixbot-gitlab> gitlab # [ 1.981546] systemd[1]: Starting Create System Files and Directories...527vm-test-run-nixbot-gitlab> gitlab # [ 1.984411] systemd[1]: Starting Rule-based Manager for Device Events and Files...528vm-test-run-nixbot-gitlab> gitlab # [ 1.994050] systemd[1]: Finished Create System Files and Directories.529vm-test-run-nixbot-gitlab> gitlab # [ 2.005123] systemd-udevd[191]: Using default interface naming scheme 'v260'.530vm-test-run-nixbot-gitlab> gitlab # [ 2.016563] systemd[1]: Started Rule-based Manager for Device Events and Files.531vm-test-run-nixbot-gitlab> gitlab # [ 2.045335] systemd[1]: Finished Coldplug All udev Devices.532vm-test-run-nixbot-gitlab> gitlab # [ 2.046194] systemd[1]: Reached target System Initialization.533vm-test-run-nixbot-gitlab> gitlab # [ 2.046944] systemd[1]: Reached target Basic System.534vm-test-run-nixbot-gitlab> gitlab # [ 2.268841] uhci_hcd 0000:00:01.2: UHCI Host Controller535vm-test-run-nixbot-gitlab> gitlab # [ 2.269618] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1536vm-test-run-nixbot-gitlab> gitlab # [ 2.270685] uhci_hcd 0000:00:01.2: detected 2 ports537vm-test-run-nixbot-gitlab> gitlab # [ 2.271455] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140538vm-test-run-nixbot-gitlab> gitlab # [ 2.272995] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18539vm-test-run-nixbot-gitlab> gitlab # [ 2.274126] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1540vm-test-run-nixbot-gitlab> gitlab # [ 2.275166] usb usb1: Product: UHCI Host Controller541vm-test-run-nixbot-gitlab> gitlab # [ 2.275873] usb usb1: Manufacturer: Linux 6.18.34 uhci_hcd542vm-test-run-nixbot-gitlab> gitlab # [ 2.277455] SCSI subsystem initialized543vm-test-run-nixbot-gitlab> gitlab # [ 2.279333] usb usb1: SerialNumber: 0000:00:01.2544vm-test-run-nixbot-gitlab> gitlab # [ 2.281455] virtio_blk virtio4: 4/0/0 default/read/poll queues545vm-test-run-nixbot-gitlab> gitlab # [ 2.286155] hub 1-0:1.0: USB hub found546vm-test-run-nixbot-gitlab> gitlab # [ 2.287192] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)547vm-test-run-nixbot-gitlab> gitlab # [ 2.287248] hub 1-0:1.0: 2 ports detected548vm-test-run-nixbot-gitlab> gitlab # [ 2.291836] virtio_blk virtio5: 4/0/0 default/read/poll queues549vm-test-run-nixbot-gitlab> gitlab # [ 2.295059] virtio_blk virtio5: [vdb] 11467256 512-byte logical blocks (5.87 GB/5.47 GiB)550vm-test-run-nixbot-gitlab> gitlab # [ 2.315303] scsi host0: ata_piix551vm-test-run-nixbot-gitlab> gitlab # [ 2.316510] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12552vm-test-run-nixbot-gitlab> gitlab # [ 2.317051] scsi host1: ata_piix553vm-test-run-nixbot-gitlab> gitlab # [ 2.318656] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0554vm-test-run-nixbot-gitlab> gitlab # [ 2.318886] serio: i8042 KBD port at 0x60,0x64 irq 1555vm-test-run-nixbot-gitlab> gitlab # [ 2.319016] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556vm-test-run-nixbot-gitlab> gitlab # [ 2.319259] serio: i8042 AUX port at 0x60,0x64 irq 12557vm-test-run-nixbot-gitlab> gitlab # [ 2.206568] (udev-worker)[212]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.558vm-test-run-nixbot-gitlab> gitlab # [ 2.208844] (udev-worker)[212]: Network interface NamePolicy= disabled on kernel command line.559vm-test-run-nixbot-gitlab> gitlab # [ 2.210355] (udev-worker)[202]: Network interface NamePolicy= disabled on kernel command line.560vm-test-run-nixbot-gitlab> gitlab # [ 2.218470] systemd[1]: Starting Virtual Console Setup...561vm-test-run-nixbot-gitlab> gitlab # [ 2.229218] systemd[1]: Found device /dev/disk/by-label/nix-store.562vm-test-run-nixbot-gitlab> gitlab # [ 2.232903] systemd[1]: Found device /dev/disk/by-label/nixos.563vm-test-run-nixbot-gitlab> gitlab # [ 2.233780] systemd[1]: Reached target Initrd Root Device.564vm-test-run-nixbot-gitlab> gitlab # [ 2.235111] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...565vm-test-run-nixbot-gitlab> gitlab # [ 2.239282] systemd-vconsole-setup[232]: Configuration of first virtual console was skipped, ignoring remaining ones.566vm-test-run-nixbot-gitlab> gitlab # [ 2.249564] systemd[1]: Finished Virtual Console Setup.567vm-test-run-nixbot-gitlab> gitlab # [ 2.263457] systemd-fsck[239]: nixos: clean, 12/65536 files, 13019/262144 blocks568vm-test-run-nixbot-gitlab> gitlab # [ 2.267905] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569vm-test-run-nixbot-gitlab> gitlab # [ 2.479695] ata2: found unknown device (class 0)570vm-test-run-nixbot-gitlab> gitlab # [ 2.482546] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571vm-test-run-nixbot-gitlab> gitlab # [ 2.486496] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572vm-test-run-nixbot-gitlab> gitlab # [ 2.513959] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573vm-test-run-nixbot-gitlab> gitlab # [ 2.528299] usb 1-1: new full-speed USB device number 2 using uhci_hcd574vm-test-run-nixbot-gitlab> gitlab # [ 2.545071] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray575vm-test-run-nixbot-gitlab> gitlab # [ 2.570831] cdrom: Uniform CD-ROM driver Revision: 3.20576vm-test-run-nixbot-gitlab> gitlab # [ 2.694685] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00577vm-test-run-nixbot-gitlab> gitlab # [ 2.697543] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10578vm-test-run-nixbot-gitlab> gitlab # [ 2.700129] usb 1-1: Product: QEMU USB Tablet579vm-test-run-nixbot-gitlab> gitlab # [ 2.701733] usb 1-1: Manufacturer: QEMU580vm-test-run-nixbot-gitlab> gitlab # [ 2.703134] usb 1-1: SerialNumber: 28754-0000:00:01.2-1581vm-test-run-nixbot-gitlab> gitlab # [ 2.721388] hid: raw HID events driver (C) Jiri Kosina582vm-test-run-nixbot-gitlab> gitlab # [ 2.728730] usbcore: registered new interface driver usbhid583vm-test-run-nixbot-gitlab> gitlab # [ 2.729512] usbhid: USB HID core driver584vm-test-run-nixbot-gitlab> gitlab # [ 2.734410] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2585vm-test-run-nixbot-gitlab> gitlab # [ 2.736013] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0586vm-test-run-nixbot-gitlab> gitlab # [ 2.909379] systemd[1]: Mounting /sysroot...587vm-test-run-nixbot-gitlab> gitlab # [ 3.208357] EXT4-fs (vda): mounted filesystem 4b88c64d-1795-465e-9189-f521a4da02ae r/w with ordered data mode. Quota mode: none.588vm-test-run-nixbot-gitlab> gitlab # [ 3.080228] systemd[1]: Mounted /sysroot.589vm-test-run-nixbot-gitlab> gitlab # [ 3.082198] systemd[1]: Reached target Initrd Root File System.590vm-test-run-nixbot-gitlab> gitlab # [ 3.084659] systemd[1]: Mounting /sysroot/nix/.ro-store...591vm-test-run-nixbot-gitlab> gitlab # [ 3.086869] systemd[1]: Mounting /sysroot/nix/.rw-store...592vm-test-run-nixbot-gitlab> gitlab # [ 3.090103] systemd[1]: Mounting /sysroot/run...593vm-test-run-nixbot-gitlab> gitlab # [ 3.099428] systemd[1]: Mounting /sysroot/tmp/shared...594vm-test-run-nixbot-gitlab> gitlab # [ 3.105433] systemd[1]: Mounting /sysroot/tmp/xchg...595vm-test-run-nixbot-gitlab> gitlab # [ 3.245644] erofs (device vdb): mounted with root inode @ nid 128.596vm-test-run-nixbot-gitlab> gitlab # [ 3.115299] systemd[1]: Starting Mountpoints Configured in the Real Root...597vm-test-run-nixbot-gitlab> gitlab # [ 3.257151] 9p: Installing v9fs 9p2000 file system support598vm-test-run-nixbot-gitlab> gitlab # [ 3.125814] systemd[1]: Mounted /sysroot/nix/.ro-store.599vm-test-run-nixbot-gitlab> gitlab # [ 3.127582] systemd[1]: Mounted /sysroot/nix/.rw-store.600vm-test-run-nixbot-gitlab> gitlab # [ 3.129314] systemd[1]: Mounted /sysroot/run.601vm-test-run-nixbot-gitlab> gitlab # [ 3.131170] systemd-sysroot-fstab-check[271]: /sysroot should be mounted in the initrd, will request daemon-reload.602vm-test-run-nixbot-gitlab> gitlab # [ 3.133763] systemd[1]: Mounted /sysroot/tmp/shared.603vm-test-run-nixbot-gitlab> gitlab # [ 3.135191] systemd[1]: Mounted /sysroot/tmp/xchg.604vm-test-run-nixbot-gitlab> gitlab # [ 3.136544] systemd[1]: Reload requested from client PID 271 ('systemd-sysroot') (unit initrd-parse-etc.service)...605vm-test-run-nixbot-gitlab> gitlab # [ 3.138096] systemd[1]: Reloading...606vm-test-run-nixbot-gitlab> gitlab # [ 3.350488] systemd[1]: Reloading finished in 218 ms.607vm-test-run-nixbot-gitlab> gitlab # [ 3.387403] systemd-sysroot-fstab-check[271]: Requesting initrd-fs.target/start/replace...608vm-test-run-nixbot-gitlab> gitlab # [ 3.472113] systemd-sysroot-fstab-check[271]: Requesting swap.target/start/replace...609vm-test-run-nixbot-gitlab> gitlab # [ 3.474717] systemd[1]: Starting rw-sysroot-nix-store.service...610vm-test-run-nixbot-gitlab> gitlab # [ 3.476899] systemd[1]: initrd-parse-etc.service: Deactivated successfully.611vm-test-run-nixbot-gitlab> gitlab # [ 3.479296] systemd[1]: Finished Mountpoints Configured in the Real Root.612vm-test-run-nixbot-gitlab> gitlab # [ 3.481455] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.613vm-test-run-nixbot-gitlab> gitlab # [ 3.485393] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.614vm-test-run-nixbot-gitlab> gitlab # [ 3.487384] systemd[1]: Finished rw-sysroot-nix-store.service.615vm-test-run-nixbot-gitlab> gitlab # [ 3.909022] systemd[1]: Mounting /sysroot/nix/store...616vm-test-run-nixbot-gitlab> gitlab # [ 3.957220] systemd[1]: Mounted /sysroot/nix/store.617vm-test-run-nixbot-gitlab> gitlab # [ 3.958493] systemd[1]: Reached target Initrd File Systems.618vm-test-run-nixbot-gitlab> gitlab # [ 3.963252] systemd[1]: Starting Find NixOS closure...619vm-test-run-nixbot-gitlab> gitlab # [ 3.967539] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...620vm-test-run-nixbot-gitlab> gitlab # [ 4.000564] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.621vm-test-run-nixbot-gitlab> gitlab # [ 4.002612] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.622vm-test-run-nixbot-gitlab> gitlab # [ 4.011856] systemd[1]: Finished Find NixOS closure.623vm-test-run-nixbot-gitlab> gitlab # [ 4.013564] systemd[1]: Reached target Initrd Default Target.624vm-test-run-nixbot-gitlab> gitlab # [ 4.016676] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...625vm-test-run-nixbot-gitlab> gitlab # [ 4.043739] systemd[1]: Stopped target Initrd Default Target.626vm-test-run-nixbot-gitlab> gitlab # [ 4.045666] systemd[1]: Stopped target Basic System.627vm-test-run-nixbot-gitlab> gitlab # [ 4.047301] systemd[1]: Stopped target Initrd Root Device.628vm-test-run-nixbot-gitlab> gitlab # [ 4.048995] systemd[1]: Stopped target Path Units.629vm-test-run-nixbot-gitlab> gitlab # [ 4.050603] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.630vm-test-run-nixbot-gitlab> gitlab # [ 4.052897] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.631vm-test-run-nixbot-gitlab> gitlab # [ 4.055264] systemd[1]: Stopped target Slice Units.632vm-test-run-nixbot-gitlab> gitlab # [ 4.056868] systemd[1]: Stopped target Socket Units.633vm-test-run-nixbot-gitlab> gitlab # [ 4.058424] systemd[1]: Stopped target System Initialization.634vm-test-run-nixbot-gitlab> gitlab # [ 4.060222] systemd[1]: Stopped target Swaps.635vm-test-run-nixbot-gitlab> gitlab # [ 4.061760] systemd[1]: Stopped target Timer Units.636vm-test-run-nixbot-gitlab> gitlab # [ 4.063343] systemd[1]: dbus.socket: Deactivated successfully.637vm-test-run-nixbot-gitlab> gitlab # [ 4.065195] systemd[1]: Closed D-Bus System Message Bus Socket.638vm-test-run-nixbot-gitlab> gitlab # [ 4.067084] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.639vm-test-run-nixbot-gitlab> gitlab # [ 4.069420] systemd[1]: Stopped Find NixOS closure.640vm-test-run-nixbot-gitlab> gitlab # [ 4.070996] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio641vm-test-run-nixbot-gitlab> gitlab # [ 4.074368] systemd[1]: Starting rw-sysroot-nix-store.service...642vm-test-run-nixbot-gitlab> gitlab # [ 4.076311] systemd[1]: systemd-sysctl.service: Deactivated successfully.643vm-test-run-nixbot-gitlab> gitlab # [ 4.078396] systemd[1]: Stopped Apply Kernel Variables.644vm-test-run-nixbot-gitlab> gitlab # [ 4.080358] systemd[1]: systemd-modules-load.service: Deactivated successfully.645vm-test-run-nixbot-gitlab> gitlab # [ 4.082261] systemd[1]: Stopped Load Kernel Modules.646vm-test-run-nixbot-gitlab> gitlab # [ 4.083533] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.647vm-test-run-nixbot-gitlab> gitlab # [ 4.085415] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.648vm-test-run-nixbot-gitlab> gitlab # [ 4.087505] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.649vm-test-run-nixbot-gitlab> gitlab # [ 4.089556] systemd[1]: Stopped Create System Files and Directories.650vm-test-run-nixbot-gitlab> gitlab # [ 4.091324] systemd[1]: Stopped target Local File Systems.651vm-test-run-nixbot-gitlab> gitlab # [ 4.092857] systemd[1]: Stopped target Preparation for Local File Systems.652vm-test-run-nixbot-gitlab> gitlab # [ 4.094742] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.653vm-test-run-nixbot-gitlab> gitlab # [ 4.097239] systemd[1]: Stopped Coldplug All udev Devices.654vm-test-run-nixbot-gitlab> gitlab # [ 4.098375] systemd[1]: Stopping Rule-based Manager for Device Events and Files...655vm-test-run-nixbot-gitlab> gitlab # [ 4.099979] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.656vm-test-run-nixbot-gitlab> gitlab # [ 4.100904] systemd[1]: Stopped Virtual Console Setup.657vm-test-run-nixbot-gitlab> gitlab # [ 4.106216] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.658vm-test-run-nixbot-gitlab> gitlab # [ 4.108397] systemd[1]: Finished rw-sysroot-nix-store.service.659vm-test-run-nixbot-gitlab> gitlab # [ 4.112814] systemd[1]: systemd-udevd.service: Deactivated successfully.660vm-test-run-nixbot-gitlab> gitlab # [ 4.116928] systemd[1]: Stopped Rule-based Manager for Device Events and Files.661vm-test-run-nixbot-gitlab> gitlab # [ 4.124777] systemd[1]: initrd-cleanup.service: Deactivated successfully.662vm-test-run-nixbot-gitlab> gitlab # [ 4.128124] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.663vm-test-run-nixbot-gitlab> gitlab # [ 4.133357] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.664vm-test-run-nixbot-gitlab> gitlab # [ 4.135659] systemd[1]: Closed udev Control Socket.665vm-test-run-nixbot-gitlab> gitlab # [ 4.139332] systemd[1]: Starting Cleanup udev Database...666vm-test-run-nixbot-gitlab> gitlab # [ 4.140451] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.667vm-test-run-nixbot-gitlab> gitlab # [ 4.142033] systemd[1]: Stopped Create Static Device Nodes in /dev.668vm-test-run-nixbot-gitlab> gitlab # [ 4.144341] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.669vm-test-run-nixbot-gitlab> gitlab # [ 4.146038] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.670vm-test-run-nixbot-gitlab> gitlab # [ 4.149668] systemd[1]: kmod-static-nodes.service: Deactivated successfully.671vm-test-run-nixbot-gitlab> gitlab # [ 4.151180] systemd[1]: Stopped Create List of Static Device Nodes.672vm-test-run-nixbot-gitlab> gitlab # [ 4.168486] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.673vm-test-run-nixbot-gitlab> gitlab # [ 4.171055] systemd[1]: Finished Cleanup udev Database.674vm-test-run-nixbot-gitlab> gitlab # [ 4.175800] systemd[1]: Reached target Switch Root.675vm-test-run-nixbot-gitlab> gitlab # [ 4.178740] systemd[1]: Starting NixOS Activation...676vm-test-run-nixbot-gitlab> gitlab # [ 4.308621] initrd-nixos-activation-start[562]: booting system configuration /nix/store/cpf0kazf2kcxx4g1ba4j13nxf3662fk5-nixos-system-gitlab-test677vm-test-run-nixbot-gitlab> gitlab # [ 4.340579] initrd-nixos-activation-start[562]: running activation script...678vm-test-run-nixbot-gitlab> gitlab # [ 4.572771] initrd-nixos-activation-start[585]: setting up /etc...679vm-test-run-nixbot-gitlab> gitlab # [ 4.677280] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.680vm-test-run-nixbot-gitlab> gitlab # [ 4.679756] systemd[1]: Finished NixOS Activation.681vm-test-run-nixbot-gitlab> gitlab # [ 4.685930] systemd[1]: Starting Switch Root...682vm-test-run-nixbot-gitlab> gitlab # [ 4.707758] systemd[1]: Switching root.683vm-test-run-nixbot-gitlab> gitlab # [ 5.095374] systemd-journald[152]: Received SIGTERM from PID 1 (systemd).684vm-test-run-nixbot-gitlab> gitlab # [ 5.229560] NET: Registered PF_VSOCK protocol family685vm-test-run-nixbot-gitlab> gitlab # [ 5.593860] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)686vm-test-run-nixbot-gitlab> gitlab # [ 5.603492] systemd[1]: Detected virtualization kvm.687vm-test-run-nixbot-gitlab> gitlab # [ 5.605274] systemd[1]: Detected architecture x86-64.688vm-test-run-nixbot-gitlab> gitlab # [ 5.607090] systemd[1]: Detected first boot.689vm-test-run-nixbot-gitlab> gitlab # [ 5.609645] systemd[1]: Initializing machine ID from random generator.690vm-test-run-nixbot-gitlab> gitlab # [ 5.751265] systemd[1]: bpf-restrict-fs: LSM BPF program attached691vm-test-run-nixbot-gitlab> gitlab # [ 5.795713] systemd[1]: Applying preset policy.692vm-test-run-nixbot-gitlab> gitlab # [ 5.928497] systemd[1]: Populated /etc with preset unit settings.693vm-test-run-nixbot-gitlab> gitlab # [ 6.029076] systemd[1]: initrd-switch-root.service: Deactivated successfully.694vm-test-run-nixbot-gitlab> gitlab # [ 6.030432] systemd[1]: Stopped initrd-switch-root.service.695vm-test-run-nixbot-gitlab> gitlab # [ 6.032279] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.696vm-test-run-nixbot-gitlab> gitlab # [ 6.034441] systemd[1]: Created slice Slice /system/getty.697vm-test-run-nixbot-gitlab> gitlab # [ 6.035722] systemd[1]: Created slice GitLab DevOps Platform Slice.698vm-test-run-nixbot-gitlab> gitlab # [ 6.037079] systemd[1]: Created slice User and Session Slice.699vm-test-run-nixbot-gitlab> gitlab # [ 6.037983] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.700vm-test-run-nixbot-gitlab> gitlab # [ 6.039125] systemd[1]: Started Forward Password Requests to Wall Directory Watch.701vm-test-run-nixbot-gitlab> gitlab # [ 6.040168] systemd[1]: Expecting device /dev/hvc0...702vm-test-run-nixbot-gitlab> gitlab # [ 6.040870] systemd[1]: Expecting device /dev/ttyS0...703vm-test-run-nixbot-gitlab> gitlab # [ 6.041584] systemd[1]: Reached target Local Encrypted Volumes.704vm-test-run-nixbot-gitlab> gitlab # [ 6.042400] systemd[1]: Stopped target initrd-fs.target.705vm-test-run-nixbot-gitlab> gitlab # [ 6.043101] systemd[1]: Stopped target initrd-root-fs.target.706vm-test-run-nixbot-gitlab> gitlab # [ 6.043927] systemd[1]: Stopped target initrd-switch-root.target.707vm-test-run-nixbot-gitlab> gitlab # [ 6.044765] systemd[1]: Reached target Virtual Machines and Containers.708vm-test-run-nixbot-gitlab> gitlab # [ 6.045680] systemd[1]: Reached target Path Units.709vm-test-run-nixbot-gitlab> gitlab # [ 6.046391] systemd[1]: Reached target Remote File Systems.710vm-test-run-nixbot-gitlab> gitlab # [ 6.047136] systemd[1]: Reached target Slice Units.711vm-test-run-nixbot-gitlab> gitlab # [ 6.047886] systemd[1]: Reached target Swaps.712vm-test-run-nixbot-gitlab> gitlab # [ 6.049479] systemd[1]: Listening on Process Core Dump Socket.713vm-test-run-nixbot-gitlab> gitlab # [ 6.050888] systemd[1]: Listening on Credential Encryption/Decryption.714vm-test-run-nixbot-gitlab> gitlab # [ 6.053268] systemd[1]: Starting Journal Log Access Socket...715vm-test-run-nixbot-gitlab> gitlab # [ 6.054587] systemd[1]: Listening on Journal Audit Socket.716vm-test-run-nixbot-gitlab> gitlab # [ 6.055534] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.717vm-test-run-nixbot-gitlab> gitlab # [ 6.056631] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki718vm-test-run-nixbot-gitlab> gitlab # [ 6.058079] systemd[1]: Listening on udev Control Socket.719vm-test-run-nixbot-gitlab> gitlab # [ 6.066184] systemd[1]: Mounting Huge Pages File System...720vm-test-run-nixbot-gitlab> gitlab # [ 6.068107] systemd[1]: Mounting POSIX Message Queue File System...721vm-test-run-nixbot-gitlab> gitlab # [ 6.070075] systemd[1]: Mounting Kernel Debug File System...722vm-test-run-nixbot-gitlab> gitlab # [ 6.071956] systemd[1]: Mounting Kernel Trace File System...723vm-test-run-nixbot-gitlab> gitlab # [ 6.081044] systemd[1]: Starting Create List of Static Device Nodes...724vm-test-run-nixbot-gitlab> gitlab # [ 6.085020] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio725vm-test-run-nixbot-gitlab> gitlab # [ 6.091654] systemd[1]: Starting Load Kernel Module configfs...726vm-test-run-nixbot-gitlab> gitlab # [ 6.096342] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm727vm-test-run-nixbot-gitlab> gitlab # [ 6.097746] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore728vm-test-run-nixbot-gitlab> gitlab # [ 6.099298] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse729vm-test-run-nixbot-gitlab> gitlab # [ 6.112241] systemd[1]: Mounting FUSE Control File System...730vm-test-run-nixbot-gitlab> gitlab # [ 6.113914] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67731vm-test-run-nixbot-gitlab> gitlab # [ 6.121290] systemd[1]: Starting Journal Service...732vm-test-run-nixbot-gitlab> gitlab # [ 6.124681] systemd[1]: Starting Load Kernel Modules...733vm-test-run-nixbot-gitlab> gitlab # [ 6.138806] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...734vm-test-run-nixbot-gitlab> gitlab # [ 6.143408] systemd[1]: Starting Remount Root and Kernel File Systems...735vm-test-run-nixbot-gitlab> gitlab # [ 6.145664] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki736vm-test-run-nixbot-gitlab> gitlab # [ 6.152782] systemd-journald[780]: Collecting audit messages is enabled.737vm-test-run-nixbot-gitlab> gitlab # [ 6.176425] systemd[1]: Starting Coldplug All udev Devices...738vm-test-run-nixbot-gitlab> gitlab # [ 6.182515] systemd[1]: Listening on Journal Log Access Socket.739vm-test-run-nixbot-gitlab> gitlab # [ 6.184582] systemd[1]: Mounted Huge Pages File System.740vm-test-run-nixbot-gitlab> gitlab # [ 6.190453] systemd[1]: Mounted POSIX Message Queue File System.741vm-test-run-nixbot-gitlab> gitlab # [ 6.191594] systemd[1]: Mounted Kernel Debug File System.742vm-test-run-nixbot-gitlab> gitlab # [ 6.192610] systemd[1]: Mounted Kernel Trace File System.743vm-test-run-nixbot-gitlab> gitlab # [ 6.059023] systemd[1]: Queued start job for default target M[ 6.193521] systemd[1]: Started Journal Service.744vm-test-run-nixbot-gitlab> gitlab # ulti-User System.745vm-test-run-nixbot-gitlab> gitlab # [ 6.060947] systemd[1]: Unnecessary job was removed for /dev/vdb.746vm-test-run-nixbot-gitlab> gitlab # [ 6.062078] systemd[1]: systemd-journald.service: Deactivated successfully.747vm-test-run-nixbot-gitlab> gitlab # [ 6.063367] systemd-modules-load[781]: Using 3 probe threads748vm-test-run-nixbot-gitlab> gitlab # [ 6.064319] systemd-modules-load[781]: Inserted module 'tls'749vm-test-run-nixbot-gitlab> gitlab # [ 6.065308] systemd[1]: Finished Create List of Static Device Nodes.750vm-test-run-nixbot-gitlab> gitlab # [ 6.201007] loop: module loaded751vm-test-run-nixbot-gitlab> gitlab # [ 6.067439] systemd[1]: modprobe@configfs.service: Deactivated successfully.752vm-test-run-nixbot-gitlab> gitlab # [ 6.202282] EXT4-fs (vda): re-mounted 4b88c64d-1795-465e-9189-f521a4da02ae.753vm-test-run-nixbot-gitlab> gitlab # [ 6.068569] systemd[1]: Finished Load Kernel Module configfs.754vm-test-run-nixbot-gitlab> gitlab # [ 6.070297] systemd[1]: Mounted FUSE Control File System.755vm-test-run-nixbot-gitlab> gitlab # [ 6.071276] systemd[1]: Mounting Kernel Configuration File System...756vm-test-run-nixbot-gitlab> gitlab # [ 6.072264] systemd-modules-load[781]: Inserted module 'loop'757vm-test-run-nixbot-gitlab> gitlab # [ 6.073162] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...758vm-test-run-nixbot-gitlab> gitlab # [ 6.074168] systemd[1]: Finished Load Kernel Modules.759vm-test-run-nixbot-gitlab> gitlab # [ 6.075519] systemd-oomd[783]: No swap; memory pressure usage will be degraded760vm-test-run-nixbot-gitlab> gitlab # [ 6.076929] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.761vm-test-run-nixbot-gitlab> gitlab # [ 6.078102] systemd[1]: Finished Remount Root and Kernel File Systems.762vm-test-run-nixbot-gitlab> gitlab # [ 6.082891] systemd[1]: Mounted Kernel Configuration File System.763vm-test-run-nixbot-gitlab> gitlab # [ 6.085101] systemd[1]: Starting Firewall...764vm-test-run-nixbot-gitlab> gitlab # [ 6.088131] systemd[1]: Starting Flush Journal to Persistent Storage...765vm-test-run-nixbot-gitlab> gitlab # [ 6.089145] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore766vm-test-run-nixbot-gitlab> gitlab # [ 6.090938] systemd[1]: Starting Load/Save OS Random Seed...767vm-test-run-nixbot-gitlab> gitlab # [ 6.099082] systemd[1]: Starting Apply Kernel Variables...768vm-test-run-nixbot-gitlab> gitlab # [ 6.102175] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki769vm-test-run-nixbot-gitlab> gitlab # [ 6.237824] systemd-journald[780]: Received client request to flush runtime journal.770vm-test-run-nixbot-gitlab> gitlab # [ 6.147290] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.771vm-test-run-nixbot-gitlab> gitlab # [ 6.150083] systemd[1]: Starting Create Static Device Nodes in /dev...772vm-test-run-nixbot-gitlab> gitlab # [ 6.151553] systemd[1]: Finished Load/Save OS Random Seed.773vm-test-run-nixbot-gitlab> gitlab # [ 6.153021] systemd[1]: Reached target First Boot Complete.774vm-test-run-nixbot-gitlab> gitlab # [ 6.154253] systemd[1]: Finished Create Static Device Nodes in /dev.775vm-test-run-nixbot-gitlab> gitlab # [ 6.155109] systemd[1]: Finished Apply Kernel Variables.776vm-test-run-nixbot-gitlab> gitlab # [ 6.155810] systemd[1]: Reached target Preparation for Local File Systems.777vm-test-run-nixbot-gitlab> gitlab # [ 6.156669] systemd[1]: Starting Rule-based Manager for Device Events and Files...778vm-test-run-nixbot-gitlab> gitlab # [ 6.157621] systemd[1]: Finished Flush Journal to Persistent Storage.779vm-test-run-nixbot-gitlab> gitlab # [ 6.171052] systemd-udevd[815]: Using default interface naming scheme 'v260'.780vm-test-run-nixbot-gitlab> gitlab # [ 6.204296] systemd[1]: Started Rule-based Manager for Device Events and Files.781vm-test-run-nixbot-gitlab> gitlab # [ 6.218850] systemd[1]: Finished Coldplug All udev Devices.782vm-test-run-nixbot-gitlab> gitlab # [ 6.289466] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse783vm-test-run-nixbot-gitlab> gitlab # [ 6.302792] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.784vm-test-run-nixbot-gitlab> gitlab # [ 6.314406] (udev-worker)[884]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.785vm-test-run-nixbot-gitlab> gitlab # [ 6.317476] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.786vm-test-run-nixbot-gitlab> gitlab # [ 6.318737] (udev-worker)[884]: Network interface NamePolicy= disabled on kernel command line.787vm-test-run-nixbot-gitlab> gitlab # [ 6.320177] (udev-worker)[888]: Network interface NamePolicy= disabled on kernel command line.788vm-test-run-nixbot-gitlab> gitlab # [ 6.332517] systemd[1]: Finished Firewall.789vm-test-run-nixbot-gitlab> gitlab # [ 6.337972] systemd[1]: Condition check resulted in Virtio network device being skipped.790vm-test-run-nixbot-gitlab> gitlab # [ 6.339172] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore791vm-test-run-nixbot-gitlab> gitlab # [ 6.340579] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67792vm-test-run-nixbot-gitlab> gitlab # [ 6.342660] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore793vm-test-run-nixbot-gitlab> gitlab # [ 6.344201] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki794vm-test-run-nixbot-gitlab> gitlab # [ 6.345447] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki795vm-test-run-nixbot-gitlab> gitlab # [ 6.494033] mousedev: PS/2 mouse device common for all mice796vm-test-run-nixbot-gitlab> gitlab # [ 6.504337] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3797vm-test-run-nixbot-gitlab> gitlab # [ 6.527351] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console798vm-test-run-nixbot-gitlab> gitlab # [ 6.528350] ACPI: button: Power Button [PWRF]799vm-test-run-nixbot-gitlab> gitlab # [ 6.542621] Console: switching to colour dummy device 80x25800vm-test-run-nixbot-gitlab> gitlab # [ 6.543735] [drm] Found bochs VGA, ID 0xb0c5.801vm-test-run-nixbot-gitlab> gitlab # [ 6.543737] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.802vm-test-run-nixbot-gitlab> gitlab # [ 6.547748] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic803vm-test-run-nixbot-gitlab> gitlab # [ 6.548007] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0804vm-test-run-nixbot-gitlab> gitlab # [ 6.548533] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0805vm-test-run-nixbot-gitlab> gitlab # [ 6.552433] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD806vm-test-run-nixbot-gitlab> gitlab # [ 6.555080] fbcon: bochs-drmdrmfb (fb0) is primary device807vm-test-run-nixbot-gitlab> gitlab # [ 6.559332] rtc_cmos 00:05: RTC can wake from S4808vm-test-run-nixbot-gitlab> gitlab # [ 6.563358] rtc_cmos 00:05: registered as rtc0809vm-test-run-nixbot-gitlab> gitlab # [ 6.563444] rtc_cmos 00:05: setting system clock to 2026-07-25T07:13:48 UTC (1784963628)810vm-test-run-nixbot-gitlab> gitlab # [ 6.563777] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs811vm-test-run-nixbot-gitlab> gitlab # [ 6.564135] Console: switching to colour frame buffer device 160x50812vm-test-run-nixbot-gitlab> gitlab # [ 6.564166] Floppy drive(s): fd0 is 2.88M AMI BIOS813vm-test-run-nixbot-gitlab> gitlab # [ 6.566331] parport_pc 00:03: reported by Plug and Play ACPI814vm-test-run-nixbot-gitlab> gitlab # [ 6.566336] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device815vm-test-run-nixbot-gitlab> gitlab # [ 6.575550] FDC 0 is a S82078B816vm-test-run-nixbot-gitlab> gitlab # [ 6.576099] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]817vm-test-run-nixbot-gitlab> gitlab # [ 6.580259] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4818vm-test-run-nixbot-gitlab> gitlab # [ 6.592875] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6819vm-test-run-nixbot-gitlab> gitlab # [ 6.598950] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5820vm-test-run-nixbot-gitlab> gitlab # [ 6.511861] systemd[1]: Starting Virtual Console Setup...821vm-test-run-nixbot-gitlab> gitlab # [ 6.527843] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.822vm-test-run-nixbot-gitlab> gitlab # [ 6.528935] systemd[1]: Stopped Virtual Console Setup.823vm-test-run-nixbot-gitlab> gitlab # [ 6.531256] systemd[1]: Starting Virtual Console Setup...824vm-test-run-nixbot-gitlab> gitlab # [ 6.542376] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.825vm-test-run-nixbot-gitlab> gitlab # [ 6.544830] systemd[1]: Stopped Virtual Console Setup.826vm-test-run-nixbot-gitlab> gitlab # [ 6.560308] systemd[1]: Starting Virtual Console Setup...827vm-test-run-nixbot-gitlab> gitlab # [ 6.714279] ppdev: user-space parallel port driver828vm-test-run-nixbot-gitlab> gitlab # [ 6.735622] kvm_amd: TSC scaling supported829vm-test-run-nixbot-gitlab> gitlab # [ 6.736120] kvm_amd: Nested Virtualization enabled830vm-test-run-nixbot-gitlab> gitlab # [ 6.736859] kvm_amd: Nested Paging enabled831vm-test-run-nixbot-gitlab> gitlab # [ 6.737389] kvm_amd: LBR virtualization supported832vm-test-run-nixbot-gitlab> gitlab # [ 6.737939] kvm_amd: Virtual VMLOAD VMSAVE supported833vm-test-run-nixbot-gitlab> gitlab # [ 6.738509] kvm_amd: Virtual GIF supported834vm-test-run-nixbot-gitlab> gitlab # [ 6.738971] kvm_amd: Virtual NMI enabled835vm-test-run-nixbot-gitlab> gitlab # [ 6.770106] EDAC MC: Ver: 3.0.0836vm-test-run-nixbot-gitlab> gitlab # [ 6.642103] systemd-vconsole-setup[955]: Configuration of first virtual console was skipped, ignoring remaining ones.837vm-test-run-nixbot-gitlab> gitlab # [ 6.644934] systemd[1]: Finished Virtual Console Setup.838vm-test-run-nixbot-gitlab> gitlab # [ 6.900297] systemd[1]: Mounting /run/wrappers...839vm-test-run-nixbot-gitlab> gitlab # [ 6.923909] systemd[1]: Mounted /run/wrappers.840vm-test-run-nixbot-gitlab> gitlab # [ 6.925605] systemd[1]: Reached target Local File Systems.841vm-test-run-nixbot-gitlab> gitlab # [ 6.927463] systemd[1]: Listening on Boot Loader Control Service Socket.842vm-test-run-nixbot-gitlab> gitlab # [ 6.929603] systemd[1]: Starting register-nix-paths.service...843vm-test-run-nixbot-gitlab> gitlab # [ 6.931761] systemd[1]: Starting Create SUID/SGID Wrappers...844vm-test-run-nixbot-gitlab> gitlab # [ 6.933700] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.845vm-test-run-nixbot-gitlab> gitlab # [ 6.936562] systemd[1]: Starting Save Transient machine-id to Disk...846vm-test-run-nixbot-gitlab> gitlab # [ 6.946205] systemd[1]: Starting Create System Files and Directories...847vm-test-run-nixbot-gitlab> gitlab # [ 6.976177] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.848vm-test-run-nixbot-gitlab> gitlab # [ 6.980785] systemd[1]: Finished Save Transient machine-id to Disk.849vm-test-run-nixbot-gitlab> gitlab # [ 6.999641] systemd[1]: Finished Create System Files and Directories.850vm-test-run-nixbot-gitlab> gitlab # [ 7.004921] systemd[1]: Starting Rebuild Journal Catalog...851vm-test-run-nixbot-gitlab> gitlab # [ 7.007236] systemd[1]: Starting Record System Boot/Shutdown in UTMP...852vm-test-run-nixbot-gitlab> gitlab # [ 7.026666] systemd[1]: Finished Record System Boot/Shutdown in UTMP.853vm-test-run-nixbot-gitlab> gitlab # [ 7.035338] systemd[1]: Finished Rebuild Journal Catalog.854vm-test-run-nixbot-gitlab> gitlab # [ 7.037561] systemd[1]: Starting Update is Completed...855vm-test-run-nixbot-gitlab> gitlab # [ 7.053899] systemd[1]: Finished Update is Completed.856vm-test-run-nixbot-gitlab> gitlab # [ 7.123556] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.857vm-test-run-nixbot-gitlab> gitlab # [ 7.125081] systemd[1]: Finished Create SUID/SGID Wrappers.858vm-test-run-nixbot-gitlab> gitlab # [ 7.125938] systemd[1]: suid-sgid-wrappers.service: Consumed 159ms CPU time over 191ms wall clock time, 4.6M memory peak, 1.1M read from disk.859vm-test-run-nixbot-gitlab> gitlab # [ 7.337394] systemd[1]: Finished register-nix-paths.service.860vm-test-run-nixbot-gitlab> gitlab # [ 7.339611] systemd[1]: Reached target System Initialization.861vm-test-run-nixbot-gitlab> gitlab # [ 7.341948] systemd[1]: Started Discard unused filesystem blocks once a week.862vm-test-run-nixbot-gitlab> gitlab # [ 7.344147] systemd[1]: Started logrotate.timer.863vm-test-run-nixbot-gitlab> gitlab # [ 7.345428] systemd[1]: Started Daily Cleanup of Temporary Directories.864vm-test-run-nixbot-gitlab> gitlab # [ 7.347155] systemd[1]: Reached target Timer Units.865vm-test-run-nixbot-gitlab> gitlab # [ 7.348692] systemd[1]: Listening on D-Bus System Message Bus Socket.866vm-test-run-nixbot-gitlab> gitlab # [ 7.350620] systemd[1]: Listening on Nix Daemon Socket.867vm-test-run-nixbot-gitlab> gitlab # [ 7.362050] systemd[1]: Starting nixbot CI service socket...868vm-test-run-nixbot-gitlab> gitlab # [ 7.363844] systemd[1]: Listening on Hostname Service Socket.869vm-test-run-nixbot-gitlab> gitlab # [ 7.365759] systemd[1]: Listening on nixbot CI service socket.870vm-test-run-nixbot-gitlab> gitlab # [ 7.367605] systemd[1]: Reached target Socket Units.871vm-test-run-nixbot-gitlab> gitlab # [ 7.369280] systemd[1]: Starting D-Bus System Message Bus...872vm-test-run-nixbot-gitlab> gitlab # [ 7.429157] dbus-broker-launch[1045]: Looking up NSS user entry for 'systemd-timesync'...873vm-test-run-nixbot-gitlab> gitlab # [ 7.431797] dbus-broker-launch[1045]: NSS returned no entry for 'systemd-timesync'874vm-test-run-nixbot-gitlab> gitlab # [ 7.434376] dbus-broker-launch[1045]: Invalid user-name in /nix/store/89zj9nmrajvcy9c3c08wv0ir9ww7lgmq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"875vm-test-run-nixbot-gitlab> gitlab # [ 7.439299] systemd[1]: Started D-Bus System Message Bus.876vm-test-run-nixbot-gitlab> gitlab # [ 7.457886] dbus-broker-launch[1045]: Ready877vm-test-run-nixbot-gitlab> gitlab # [ 7.460223] systemd[1]: Reached target Basic System.878vm-test-run-nixbot-gitlab> gitlab # [ 7.463193] systemd[1]: Started backdoor.service.879vm-test-run-nixbot-gitlab> gitlab # [ 7.467621] systemd[1]: Starting gitlab-config.service...880vm-test-run-nixbot-gitlab> gitlab # [ 7.469901] systemd[1]: Starting Import lastlog data into lastlog2 database...881vm-test-run-nixbot-gitlab> gitlab # [ 7.473573] systemd[1]: Starting Logrotate configuration check...882vm-test-run-nixbot-gitlab> gitlab # [ 7.490404] systemd[1]: Starting Name Service Cache Daemon (nsncd)...883vm-test-run-nixbot-gitlab> gitlab # [ 7.495713] systemd[1]: Starting Post-Boot Actions...884vm-test-run-nixbot-gitlab> gitlab # [ 7.499272] systemd[1]: Started Reset console on configuration changes.885vm-test-run-nixbot-gitlab> gitlab # [ 7.505478] logrotate[1050]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.886vm-test-run-nixbot-gitlab> gitlab # [ 7.509864] logrotate[1050]: reading config file /nix/store/sn4bd2nqi3yg4r51djm9i2rmfgbwvmhb-logrotate.conf887vm-test-run-nixbot-gitlab> gitlab # [ 7.513135] logrotate[1050]: note: 'monthly' overrides previously specified 'weekly'888vm-test-run-nixbot-gitlab> gitlab # connecting to host...889vm-test-run-nixbot-gitlab> gitlab # [ 7.513824] logrotate[1050]: Reading state from file: /var/lib/logrotate.status890vm-test-run-nixbot-gitlab> gitlab # [ 7.516091] logrotate[1050]: state file /var/lib/logrotate.status does not exist891vm-test-run-nixbot-gitlab> gitlab # [ 7.516956] logrotate[1050]: Allocating hash table for state file, size 64 entries892vm-test-run-nixbot-gitlab> gitlab # [ 7.520690] logrotate[1050]: Handling 4 logs893vm-test-run-nixbot-gitlab> gitlab # [ 7.521593] logrotate[1050]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed894vm-test-run-nixbot-gitlab> gitlab # [ 7.523652] logrotate[1050]: considering log /var/log/btmp895vm-test-run-nixbot-gitlab> gitlab # [ 7.524986] logrotate[1050]: Creating new state896vm-test-run-nixbot-gitlab> gitlab: Guest shell says: b'Spawning backdoor root shell...\n'897vm-test-run-nixbot-gitlab> gitlab # [ 7.528725] logrotate[1050]: Now: 2026-07-25 07:13898vm-test-run-nixbot-gitlab> gitlab: connected to guest root shell899vm-test-run-nixbot-gitlab> gitlab # [ 7.529643] logrotate[1050]: Last rotated at 2026-07-25 07:00900vm-test-run-nixbot-gitlab> gitlab: (connecting took 8.19 seconds)901vm-test-run-nixbot-gitlab> gitlab # [ 7.530462] logrotate[1050]: log does not need rotating (log has already been rotated)902vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for the VM to finish booting, in 8.19 seconds)903vm-test-run-nixbot-gitlab> gitlab # [ 7.531135] logrotate[1050]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed904vm-test-run-nixbot-gitlab> gitlab # [ 7.532055] logrotate[1050]: considering log /var/log/wtmp905vm-test-run-nixbot-gitlab> gitlab # [ 7.532552] logrotate[1050]: Creating new state906vm-test-run-nixbot-gitlab> gitlab # [ 7.533736] logrotate[1050]: Now: 2026-07-25 07:13907vm-test-run-nixbot-gitlab> gitlab # [ 7.534776] logrotate[1050]: Last rotated at 2026-07-25 07:00908vm-test-run-nixbot-gitlab> gitlab # [ 7.535397] logrotate[1050]: log does not need rotating (log has already been rotated)909vm-test-run-nixbot-gitlab> gitlab # [ 7.535985] logrotate[1050]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed910vm-test-run-nixbot-gitlab> gitlab # [ 7.537436] logrotate[1050]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1050)911vm-test-run-nixbot-gitlab> gitlab # [ 7.537842] logrotate[1050]: considering log /var/gitlab/state/log/*.log912vm-test-run-nixbot-gitlab> gitlab # [ 7.539076] logrotate[1050]: log /var/gitlab/state/log/*.log does not exist -- skipping913vm-test-run-nixbot-gitlab> gitlab # [ 7.539457] logrotate[1050]: Creating new state914vm-test-run-nixbot-gitlab> gitlab # [ 7.539882] logrotate[1050]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1050)915vm-test-run-nixbot-gitlab> gitlab # [ 7.540325] logrotate[1050]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed916vm-test-run-nixbot-gitlab> gitlab # [ 7.540826] logrotate[1050]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1050)917vm-test-run-nixbot-gitlab> gitlab # [ 7.541422] logrotate[1050]: considering log /var/log/nginx/*.log918vm-test-run-nixbot-gitlab> gitlab # [ 7.541954] logrotate[1050]: log /var/log/nginx/*.log does not exist -- skipping919vm-test-run-nixbot-gitlab> gitlab # [ 7.542560] logrotate[1050]: Creating new state920vm-test-run-nixbot-gitlab> gitlab # [ 7.542978] logrotate[1050]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1050)921vm-test-run-nixbot-gitlab> gitlab # [ 7.543716] systemd[1]: Starting resolvconf update...922vm-test-run-nixbot-gitlab> gitlab # [ 7.544601] systemd[1]: Finished Logrotate configuration check.923vm-test-run-nixbot-gitlab> gitlab # [ 7.545144] systemd[1]: Finished Post-Boot Actions.924vm-test-run-nixbot-gitlab> gitlab # [ 7.545741] systemd[1]: Finished Import lastlog data into lastlog2 database.925vm-test-run-nixbot-gitlab> gitlab # [ 7.561145] nsncd[1051]: Jul 25 07:13:49.631 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"926vm-test-run-nixbot-gitlab> gitlab # [ 7.561843] systemd[1]: Started Name Service Cache Daemon (nsncd).927vm-test-run-nixbot-gitlab> gitlab # [ 7.562536] systemd[1]: Reached target Host and Network Name Lookups.928vm-test-run-nixbot-gitlab> gitlab # [ 7.563110] systemd[1]: Reached target User and Group Name Lookups.929vm-test-run-nixbot-gitlab> gitlab # [ 7.568063] systemd[1]: Starting User Login Management...930vm-test-run-nixbot-gitlab> gitlab # [ 7.576153] systemd[1]: Stopped target Host and Network Name Lookups.931vm-test-run-nixbot-gitlab> gitlab # [ 7.578212] systemd[1]: Stopping Host and Network Name Lookups...932vm-test-run-nixbot-gitlab> gitlab # [ 7.578699] systemd[1]: Stopped target User and Group Name Lookups.933vm-test-run-nixbot-gitlab> gitlab # [ 7.579117] systemd[1]: Stopping User and Group Name Lookups...934vm-test-run-nixbot-gitlab> gitlab # [ 7.579573] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...935vm-test-run-nixbot-gitlab> gitlab # [ 7.581222] systemd[1]: nscd.service: Deactivated successfully.936vm-test-run-nixbot-gitlab> gitlab # [ 7.582108] systemd[1]: Stopped Name Service Cache Daemon (nsncd).937vm-test-run-nixbot-gitlab> gitlab # [ 7.582907] systemd[1]: nscd.service: Consumed 27ms CPU time over 91ms wall clock time, 8M memory peak, 5.7M read from disk.938vm-test-run-nixbot-gitlab> gitlab # [ 7.587552] systemd[1]: Starting Name Service Cache Daemon (nsncd)...939vm-test-run-nixbot-gitlab> gitlab # [ 7.602542] systemd[1]: Started Name Service Cache Daemon (nsncd).940vm-test-run-nixbot-gitlab> gitlab # [ 7.603448] nsncd[1135]: Jul 25 07:13:49.673 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"941vm-test-run-nixbot-gitlab> gitlab # [ 7.605234] systemd[1]: Reached target Host and Network Name Lookups.942vm-test-run-nixbot-gitlab> gitlab # [ 7.606249] systemd[1]: Reached target User and Group Name Lookups.943vm-test-run-nixbot-gitlab> gitlab # [ 7.610110] systemd[1]: Finished resolvconf update.944vm-test-run-nixbot-gitlab> gitlab # [ 7.610750] systemd[1]: Reached target Preparation for Network.945vm-test-run-nixbot-gitlab> gitlab # [ 7.612689] systemd[1]: Starting DHCP Client...946vm-test-run-nixbot-gitlab> gitlab # [ 7.614305] systemd[1]: Starting Address configuration of eth1...947vm-test-run-nixbot-gitlab> gitlab # [ 7.616359] systemd[1]: Starting Extra networking commands....948vm-test-run-nixbot-gitlab> gitlab # [ 7.617910] systemd-logind[1111]: New seat seat0.949vm-test-run-nixbot-gitlab> gitlab # [ 7.620198] systemd-logind[1111]: Watching system buttons on /dev/input/event2 (Power Button)950vm-test-run-nixbot-gitlab> gitlab # [ 7.620839] systemd-logind[1111]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)951vm-test-run-nixbot-gitlab> gitlab # [ 7.621383] systemd-logind[1111]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)952vm-test-run-nixbot-gitlab> gitlab # [ 7.624948] systemd[1]: Started User Login Management.953vm-test-run-nixbot-gitlab> gitlab # [ 7.629277] systemd[1]: Starting linger-users.service...954vm-test-run-nixbot-gitlab> gitlab # [ 7.642373] systemd[1]: linger-users.service: Deactivated successfully.955vm-test-run-nixbot-gitlab> gitlab # [ 7.643027] systemd[1]: Finished linger-users.service.956vm-test-run-nixbot-gitlab> gitlab # [ 7.649250] network-addresses-eth1-start[1160]: adding address 192.168.1.1/24... done957vm-test-run-nixbot-gitlab> gitlab # [ 7.652392] network-addresses-eth1-start[1160]: adding address 2001:db8:1::1/64... done958vm-test-run-nixbot-gitlab> gitlab # [ 7.657336] systemd[1]: Finished Address configuration of eth1.959vm-test-run-nixbot-gitlab> gitlab # [ 7.679337] systemd[1]: Finished Extra networking commands..960vm-test-run-nixbot-gitlab> gitlab # [ 7.680074] systemd[1]: Reached target Network.961vm-test-run-nixbot-gitlab> gitlab # [ 7.682107] systemd[1]: Starting gitlab-workhorse.service...962vm-test-run-nixbot-gitlab> gitlab # [ 7.686098] systemd[1]: Starting Nginx Web Server...963vm-test-run-nixbot-gitlab> gitlab # [ 7.687355] systemd[1]: Starting PostgreSQL Server...964vm-test-run-nixbot-gitlab> gitlab # [ 7.688685] systemd[1]: Starting Redis Server - redis-gitlab...965vm-test-run-nixbot-gitlab> gitlab # [ 7.691768] dhcpcd[1178]: dhcpcd-10.3.2 starting966vm-test-run-nixbot-gitlab> gitlab # [ 7.692994] systemd[1]: Starting Permit User Sessions...967vm-test-run-nixbot-gitlab> gitlab # [ 7.695377] dhcpcd[1226]: dev: loaded udev968vm-test-run-nixbot-gitlab> gitlab # [ 7.835822] 8021q: 802.1Q VLAN Support v1.8969vm-test-run-nixbot-gitlab> gitlab # [ 7.836401] 8021q: adding VLAN 0 to HW filter on device eth1970vm-test-run-nixbot-gitlab> gitlab # [ 7.708925] systemd[1]: Finished Permit User Sessions.971vm-test-run-nixbot-gitlab> gitlab # [ 7.714135] systemd[1]: Started Getty on tty1.972vm-test-run-nixbot-gitlab> gitlab # [ 7.715262] systemd[1]: Reached target Login Prompts.973vm-test-run-nixbot-gitlab> gitlab # [ 7.721542] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.974vm-test-run-nixbot-gitlab> gitlab # [ 7.928120] cfg80211: Loading compiled-in X.509 certificates for regulatory database975vm-test-run-nixbot-gitlab> gitlab # [ 7.934911] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'976vm-test-run-nixbot-gitlab> gitlab # [ 7.936972] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'977vm-test-run-nixbot-gitlab> gitlab # [ 7.938789] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2978vm-test-run-nixbot-gitlab> gitlab # [ 7.939930] cfg80211: failed to load regulatory.db979vm-test-run-nixbot-gitlab> gitlab # [ 7.813279] redis-server[1244]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.980vm-test-run-nixbot-gitlab> gitlab # [ 7.815182] redis-server[1244]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo981vm-test-run-nixbot-gitlab> gitlab # [ 7.816283] redis-server[1244]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1244, just started982vm-test-run-nixbot-gitlab> gitlab # [ 7.818076] nginx-pre-start[1246]: nginx: the configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf syntax is ok983vm-test-run-nixbot-gitlab> gitlab # [ 7.819922] nginx-pre-start[1246]: nginx: configuration file /nix/store/nlpb2pnbsk0921apkv5yml2qxbm30d7w-nginx.conf test is successful984vm-test-run-nixbot-gitlab> gitlab # [ 7.822102] redis-server[1244]: Configuration loaded985vm-test-run-nixbot-gitlab> gitlab # [ 7.823121] systemd[1]: Started Redis Server - redis-gitlab.986vm-test-run-nixbot-gitlab> gitlab # [ 7.824104] redis[1244]: monotonic clock: POSIX clock_gettime987vm-test-run-nixbot-gitlab> gitlab # [ 7.825212] systemd[1]: Started Nginx Web Server.988vm-test-run-nixbot-gitlab> gitlab # [ 7.825939] redis[1244]: Running mode=standalone, port=0.989vm-test-run-nixbot-gitlab> gitlab # [ 7.826885] redis[1244]: Server initialized990vm-test-run-nixbot-gitlab> gitlab # [ 7.827730] redis[1244]: Ready to accept connections unix991vm-test-run-nixbot-gitlab> gitlab # [ 7.828854] redis[1244]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.992vm-test-run-nixbot-gitlab> gitlab # [ 7.968489] 8021q: adding VLAN 0 to HW filter on device eth0993vm-test-run-nixbot-gitlab> gitlab # [ 7.838248] dhcpcd[1226]: eth0: waiting for carrier994vm-test-run-nixbot-gitlab> gitlab # [ 7.839245] dhcpcd[1226]: eth0: carrier acquired995vm-test-run-nixbot-gitlab> gitlab # [ 7.842704] dhcpcd[1226]: DUID 00:01:00:01:31:f7:1e:ad:52:54:00:12:34:56996vm-test-run-nixbot-gitlab> gitlab # [ 7.843514] dhcpcd[1226]: eth0: IAID 00:12:34:56997vm-test-run-nixbot-gitlab> gitlab # [ 7.844151] dhcpcd[1226]: eth0: adding address fe80::5054:ff:fe12:3456998vm-test-run-nixbot-gitlab> gitlab # [ 7.848104] postgresql-pre-start[1248]: The files belonging to this database system will be owned by user "postgres".999vm-test-run-nixbot-gitlab> gitlab # [ 7.849655] postgresql-pre-start[1248]: This user must also own the server process.1000vm-test-run-nixbot-gitlab> gitlab # [ 7.852818] postgresql-pre-start[1248]: The database cluster will be initialized with locale "en_US.UTF-8".1001vm-test-run-nixbot-gitlab> gitlab # [ 7.854110] postgresql-pre-start[1248]: The default database encoding has accordingly been set to "UTF8".1002vm-test-run-nixbot-gitlab> gitlab # [ 7.855270] postgresql-pre-start[1248]: The default text search configuration will be set to "english".1003vm-test-run-nixbot-gitlab> gitlab # [ 7.856409] postgresql-pre-start[1248]: Data page checksums are disabled.1004vm-test-run-nixbot-gitlab> gitlab # [ 7.857307] postgresql-pre-start[1248]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1005vm-test-run-nixbot-gitlab> gitlab # [ 7.860796] postgresql-pre-start[1248]: creating subdirectories ... ok1006vm-test-run-nixbot-gitlab> gitlab # [ 7.861889] postgresql-pre-start[1248]: selecting dynamic shared memory implementation ... posix1007vm-test-run-nixbot-gitlab> gitlab # [ 7.882041] postgresql-pre-start[1248]: selecting default "max_connections" ... 1001008vm-test-run-nixbot-gitlab> gitlab # [ 7.913987] postgresql-pre-start[1248]: selecting default "shared_buffers" ... 128MB1009vm-test-run-nixbot-gitlab> gitlab # [ 8.126820] systemd[1]: Started gitlab-workhorse.service.1010vm-test-run-nixbot-gitlab> gitlab # [ 8.242933] postgresql-pre-start[1248]: selecting default time zone ... UTC1011vm-test-run-nixbot-gitlab> gitlab # [ 8.244864] postgresql-pre-start[1248]: creating configuration files ... ok1012vm-test-run-nixbot-gitlab> gitlab # [ 8.353745] gitlab-workhorse[1281]: time="2026-07-25T07:13:50Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41013vm-test-run-nixbot-gitlab> gitlab # [ 8.355261] gitlab-workhorse[1281]: time="2026-07-25T07:13:50Z" level=info msg="Using redis/go-redis"1014vm-test-run-nixbot-gitlab> gitlab # [ 8.356474] gitlab-workhorse[1281]: time="2026-07-25T07:13:50Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1015vm-test-run-nixbot-gitlab> gitlab # [ 8.420286] postgresql-pre-start[1248]: running bootstrap script ... ok1016vm-test-run-nixbot-gitlab> gitlab # [ 8.597412] dhcpcd[1226]: eth0: soliciting a DHCP lease1017vm-test-run-nixbot-gitlab> gitlab # [ 8.739473] NET: Registered PF_PACKET protocol family1018vm-test-run-nixbot-gitlab> gitlab # [ 8.610662] dhcpcd[1226]: eth0: offered 10.0.2.15 from 10.0.2.21019vm-test-run-nixbot-gitlab> gitlab # [ 8.615310] dhcpcd[1226]: eth0: probing address 10.0.2.15/241020vm-test-run-nixbot-gitlab> gitlab # [ 8.859645] postgresql-pre-start[1248]: performing post-bootstrap initialization ... ok1021vm-test-run-nixbot-gitlab> gitlab # [ 9.135973] postgresql-pre-start[1248]: syncing data to disk ... ok1022vm-test-run-nixbot-gitlab> gitlab # [ 9.138182] postgresql-pre-start[1248]: initdb: warning: enabling "trust" authentication for local connections1023vm-test-run-nixbot-gitlab> gitlab # [ 9.141121] postgresql-pre-start[1248]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1024vm-test-run-nixbot-gitlab> gitlab # [ 9.145516] postgresql-pre-start[1248]: Success. You can now start the database server using:1025vm-test-run-nixbot-gitlab> gitlab # [ 9.147962] postgresql-pre-start[1248]: pg_ctl -D /var/lib/postgresql/17 -l logfile start1026vm-test-run-nixbot-gitlab> gitlab # [ 9.254796] postgres[1308]: [1308] LOG: starting PostgreSQL 17.10 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1027vm-test-run-nixbot-gitlab> gitlab # [ 9.258444] postgres[1308]: [1308] LOG: listening on IPv6 address "::1", port 54321028vm-test-run-nixbot-gitlab> gitlab # [ 9.260853] postgres[1308]: [1308] LOG: listening on IPv4 address "127.0.0.1", port 54321029vm-test-run-nixbot-gitlab> gitlab # [ 9.263392] postgres[1308]: [1308] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1030vm-test-run-nixbot-gitlab> gitlab # [ 9.273666] postgres[1318]: [1318] LOG: database system was shut down at 2026-07-25 07:13:50 GMT1031vm-test-run-nixbot-gitlab> gitlab # [ 9.282520] postgres[1308]: [1308] LOG: database system is ready to accept connections1032vm-test-run-nixbot-gitlab> gitlab # [ 9.287486] systemd[1]: Started PostgreSQL Server.1033vm-test-run-nixbot-gitlab> gitlab # [ 9.289690] systemd[1]: Starting PostgreSQL Setup Scripts...1034vm-test-run-nixbot-gitlab> gitlab # [ 9.401310] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1315]: mkdir -p /var/gitlab/state/home/.ssh: OK1035vm-test-run-nixbot-gitlab> gitlab # [ 9.403563] 119c5p75zqwmpdrsjsd5cszxwrq2hgfq-gitlab-config[1315]: chmod 700 /var/gitlab/state/home/.ssh: OK1036vm-test-run-nixbot-gitlab> gitlab # [ 9.456575] postgresql-setup-start[1330]: CREATE DATABASE1037vm-test-run-nixbot-gitlab> gitlab # [ 9.460073] systemd[1]: Finished gitlab-config.service.1038vm-test-run-nixbot-gitlab> gitlab # [ 9.463752] systemd[1]: Started gitaly.service.1039vm-test-run-nixbot-gitlab> gitlab # [ 9.479263] postgresql-setup-start[1348]: CREATE ROLE1040vm-test-run-nixbot-gitlab> gitlab # [ 9.495597] postgresql-setup-start[1351]: ALTER DATABASE1041vm-test-run-nixbot-gitlab> gitlab # [ 9.519946] postgresql-setup-start[1356]: CREATE ROLE1042vm-test-run-nixbot-gitlab> gitlab # [ 9.523051] systemd[1]: Finished PostgreSQL Setup Scripts.1043vm-test-run-nixbot-gitlab> gitlab # [ 9.523944] systemd[1]: Reached target PostgreSQL.1044vm-test-run-nixbot-gitlab> gitlab # [ 9.526512] systemd[1]: Starting gitlab-db-config.service...1045vm-test-run-nixbot-gitlab> gitlab # [ 9.528177] systemd[1]: Starting gitlab-postgresql.service...1046vm-test-run-nixbot-gitlab> gitlab # [ 9.631200] gitlab-postgresql-start[1366]: CREATE DATABASE1047vm-test-run-nixbot-gitlab> gitlab # [ 9.670534] gitlab-postgresql-start[1376]: CREATE EXTENSION1048vm-test-run-nixbot-gitlab> gitlab # [ 9.710581] gitlab-postgresql-start[1382]: CREATE EXTENSION1049vm-test-run-nixbot-gitlab> gitlab # [ 9.713426] systemd[1]: Finished gitlab-postgresql.service.1050vm-test-run-nixbot-gitlab> gitlab # [ 9.945463] gitaly[1347]: time="2026-07-25T07:13:52.015Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/2wcq0nlg508fs5wq7jnpg1lw2pib950g-gitaly.toml' and fix the errors that are printed." pid=13471051vm-test-run-nixbot-gitlab> gitlab # [ 9.946814] gitaly[1347]: time="2026-07-25T07:13:52.015Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13471052vm-test-run-nixbot-gitlab> gitlab # [ 9.947879] gitaly[1347]: time="2026-07-25T07:13:52.015Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13471053vm-test-run-nixbot-gitlab> gitlab # [ 9.948658] gitaly[1347]: time="2026-07-25T07:13:52.015Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13471054vm-test-run-nixbot-gitlab> gitlab # [ 9.949473] gitaly[1347]: time="2026-07-25T07:13:52.015Z" level=info msg="Starting Gitaly" pid=1347 version=18.11.41055vm-test-run-nixbot-gitlab> gitlab # [ 9.968218] dhcpcd[1226]: eth0: soliciting an IPv6 router1056vm-test-run-nixbot-gitlab> gitlab # [ 9.969835] dhcpcd[1226]: eth0: Router Advertisement from fe80::21057vm-test-run-nixbot-gitlab> gitlab # [ 9.970690] dhcpcd[1226]: eth0: adding address fec0::5054:ff:fe12:3456/641058vm-test-run-nixbot-gitlab> gitlab # [ 9.971581] dhcpcd[1226]: eth0: adding route to fec0::/641059vm-test-run-nixbot-gitlab> gitlab # [ 9.972540] dhcpcd[1226]: eth0: adding default route via fe80::21060vm-test-run-nixbot-gitlab> gitlab # [ 10.144747] gitaly[1347]: time="2026-07-25T07:13:52.215Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=199 pid=13471061vm-test-run-nixbot-gitlab> gitlab # [ 10.145548] gitaly[1347]: time="2026-07-25T07:13:52.215Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13471062vm-test-run-nixbot-gitlab> gitlab # [ 10.148387] gitaly[1347]: time="2026-07-25T07:13:52.219Z" level=info msg="finished initializing command factory" duration_ms=3 pid=13471063vm-test-run-nixbot-gitlab> gitlab # [ 10.148865] gitaly[1347]: time="2026-07-25T07:13:52.219Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1347/git-exec-3820895893.d/git pid=13471064vm-test-run-nixbot-gitlab> gitlab # [ 10.155789] gitaly[1347]: time="2026-07-25T07:13:52.226Z" level=info msg="finished detecting git version" duration_ms=7 pid=13471065vm-test-run-nixbot-gitlab> gitlab # [ 10.156273] gitaly[1347]: time="2026-07-25T07:13:52.226Z" level=info msg="using Git version" pid=1347 version=2.53.g1066vm-test-run-nixbot-gitlab> gitlab # [ 10.156884] gitaly[1347]: time="2026-07-25T07:13:52.226Z" level=info msg="clearing disk cache object folder" pid=1347 storage=default1067vm-test-run-nixbot-gitlab> gitlab # [ 10.157598] gitaly[1347]: time="2026-07-25T07:13:52.227Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4041546167 pid=1347 storage=default1068vm-test-run-nixbot-gitlab> gitlab # [ 10.158419] gitaly[1347]: time="2026-07-25T07:13:52.227Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4041546167 pid=1347 storage=default1069vm-test-run-nixbot-gitlab> gitlab # [ 10.158975] gitaly[1347]: time="2026-07-25T07:13:52.227Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13471070vm-test-run-nixbot-gitlab> gitlab # [ 10.159300] gitaly[1347]: time="2026-07-25T07:13:52.227Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13471071vm-test-run-nixbot-gitlab> gitlab # [ 10.159904] gitaly[1347]: time="2026-07-25T07:13:52.229Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4041546167 clear_duration_ms=0 pid=1347 storage=default1072vm-test-run-nixbot-gitlab> gitlab # [ 10.205442] gitaly[1347]: time="2026-07-25T07:13:52.275Z" level=info msg="counting repositories" pid=13471073vm-test-run-nixbot-gitlab> gitlab # [ 10.206141] gitaly[1347]: time="2026-07-25T07:13:52.276Z" level=info msg="finished tempdir cleaner walk" pid=1347 storage=default time_ms=01074vm-test-run-nixbot-gitlab> gitlab # [ 10.206530] gitaly[1347]: time="2026-07-25T07:13:52.276Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13471075vm-test-run-nixbot-gitlab> gitlab # [ 10.207038] gitaly[1347]: time="2026-07-25T07:13:52.276Z" level=info msg="starting to count repositories" pid=1347 storage_path=/var/gitlab/state/repositories1076vm-test-run-nixbot-gitlab> gitlab # [ 10.207395] gitaly[1347]: time="2026-07-25T07:13:52.276Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1347 schema=unix1077vm-test-run-nixbot-gitlab> gitlab # [ 10.207852] gitaly[1347]: time="2026-07-25T07:13:52.276Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1347/sock.d/intern pid=1347 schema=unix1078vm-test-run-nixbot-gitlab> gitlab # [ 10.214851] gitaly[1347]: time="2026-07-25T07:13:52.285Z" level=info msg="completed counting repositories" counting_duration_ms=9 pid=1347 storage_path=/var/gitlab/state/repositories1079vm-test-run-nixbot-gitlab> gitlab # [ 10.215464] gitaly[1347]: time="2026-07-25T07:13:52.285Z" level=info msg="completed counting all repositories" counting_duration=9 pid=13471080vm-test-run-nixbot-gitlab> gitlab # [ 10.218632] gitaly[1347]: time="2026-07-25T07:13:52.289Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13471081vm-test-run-nixbot-gitlab> gitlab # [ 10.219754] gitaly[1347]: time="2026-07-25T07:13:52.289Z" level=info msg="Started Gitaly" duration_ms=273 pid=13471082vm-test-run-nixbot-gitlab> gitlab # [ 10.220951] gitaly[1347]: time="2026-07-25T07:13:52.289Z" level=info msg="maintenance: daily scheduled" pid=1347 scheduled="2026-07-25 12:00:00 +0000 UTC"1083vm-test-run-nixbot-gitlab> gitlab # [ 11.006370] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1364]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1084vm-test-run-nixbot-gitlab> gitlab # [ 11.008776] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1364]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1085vm-test-run-nixbot-gitlab> gitlab # [ 11.032361] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1364]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1086vm-test-run-nixbot-gitlab> gitlab # [ 12.152747] gitaly[1347]: time="2026-07-25T07:13:54.222Z" level=info msg="License database preloaded" duration_ms=2206 pid=13471087vm-test-run-nixbot-gitlab> gitlab # [ 13.683964] dhcpcd[1226]: eth0: leased 10.0.2.15 for 86400 seconds1088vm-test-run-nixbot-gitlab> gitlab # [ 13.686150] dhcpcd[1226]: eth0: adding route to 10.0.2.0/241089vm-test-run-nixbot-gitlab> gitlab # [ 13.687917] dhcpcd[1226]: eth0: adding default route via 10.0.2.21090vm-test-run-nixbot-gitlab> gitlab # [ 13.764890] systemd[1]: Started DHCP Client.1091vm-test-run-nixbot-gitlab> gitlab # [ 13.766475] systemd[1]: Reached target Network is Online.1092vm-test-run-nixbot-gitlab> gitlab # [ 39.932476] postgres[1721]: [1721] ERROR: relation "feature_gates" does not exist at character 5231093vm-test-run-nixbot-gitlab> gitlab # [ 39.935650] postgres[1721]: [1721] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1094vm-test-run-nixbot-gitlab> gitlab # [ 39.938365] postgres[1721]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1095vm-test-run-nixbot-gitlab> gitlab # [ 39.941205] postgres[1721]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1096vm-test-run-nixbot-gitlab> gitlab # [ 39.943823] postgres[1721]: attidentity AS identity,1097vm-test-run-nixbot-gitlab> gitlab # [ 39.945572] postgres[1721]: attgenerated as attgenerated1098vm-test-run-nixbot-gitlab> gitlab # [ 39.947453] postgres[1721]: FROM pg_attribute a1099vm-test-run-nixbot-gitlab> gitlab # [ 39.948992] postgres[1721]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1100vm-test-run-nixbot-gitlab> gitlab # [ 39.951745] postgres[1721]: LEFT JOIN pg_type t ON a.atttypid = t.oid1101vm-test-run-nixbot-gitlab> gitlab # [ 39.953775] postgres[1721]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1102vm-test-run-nixbot-gitlab> gitlab # [ 39.956931] postgres[1721]: WHERE a.attrelid = '"feature_gates"'::regclass1103vm-test-run-nixbot-gitlab> gitlab # [ 39.959184] postgres[1721]: AND a.attnum > 0 AND NOT a.attisdropped1104vm-test-run-nixbot-gitlab> gitlab # [ 39.961220] postgres[1721]: ORDER BY a.attnum1105vm-test-run-nixbot-gitlab> gitlab # [ 39.962712] postgres[1721]:1106vm-test-run-nixbot-gitlab> gitlab # [ 40.119936] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1364]: W, [2026-07-25T07:14:22.189948 #1364] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1107vm-test-run-nixbot-gitlab> gitlab # [ 45.103062] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1776]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1108vm-test-run-nixbot-gitlab> gitlab # [ 45.107410] ibq8wv904zk2qy52df1dc0x5kfbjfac2-gitlab-db-config[1776]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1109vm-test-run-nixbot-gitlab> gitlab # [ 48.407990] gitlab-workhorse[1281]: time="2026-07-25T07:14:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1110vm-test-run-nixbot-gitlab> gitlab # [ 58.409231] gitlab-workhorse[1281]: time="2026-07-25T07:14:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1111vm-test-run-nixbot-gitlab> gitlab # [ 58.777842] postgres[1842]: [1842] ERROR: relation "table_without_models" does not exist1112vm-test-run-nixbot-gitlab> gitlab # [ 58.779303] postgres[1842]: [1842] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1113vm-test-run-nixbot-gitlab> gitlab # [ 68.419451] gitlab-workhorse[1281]: time="2026-07-25T07:14:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1114vm-test-run-nixbot-gitlab> gitlab # [ 71.181900] systemd[1]: Finished gitlab-db-config.service.1115vm-test-run-nixbot-gitlab> gitlab # [ 71.183718] systemd[1]: Started gitlab-sidekiq.service.1116vm-test-run-nixbot-gitlab> gitlab # [ 71.185417] systemd[1]: Starting gitlab.service...1117vm-test-run-nixbot-gitlab> gitlab # [ 71.514433] bundle[2009]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1118vm-test-run-nixbot-gitlab> gitlab # [ 71.515721] bundle[2009]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1119vm-test-run-nixbot-gitlab> gitlab # [ 71.518691] bundle[2009]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1120vm-test-run-nixbot-gitlab> gitlab # [ 74.187890] sidekiq-cluster[2008]: {"severity":"INFO","time":"2026-07-25T07:14:56.241Z","message":"Starting cluster with 1 processes"}1121vm-test-run-nixbot-gitlab> gitlab # [ 74.295574] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.345Z","pid":2009,"message":"* Enabling systemd notification integration"}1122vm-test-run-nixbot-gitlab> gitlab # [ 74.296687] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"Puma starting in cluster mode..."}1123vm-test-run-nixbot-gitlab> gitlab # [ 74.297570] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1124vm-test-run-nixbot-gitlab> gitlab # [ 74.298385] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1125vm-test-run-nixbot-gitlab> gitlab # [ 74.299072] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"* Min threads: 0"}1126vm-test-run-nixbot-gitlab> gitlab # [ 74.299807] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"* Max threads: 4"}1127vm-test-run-nixbot-gitlab> gitlab # [ 74.300417] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"* Environment: production"}1128vm-test-run-nixbot-gitlab> gitlab # [ 74.301090] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"* Master PID: 2009"}1129vm-test-run-nixbot-gitlab> gitlab # [ 74.301730] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"* Workers: 2"}1130vm-test-run-nixbot-gitlab> gitlab # [ 74.302475] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1131vm-test-run-nixbot-gitlab> gitlab # [ 74.303161] bundle[2009]: {"timestamp":"2026-07-25T07:14:56.365Z","pid":2009,"message":"* Preloading application"}1132vm-test-run-nixbot-gitlab> gitlab # [ 78.428876] gitlab-workhorse[1281]: time="2026-07-25T07:15:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1133vm-test-run-nixbot-gitlab> gitlab # [ 88.439107] gitlab-workhorse[1281]: time="2026-07-25T07:15:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1134vm-test-run-nixbot-gitlab> gitlab # [ 96.524602] bundle[2009]: W, [2026-07-25T07:15:18.594358 #2009] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1135vm-test-run-nixbot-gitlab> gitlab # [ 98.440240] gitlab-workhorse[1281]: time="2026-07-25T07:15:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1136vm-test-run-nixbot-gitlab> gitlab # [ 99.066533] sidekiq-cluster[2039]: 2026-07-25T07:15:21.136Z pid=2039 tid=u4f INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2039, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>429510656}1137vm-test-run-nixbot-gitlab> gitlab # [ 99.240719] sidekiq-cluster[2039]: W, [2026-07-25T07:15:21.311146 #2039] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1138vm-test-run-nixbot-gitlab> gitlab # [ 99.280616] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:21.351Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1139vm-test-run-nixbot-gitlab> gitlab # [ 101.016132] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.085Z","message":"GitLab reliable fetch activated!"}1140vm-test-run-nixbot-gitlab> gitlab # [ 101.018317] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.086Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1141vm-test-run-nixbot-gitlab> gitlab # [ 101.047891] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.118Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1142vm-test-run-nixbot-gitlab> gitlab # [ 101.054905] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.125Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1143vm-test-run-nixbot-gitlab> gitlab # [ 101.064393] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.134Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1144vm-test-run-nixbot-gitlab> gitlab # [ 101.073858] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.144Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1145vm-test-run-nixbot-gitlab> gitlab # [ 101.081729] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.152Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1146vm-test-run-nixbot-gitlab> gitlab # [ 101.089507] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.160Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1147vm-test-run-nixbot-gitlab> gitlab # [ 101.096761] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.167Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1148vm-test-run-nixbot-gitlab> gitlab # [ 101.104305] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.174Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1149vm-test-run-nixbot-gitlab> gitlab # [ 101.111738] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.182Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1150vm-test-run-nixbot-gitlab> gitlab # [ 101.120353] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.190Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1151vm-test-run-nixbot-gitlab> gitlab # [ 101.125707] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.196Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1152vm-test-run-nixbot-gitlab> gitlab # [ 101.130544] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.200Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1153vm-test-run-nixbot-gitlab> gitlab # [ 101.134355] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.204Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1154vm-test-run-nixbot-gitlab> gitlab # [ 101.138129] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.207Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1155vm-test-run-nixbot-gitlab> gitlab # [ 101.141802] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.211Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1156vm-test-run-nixbot-gitlab> gitlab # [ 101.145543] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.214Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1157vm-test-run-nixbot-gitlab> gitlab # [ 101.149855] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.218Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1158vm-test-run-nixbot-gitlab> gitlab # [ 101.152398] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.220Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1159vm-test-run-nixbot-gitlab> gitlab # [ 101.152933] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.222Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1160vm-test-run-nixbot-gitlab> gitlab # [ 101.157540] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.228Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1161vm-test-run-nixbot-gitlab> gitlab # [ 101.161547] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.232Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1162vm-test-run-nixbot-gitlab> gitlab # [ 101.166098] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.236Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1163vm-test-run-nixbot-gitlab> gitlab # [ 101.169720] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.240Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1164vm-test-run-nixbot-gitlab> gitlab # [ 101.172980] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.243Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1165vm-test-run-nixbot-gitlab> gitlab # [ 101.176528] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.247Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1166vm-test-run-nixbot-gitlab> gitlab # [ 101.180158] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.250Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1167vm-test-run-nixbot-gitlab> gitlab # [ 101.183881] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.254Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1168vm-test-run-nixbot-gitlab> gitlab # [ 101.187444] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.258Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1169vm-test-run-nixbot-gitlab> gitlab # [ 101.190944] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.261Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1170vm-test-run-nixbot-gitlab> gitlab # [ 101.194652] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.265Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1171vm-test-run-nixbot-gitlab> gitlab # [ 101.198332] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.269Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1172vm-test-run-nixbot-gitlab> gitlab # [ 101.201746] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.272Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1173vm-test-run-nixbot-gitlab> gitlab # [ 101.206107] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.276Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1174vm-test-run-nixbot-gitlab> gitlab # [ 101.210081] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.280Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1175vm-test-run-nixbot-gitlab> gitlab # [ 101.214497] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.285Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1176vm-test-run-nixbot-gitlab> gitlab # [ 101.218314] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.288Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1177vm-test-run-nixbot-gitlab> gitlab # [ 101.222494] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.293Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1178vm-test-run-nixbot-gitlab> gitlab # [ 101.227380] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.297Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1179vm-test-run-nixbot-gitlab> gitlab # [ 101.232805] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.303Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1180vm-test-run-nixbot-gitlab> gitlab # [ 101.236872] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.307Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1181vm-test-run-nixbot-gitlab> gitlab # [ 101.240881] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.311Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1182vm-test-run-nixbot-gitlab> gitlab # [ 101.245640] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.316Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1183vm-test-run-nixbot-gitlab> gitlab # [ 101.250617] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.321Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1184vm-test-run-nixbot-gitlab> gitlab # [ 101.255250] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.325Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1185vm-test-run-nixbot-gitlab> gitlab # [ 101.259564] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.330Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1186vm-test-run-nixbot-gitlab> gitlab # [ 101.264814] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.335Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1187vm-test-run-nixbot-gitlab> gitlab # [ 101.269620] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.340Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1188vm-test-run-nixbot-gitlab> gitlab # [ 101.273868] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.344Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1189vm-test-run-nixbot-gitlab> gitlab # [ 101.278659] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.349Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1190vm-test-run-nixbot-gitlab> gitlab # [ 101.285652] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.356Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1191vm-test-run-nixbot-gitlab> gitlab # [ 101.291601] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.362Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1192vm-test-run-nixbot-gitlab> gitlab # [ 101.297245] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.367Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1193vm-test-run-nixbot-gitlab> gitlab # [ 101.303337] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.373Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1194vm-test-run-nixbot-gitlab> gitlab # [ 101.322381] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.392Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1195vm-test-run-nixbot-gitlab> gitlab # [ 101.328096] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.398Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1196vm-test-run-nixbot-gitlab> gitlab # [ 101.333200] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.403Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1197vm-test-run-nixbot-gitlab> gitlab # [ 101.338107] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.408Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1198vm-test-run-nixbot-gitlab> gitlab # [ 101.342804] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.413Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1199vm-test-run-nixbot-gitlab> gitlab # [ 101.348457] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.419Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1200vm-test-run-nixbot-gitlab> gitlab # [ 101.352981] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.423Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1201vm-test-run-nixbot-gitlab> gitlab # [ 101.359864] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.430Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1202vm-test-run-nixbot-gitlab> gitlab # [ 101.365314] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.435Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1203vm-test-run-nixbot-gitlab> gitlab # [ 101.369986] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.440Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1204vm-test-run-nixbot-gitlab> gitlab # [ 101.376067] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.446Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1205vm-test-run-nixbot-gitlab> gitlab # [ 101.382268] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.452Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1206vm-test-run-nixbot-gitlab> gitlab # [ 101.388064] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.458Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1207vm-test-run-nixbot-gitlab> gitlab # [ 101.394282] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.464Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1208vm-test-run-nixbot-gitlab> gitlab # [ 101.399188] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.469Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1209vm-test-run-nixbot-gitlab> gitlab # [ 101.404128] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.474Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1210vm-test-run-nixbot-gitlab> gitlab # [ 101.409266] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.479Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1211vm-test-run-nixbot-gitlab> gitlab # [ 101.414528] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.485Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1212vm-test-run-nixbot-gitlab> gitlab # [ 101.444085] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.514Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1213vm-test-run-nixbot-gitlab> gitlab # [ 101.449157] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.519Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1214vm-test-run-nixbot-gitlab> gitlab # [ 101.455198] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.525Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1215vm-test-run-nixbot-gitlab> gitlab # [ 101.461354] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.531Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1216vm-test-run-nixbot-gitlab> gitlab # [ 101.468861] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.539Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1217vm-test-run-nixbot-gitlab> gitlab # [ 101.475537] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.546Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1218vm-test-run-nixbot-gitlab> gitlab # [ 101.485210] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.555Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1219vm-test-run-nixbot-gitlab> gitlab # [ 101.492551] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.563Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1220vm-test-run-nixbot-gitlab> gitlab # [ 101.500360] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.570Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1221vm-test-run-nixbot-gitlab> gitlab # [ 101.507270] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.577Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1222vm-test-run-nixbot-gitlab> gitlab # [ 101.514537] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.585Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1223vm-test-run-nixbot-gitlab> gitlab # [ 101.522816] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.593Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1224vm-test-run-nixbot-gitlab> gitlab # [ 101.533089] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.603Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1225vm-test-run-nixbot-gitlab> gitlab # [ 101.540116] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.610Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1226vm-test-run-nixbot-gitlab> gitlab # [ 101.547909] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.618Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1227vm-test-run-nixbot-gitlab> gitlab # [ 101.557947] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.628Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1228vm-test-run-nixbot-gitlab> gitlab # [ 101.567203] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.636Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1229vm-test-run-nixbot-gitlab> gitlab # [ 101.574599] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.645Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1230vm-test-run-nixbot-gitlab> gitlab # [ 101.581785] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.652Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1231vm-test-run-nixbot-gitlab> gitlab # [ 101.589834] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.660Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1232vm-test-run-nixbot-gitlab> gitlab # [ 101.596851] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.667Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1233vm-test-run-nixbot-gitlab> gitlab # [ 101.605060] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.675Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1234vm-test-run-nixbot-gitlab> gitlab # [ 101.611971] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.682Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1235vm-test-run-nixbot-gitlab> gitlab # [ 101.620290] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.690Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1236vm-test-run-nixbot-gitlab> gitlab # [ 101.628051] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.698Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1237vm-test-run-nixbot-gitlab> gitlab # [ 101.637116] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.707Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1238vm-test-run-nixbot-gitlab> gitlab # [ 101.644191] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.714Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1239vm-test-run-nixbot-gitlab> gitlab # [ 101.651861] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.722Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1240vm-test-run-nixbot-gitlab> gitlab # [ 101.681313] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.751Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1241vm-test-run-nixbot-gitlab> gitlab # [ 101.690351] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.760Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1242vm-test-run-nixbot-gitlab> gitlab # [ 101.698970] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.769Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1243vm-test-run-nixbot-gitlab> gitlab # [ 101.708693] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.779Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1244vm-test-run-nixbot-gitlab> gitlab # [ 101.718101] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.788Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1245vm-test-run-nixbot-gitlab> gitlab # [ 101.726875] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.797Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1246vm-test-run-nixbot-gitlab> gitlab # [ 101.736736] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.807Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1247vm-test-run-nixbot-gitlab> gitlab # [ 101.744971] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.815Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1248vm-test-run-nixbot-gitlab> gitlab # [ 101.753348] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.823Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1249vm-test-run-nixbot-gitlab> gitlab # [ 101.762326] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.832Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1250vm-test-run-nixbot-gitlab> gitlab # [ 101.769765] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:23.840Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1251vm-test-run-nixbot-gitlab> gitlab # [ 104.557390] sidekiq-cluster[2039]: InitializerConnections Query: SET client_min_messages TO 'warning'1252vm-test-run-nixbot-gitlab> gitlab # [ 104.559695] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1253vm-test-run-nixbot-gitlab> gitlab # [ 104.561306] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1254vm-test-run-nixbot-gitlab> gitlab # [ 104.562662] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1255vm-test-run-nixbot-gitlab> gitlab # [ 104.564121] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1256vm-test-run-nixbot-gitlab> gitlab # [ 104.565191] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1257vm-test-run-nixbot-gitlab> gitlab # [ 104.566266] sidekiq-cluster[2039]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1258vm-test-run-nixbot-gitlab> gitlab # [ 104.575486] sidekiq-cluster[2039]: InitializerConnections Query: SET standard_conforming_strings = on1259vm-test-run-nixbot-gitlab> gitlab # [ 104.577100] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1260vm-test-run-nixbot-gitlab> gitlab # [ 104.578307] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1261vm-test-run-nixbot-gitlab> gitlab # [ 104.579900] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1262vm-test-run-nixbot-gitlab> gitlab # [ 104.580806] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1263vm-test-run-nixbot-gitlab> gitlab # [ 104.581997] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1264vm-test-run-nixbot-gitlab> gitlab # [ 104.582973] sidekiq-cluster[2039]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1265vm-test-run-nixbot-gitlab> gitlab # [ 104.590807] sidekiq-cluster[2039]: InitializerConnections Query: SET intervalstyle = iso_86011266vm-test-run-nixbot-gitlab> gitlab # [ 104.591783] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1267vm-test-run-nixbot-gitlab> gitlab # [ 104.593092] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1268vm-test-run-nixbot-gitlab> gitlab # [ 104.593741] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1269vm-test-run-nixbot-gitlab> gitlab # [ 104.594599] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1270vm-test-run-nixbot-gitlab> gitlab # [ 104.595424] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1271vm-test-run-nixbot-gitlab> gitlab # [ 104.596182] sidekiq-cluster[2039]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1272vm-test-run-nixbot-gitlab> gitlab # [ 104.607293] sidekiq-cluster[2039]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1273vm-test-run-nixbot-gitlab> gitlab # [ 104.608330] sidekiq-cluster[2039]: FROM pg_type as t1274vm-test-run-nixbot-gitlab> gitlab # [ 104.609114] sidekiq-cluster[2039]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1275vm-test-run-nixbot-gitlab> gitlab # [ 104.609779] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1276vm-test-run-nixbot-gitlab> gitlab # [ 104.610596] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1277vm-test-run-nixbot-gitlab> gitlab # [ 104.611399] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1278vm-test-run-nixbot-gitlab> gitlab # [ 104.612138] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1279vm-test-run-nixbot-gitlab> gitlab # [ 104.612739] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1280vm-test-run-nixbot-gitlab> gitlab # [ 104.613474] sidekiq-cluster[2039]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1281vm-test-run-nixbot-gitlab> gitlab # [ 104.621219] sidekiq-cluster[2039]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1282vm-test-run-nixbot-gitlab> gitlab # [ 104.622179] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1283vm-test-run-nixbot-gitlab> gitlab # [ 104.622901] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1284vm-test-run-nixbot-gitlab> gitlab # [ 104.623783] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1285vm-test-run-nixbot-gitlab> gitlab # [ 104.624447] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1286vm-test-run-nixbot-gitlab> gitlab # [ 104.625207] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1287vm-test-run-nixbot-gitlab> gitlab # [ 104.625828] sidekiq-cluster[2039]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1288vm-test-run-nixbot-gitlab> gitlab # [ 104.633050] sidekiq-cluster[2039]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1289vm-test-run-nixbot-gitlab> gitlab # [ 104.634002] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:341:in `block in current_feature_value'1290vm-test-run-nixbot-gitlab> gitlab # [ 104.634823] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:356:in `with_feature'1291vm-test-run-nixbot-gitlab> gitlab # [ 104.635494] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:337:in `current_feature_value'1292vm-test-run-nixbot-gitlab> gitlab # [ 104.636280] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/feature.rb:130:in `enabled?'1293vm-test-run-nixbot-gitlab> gitlab # [ 104.636953] sidekiq-cluster[2039]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1294vm-test-run-nixbot-gitlab> gitlab # [ 104.637674] sidekiq-cluster[2039]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1295vm-test-run-nixbot-gitlab> gitlab # [ 108.441397] gitlab-workhorse[1281]: time="2026-07-25T07:15:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1296vm-test-run-nixbot-gitlab> gitlab # [ 118.451643] gitlab-workhorse[1281]: time="2026-07-25T07:15:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1297vm-test-run-nixbot-gitlab> gitlab # [ 122.119447] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:44.189Z","message":"Booted Rails 7.2.3 application in production environment"}1298vm-test-run-nixbot-gitlab> gitlab # [ 122.121700] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:44.189Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1299vm-test-run-nixbot-gitlab> gitlab # [ 122.123223] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:44.189Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1300vm-test-run-nixbot-gitlab> gitlab # [ 122.123899] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:44.190Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1301vm-test-run-nixbot-gitlab> gitlab # [ 122.135802] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:44.206Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1302vm-test-run-nixbot-gitlab> gitlab # [ 123.309899] bundle[2009]: {"timestamp":"2026-07-25T07:15:45.379Z","pid":2009,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1303vm-test-run-nixbot-gitlab> gitlab # [ 123.311245] bundle[2009]: {"timestamp":"2026-07-25T07:15:45.380Z","pid":2009,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1304vm-test-run-nixbot-gitlab> gitlab # [ 123.313058] bundle[2009]: {"timestamp":"2026-07-25T07:15:45.380Z","pid":2009,"message":"! #\u003cThread:0x00007846a75896a0 /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/g5qraa51hgg5fl7n3da89ygf00qfv95x-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1305vm-test-run-nixbot-gitlab> gitlab # [ 123.314098] bundle[2009]: {"timestamp":"2026-07-25T07:15:45.380Z","pid":2009,"message":"! #\u003cThread:0x00007846a77c88d0 /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/wg5r0zmy3rh1kga7z4z7mbs298p0wxli-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1306vm-test-run-nixbot-gitlab> gitlab # [ 123.315200] bundle[2009]: {"timestamp":"2026-07-25T07:15:45.380Z","pid":2009,"message":"Use Ctrl-C to stop"}1307vm-test-run-nixbot-gitlab> gitlab # [ 123.329154] bundle[2009]: {"timestamp":"2026-07-25T07:15:45.380Z","pid":2009,"message":"Sending status to systemd every 1.0 sec"}1308vm-test-run-nixbot-gitlab> gitlab # [ 123.486916] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:45.556Z","message":"Cleaning working queues"}1309vm-test-run-nixbot-gitlab> gitlab # [ 123.489966] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:45.560Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ec2708c2c79622b99365eaaa","created_at":"2026-07-25T07:14:52.659Z","trace_propagation_headers":{"sentry-trace":"31c9b8b0be6a4865918fc38b307eff5c-7a84826d1df24909","baggage":"sentry-trace_id=31c9b8b0be6a4865918fc38b307eff5c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"daca22b5ea30324c5bd16625463e9b47","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T07:14:52.673Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ec2708c2c79622b99365eaaa: start","job_status":"start","queue_duration_s":52.887229,"scheduling_latency_s":52.887271}1310vm-test-run-nixbot-gitlab> gitlab # [ 123.633616] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:15:45.703Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"ec2708c2c79622b99365eaaa","created_at":"2026-07-25T07:14:52.659Z","trace_propagation_headers":{"sentry-trace":"31c9b8b0be6a4865918fc38b307eff5c-7a84826d1df24909","baggage":"sentry-trace_id=31c9b8b0be6a4865918fc38b307eff5c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"daca22b5ea30324c5bd16625463e9b47","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T07:14:52.673Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-ec2708c2c79622b99365eaaa: done: 0.143628 sec","job_status":"done","queue_duration_s":52.887229,"scheduling_latency_s":52.887271,"redis_calls":26,"redis_duration_s":0.003875,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002058,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001059,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000758,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07631388900000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.143628,"completed_at":"2026-07-25T07:15:45.703Z","load_balancing_strategy":"primary","db_duration_s":0.048121,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1311vm-test-run-nixbot-gitlab> gitlab # [ 123.673563] bundle[2009]: {"timestamp":"2026-07-25T07:15:45.744Z","pid":2009,"message":"- Worker 0 (PID: 2522) booted in 0.32s, phase: 0"}1312vm-test-run-nixbot-gitlab> gitlab # [ 123.695341] bundle[2009]: {"timestamp":"2026-07-25T07:15:45.765Z","pid":2009,"message":"- Worker 1 (PID: 2526) booted in 0.32s, phase: 0"}1313vm-test-run-nixbot-gitlab> gitlab # [ 123.698645] systemd[1]: Started gitlab.service.1314vm-test-run-nixbot-gitlab> gitlab # [ 123.699403] systemd[1]: Reached target Common target for all GitLab services..1315vm-test-run-nixbot-gitlab> gitlab # [ 123.700573] systemd[1]: Starting setup-gitlab.service...1316vm-test-run-nixbot-gitlab> gitlab # [ 123.719331] setup-gitlab-start[2557]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1317vm-test-run-nixbot-gitlab> gitlab # [ 126.023302] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:15:48 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 22791318vm-test-run-nixbot-gitlab> gitlab # [ 126.031479] setup-gitlab-start[2576]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1319vm-test-run-nixbot-gitlab> gitlab # [ 126.032746] setup-gitlab-start[2577]: ++ jq -r .access_token1320vm-test-run-nixbot-gitlab> gitlab # [ 126.768242] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:15:48 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 7141321vm-test-run-nixbot-gitlab> gitlab # [ 126.773737] setup-gitlab-start[2557]: + BEARER=2b8b82118a81118e2eade78024581a225f5188cb4d204d25d712198f66406ac21322vm-test-run-nixbot-gitlab> gitlab # [ 126.775531] setup-gitlab-start[2557]: + AUTH='Authorization: Bearer 2b8b82118a81118e2eade78024581a225f5188cb4d204d25d712198f66406ac2'1323vm-test-run-nixbot-gitlab> gitlab # [ 126.776863] setup-gitlab-start[2557]: + curl -fs -X PUT -H 'Authorization: Bearer 2b8b82118a81118e2eade78024581a225f5188cb4d204d25d712198f66406ac2' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1324vm-test-run-nixbot-gitlab> gitlab # [ 127.502072] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:15:49 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 7111325vm-test-run-nixbot-gitlab> gitlab # [ 127.507567] setup-gitlab-start[2557]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1326vm-test-run-nixbot-gitlab> gitlab # [ 127.523479] runuser[2595]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1327vm-test-run-nixbot-gitlab> gitlab # [ 127.841357] setup-gitlab-start[2596]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1328vm-test-run-nixbot-gitlab> gitlab # [ 127.843298] setup-gitlab-start[2596]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1329vm-test-run-nixbot-gitlab> gitlab # [ 127.845223] setup-gitlab-start[2596]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1330vm-test-run-nixbot-gitlab> gitlab # [ 128.381838] setup-gitlab-start[2596]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1331vm-test-run-nixbot-gitlab> gitlab # [ 128.383358] setup-gitlab-start[2596]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1332vm-test-run-nixbot-gitlab> gitlab # [ 128.385887] setup-gitlab-start[2596]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1333vm-test-run-nixbot-gitlab> gitlab # [ 140.009462] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"500292f4133cd0ead92ef729","created_at":"2026-07-25T07:16:02.044Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ca227fcde2a93687aec7f0efd0bbe25","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.076Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-500292f4133cd0ead92ef729: start","job_status":"start","queue_duration_s":0.002359,"scheduling_latency_s":0.002456}1334vm-test-run-nixbot-gitlab> gitlab # [ 140.107389] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"500292f4133cd0ead92ef729","created_at":"2026-07-25T07:16:02.044Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ca227fcde2a93687aec7f0efd0bbe25","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.076Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-500292f4133cd0ead92ef729: done: 0.099018 sec","job_status":"done","queue_duration_s":0.002359,"scheduling_latency_s":0.002456,"redis_calls":10,"redis_duration_s":0.00475,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001109,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000640026,"duration_s":0.099018,"completed_at":"2026-07-25T07:16:02.177Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015856,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335vm-test-run-nixbot-gitlab> gitlab # [ 140.150488] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.181Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"74432f279c1dcdfd81259d3a","created_at":"2026-07-25T07:16:02.086Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1382488e12b49c14f37ac86db410e955","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T07:16:02.111Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-74432f279c1dcdfd81259d3a: start","job_status":"start","queue_duration_s":0.070019,"scheduling_latency_s":0.070036}1336vm-test-run-nixbot-gitlab> gitlab # [ 140.151609] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.220Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1337vm-test-run-nixbot-gitlab> gitlab # [ 140.197100] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"74432f279c1dcdfd81259d3a","created_at":"2026-07-25T07:16:02.086Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1382488e12b49c14f37ac86db410e955","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-07-25T07:16:02.111Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-74432f279c1dcdfd81259d3a: done: 0.086091 sec","job_status":"done","queue_duration_s":0.070019,"scheduling_latency_s":0.070036,"redis_calls":10,"redis_duration_s":0.008552,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002079,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002348,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000735009,"duration_s":0.086091,"completed_at":"2026-07-25T07:16:02.267Z","load_balancing_strategy":"primary","db_duration_s":0.004089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338vm-test-run-nixbot-gitlab> gitlab # [ 140.235453] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"95025b3f623491f9b3195a8e","created_at":"2026-07-25T07:16:02.135Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21fbbcae4856bb62ccc53aad6e0c2139","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.142Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-95025b3f623491f9b3195a8e: start","job_status":"start","queue_duration_s":0.163269,"scheduling_latency_s":0.163295}1339vm-test-run-nixbot-gitlab> gitlab # [ 140.716092] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"95025b3f623491f9b3195a8e","created_at":"2026-07-25T07:16:02.135Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21fbbcae4856bb62ccc53aad6e0c2139","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.142Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-95025b3f623491f9b3195a8e: done: 0.480317 sec","job_status":"done","queue_duration_s":0.163269,"scheduling_latency_s":0.163295,"redis_calls":574,"redis_duration_s":0.271514,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.009976,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001851,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.259687,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.231187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000296407,"duration_s":0.480317,"completed_at":"2026-07-25T07:16:02.786Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340vm-test-run-nixbot-gitlab> gitlab # [ 140.787258] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.787Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e1a507e2dfbb78d5c3946460","created_at":"2026-07-25T07:16:02.148Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a83c7c1ea60e2e5a97b302eef699328b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.159Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e1a507e2dfbb78d5c3946460: start","job_status":"start","queue_duration_s":0.627831,"scheduling_latency_s":0.627846}1341vm-test-run-nixbot-gitlab> gitlab # [ 140.799160] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.815Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e1a507e2dfbb78d5c3946460","created_at":"2026-07-25T07:16:02.148Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a83c7c1ea60e2e5a97b302eef699328b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.159Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e1a507e2dfbb78d5c3946460: done: 0.027698 sec","job_status":"done","queue_duration_s":0.627831,"scheduling_latency_s":0.627846,"redis_calls":13,"redis_duration_s":0.00294,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000506,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001419,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.012063823,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.027698,"completed_at":"2026-07-25T07:16:02.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007175,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1342vm-test-run-nixbot-gitlab> gitlab # [ 140.839398] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.816Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"c6849fc1afa4a4bfcad33ae4","created_at":"2026-07-25T07:16:02.175Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"917e3bc940a686a5f0b5ab4d7c9ff6fc","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.185Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-c6849fc1afa4a4bfcad33ae4: start","job_status":"start","queue_duration_s":0.630687,"scheduling_latency_s":0.6307}1343vm-test-run-nixbot-gitlab> gitlab # [ 140.850162] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.830Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"c6849fc1afa4a4bfcad33ae4","created_at":"2026-07-25T07:16:02.175Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"917e3bc940a686a5f0b5ab4d7c9ff6fc","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.185Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-c6849fc1afa4a4bfcad33ae4: done: 0.013491 sec","job_status":"done","queue_duration_s":0.630687,"scheduling_latency_s":0.6307,"redis_calls":12,"redis_duration_s":0.00252,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000465,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000447,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000267353,"duration_s":0.013491,"completed_at":"2026-07-25T07:16:02.830Z","load_balancing_strategy":"primary","db_duration_s":0.000387,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344vm-test-run-nixbot-gitlab> gitlab # [ 140.868896] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.831Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"27e92f9b54bf74ef49a12552","created_at":"2026-07-25T07:16:02.195Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"699da41f07e43b2a3502c9dde852591d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.258Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-27e92f9b54bf74ef49a12552: start","job_status":"start","queue_duration_s":0.572142,"scheduling_latency_s":0.572154}1345vm-test-run-nixbot-gitlab> gitlab # [ 140.869579] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"27e92f9b54bf74ef49a12552","created_at":"2026-07-25T07:16:02.195Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"699da41f07e43b2a3502c9dde852591d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.258Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-27e92f9b54bf74ef49a12552: done: 0.014033 sec","job_status":"done","queue_duration_s":0.572142,"scheduling_latency_s":0.572154,"redis_calls":12,"redis_duration_s":0.0022429999999999998,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000798,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000251987,"duration_s":0.014033,"completed_at":"2026-07-25T07:16:02.845Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346vm-test-run-nixbot-gitlab> gitlab # [ 140.894076] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"03ad721dcf17c822040254e5","created_at":"2026-07-25T07:16:02.301Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3da1c52173430b9a422adb2c7cfaf57a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.313Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-03ad721dcf17c822040254e5: start","job_status":"start","queue_duration_s":0.532567,"scheduling_latency_s":0.532579}1347vm-test-run-nixbot-gitlab> gitlab # [ 140.905643] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"03ad721dcf17c822040254e5","created_at":"2026-07-25T07:16:02.301Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3da1c52173430b9a422adb2c7cfaf57a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.313Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-03ad721dcf17c822040254e5: done: 0.017184 sec","job_status":"done","queue_duration_s":0.532567,"scheduling_latency_s":0.532579,"redis_calls":12,"redis_duration_s":0.002406,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000411784,"exclusive_lock_hold_duration_s":0.0044905150000000005,"duration_s":0.017184,"completed_at":"2026-07-25T07:16:02.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348vm-test-run-nixbot-gitlab> gitlab # [ 140.941520] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4ca2c93e005b40680a8b3858","created_at":"2026-07-25T07:16:02.334Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e57a2beea2fa461e7158b7e61c1c8f2f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.346Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4ca2c93e005b40680a8b3858: start","job_status":"start","queue_duration_s":0.517867,"scheduling_latency_s":0.51788}1349vm-test-run-nixbot-gitlab> gitlab # [ 140.950589] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4ca2c93e005b40680a8b3858","created_at":"2026-07-25T07:16:02.334Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e57a2beea2fa461e7158b7e61c1c8f2f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.346Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4ca2c93e005b40680a8b3858: done: 0.016114 sec","job_status":"done","queue_duration_s":0.517867,"scheduling_latency_s":0.51788,"redis_calls":10,"redis_duration_s":0.002002,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000399,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025059,"duration_s":0.016114,"completed_at":"2026-07-25T07:16:02.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350vm-test-run-nixbot-gitlab> gitlab # [ 140.989058] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:02.881Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8a7aaf54ce1b393c4fcfa33a","created_at":"2026-07-25T07:16:02.353Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cef333351195e0fa7f3436b02ec7c1ec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.362Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8a7aaf54ce1b393c4fcfa33a: start","job_status":"start","queue_duration_s":0.519367,"scheduling_latency_s":0.519379}1351vm-test-run-nixbot-gitlab> gitlab # [ 141.010352] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.080Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"8a7aaf54ce1b393c4fcfa33a","created_at":"2026-07-25T07:16:02.353Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cef333351195e0fa7f3436b02ec7c1ec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.362Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-8a7aaf54ce1b393c4fcfa33a: done: 0.198864 sec","job_status":"done","queue_duration_s":0.519367,"scheduling_latency_s":0.519379,"redis_calls":12,"redis_duration_s":0.002696,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000814,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.165825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000467378,"exclusive_lock_hold_duration_s":0.154245302,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.198864,"completed_at":"2026-07-25T07:16:03.080Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352vm-test-run-nixbot-gitlab> gitlab # [ 141.048646] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ffae829fdc9a12215deaf08a","created_at":"2026-07-25T07:16:02.374Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20b4f70a6a6f3611713e049f9ba8fcff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.383Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ffae829fdc9a12215deaf08a: start","job_status":"start","queue_duration_s":0.697535,"scheduling_latency_s":0.697549}1353vm-test-run-nixbot-gitlab> gitlab # [ 141.049208] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.089Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1354vm-test-run-nixbot-gitlab> gitlab # [ 141.049632] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.093Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ffae829fdc9a12215deaf08a","created_at":"2026-07-25T07:16:02.374Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20b4f70a6a6f3611713e049f9ba8fcff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.383Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ffae829fdc9a12215deaf08a: done: 0.012023 sec","job_status":"done","queue_duration_s":0.697535,"scheduling_latency_s":0.697549,"redis_calls":10,"redis_duration_s":0.001447,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000345296,"duration_s":0.012023,"completed_at":"2026-07-25T07:16:03.093Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355vm-test-run-nixbot-gitlab> gitlab # [ 141.085633] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.094Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2e14ec96402894d9bcc61140","created_at":"2026-07-25T07:16:02.392Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eef845bb69eda9463c3874faffb93a27","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.402Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2e14ec96402894d9bcc61140: start","job_status":"start","queue_duration_s":0.69229,"scheduling_latency_s":0.692303}1356vm-test-run-nixbot-gitlab> gitlab # [ 141.121529] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2e14ec96402894d9bcc61140","created_at":"2026-07-25T07:16:02.392Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eef845bb69eda9463c3874faffb93a27","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.402Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2e14ec96402894d9bcc61140: done: 0.02089 sec","job_status":"done","queue_duration_s":0.69229,"scheduling_latency_s":0.692303,"redis_calls":10,"redis_duration_s":0.001606,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000374,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000255898,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.02089,"completed_at":"2026-07-25T07:16:03.115Z","load_balancing_strategy":"primary","db_duration_s":0.007028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357vm-test-run-nixbot-gitlab> gitlab # [ 141.124937] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"cf0ff11440a2c402746da47a","created_at":"2026-07-25T07:16:02.423Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2aae637a734dd8ce8538db3af8f65072","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.431Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-cf0ff11440a2c402746da47a: start","job_status":"start","queue_duration_s":0.684538,"scheduling_latency_s":0.68455}1358vm-test-run-nixbot-gitlab> gitlab # [ 141.136870] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"cf0ff11440a2c402746da47a","created_at":"2026-07-25T07:16:02.423Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2aae637a734dd8ce8538db3af8f65072","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.431Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-cf0ff11440a2c402746da47a: done: 0.011949 sec","job_status":"done","queue_duration_s":0.684538,"scheduling_latency_s":0.68455,"redis_calls":10,"redis_duration_s":0.001273,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000215111,"duration_s":0.011949,"completed_at":"2026-07-25T07:16:03.128Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359vm-test-run-nixbot-gitlab> gitlab # [ 141.195337] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.129Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e9dcc9419bbe83401f752799","created_at":"2026-07-25T07:16:02.440Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"641dabaaec45535f5b6ee42354e4666d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.447Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e9dcc9419bbe83401f752799: start","job_status":"start","queue_duration_s":0.681267,"scheduling_latency_s":0.681281}1360vm-test-run-nixbot-gitlab> gitlab # [ 141.195894] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e9dcc9419bbe83401f752799","created_at":"2026-07-25T07:16:02.440Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"641dabaaec45535f5b6ee42354e4666d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.447Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e9dcc9419bbe83401f752799: done: 0.136482 sec","job_status":"done","queue_duration_s":0.681267,"scheduling_latency_s":0.681281,"redis_calls":14,"redis_duration_s":0.001955,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":125,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000305626,"exclusive_lock_hold_duration_s":0.122295152,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.136482,"completed_at":"2026-07-25T07:16:03.265Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361vm-test-run-nixbot-gitlab> gitlab # [ 141.253211] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a86c5b1b75c754514458036f","created_at":"2026-07-25T07:16:02.458Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d70b44ced78290f2a1762e188b0ea1df","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T07:16:02.464Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a86c5b1b75c754514458036f: start","job_status":"start","queue_duration_s":0.802366,"scheduling_latency_s":0.80238}1362vm-test-run-nixbot-gitlab> gitlab # [ 141.253854] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.274Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1363vm-test-run-nixbot-gitlab> gitlab # [ 141.254411] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a86c5b1b75c754514458036f","created_at":"2026-07-25T07:16:02.458Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d70b44ced78290f2a1762e188b0ea1df","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-07-25T07:16:02.464Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a86c5b1b75c754514458036f: done: 0.012362 sec","job_status":"done","queue_duration_s":0.802366,"scheduling_latency_s":0.80238,"redis_calls":10,"redis_duration_s":0.001227,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000190527,"duration_s":0.012362,"completed_at":"2026-07-25T07:16:03.278Z","load_balancing_strategy":"primary","db_duration_s":0.000692,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364vm-test-run-nixbot-gitlab> gitlab # [ 141.265961] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"1bf008afb811c49049339e65","created_at":"2026-07-25T07:16:02.471Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.476Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-1bf008afb811c49049339e65: start","job_status":"start","queue_duration_s":0.803754,"scheduling_latency_s":0.803767}1365vm-test-run-nixbot-gitlab> gitlab # [ 141.277023] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"1bf008afb811c49049339e65","created_at":"2026-07-25T07:16:02.471Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.476Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-1bf008afb811c49049339e65: done: 0.058886 sec","job_status":"done","queue_duration_s":0.803754,"scheduling_latency_s":0.803767,"redis_calls":65,"redis_duration_s":0.008931,"redis_read_bytes":114,"redis_write_bytes":41332,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000506,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000482,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37035,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007535,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000408,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000202261,"duration_s":0.058886,"completed_at":"2026-07-25T07:16:03.338Z","load_balancing_strategy":"primary","db_duration_s":0.001232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366vm-test-run-nixbot-gitlab> gitlab # [ 141.332079] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5b5b0bc94298ce5fb26829ab","created_at":"2026-07-25T07:16:02.480Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.484Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5b5b0bc94298ce5fb26829ab: start","job_status":"start","queue_duration_s":0.855346,"scheduling_latency_s":0.855359}1367vm-test-run-nixbot-gitlab> gitlab # [ 141.332698] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5b5b0bc94298ce5fb26829ab","created_at":"2026-07-25T07:16:02.480Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.484Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5b5b0bc94298ce5fb26829ab: done: 0.023075 sec","job_status":"done","queue_duration_s":0.855346,"scheduling_latency_s":0.855359,"redis_calls":19,"redis_duration_s":0.002424,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00053,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000186,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001276,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000197231,"duration_s":0.023075,"completed_at":"2026-07-25T07:16:03.362Z","load_balancing_strategy":"primary","db_duration_s":0.002697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368vm-test-run-nixbot-gitlab> gitlab # [ 141.374929] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"159f1ab8052573a4afa59713","created_at":"2026-07-25T07:16:02.488Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7f0eec373af7ef79dece3dbb57e790c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.492Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-159f1ab8052573a4afa59713: start","job_status":"start","queue_duration_s":0.87075,"scheduling_latency_s":0.870763}1369vm-test-run-nixbot-gitlab> gitlab # [ 141.375571] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.370Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1370vm-test-run-nixbot-gitlab> gitlab # [ 141.376077] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"159f1ab8052573a4afa59713","created_at":"2026-07-25T07:16:02.488Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7f0eec373af7ef79dece3dbb57e790c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.492Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-159f1ab8052573a4afa59713: done: 0.011329 sec","job_status":"done","queue_duration_s":0.87075,"scheduling_latency_s":0.870763,"redis_calls":10,"redis_duration_s":0.001225,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00018913,"duration_s":0.011329,"completed_at":"2026-07-25T07:16:03.375Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371vm-test-run-nixbot-gitlab> gitlab # [ 141.415955] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.376Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"e32fa8dbe780d7eada1cd871","created_at":"2026-07-25T07:16:02.500Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"b2fbae5d9b1ab6ab2374b137434abbf0","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.504Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-e32fa8dbe780d7eada1cd871: start","job_status":"start","queue_duration_s":0.871526,"scheduling_latency_s":0.871538}1372vm-test-run-nixbot-gitlab> gitlab # [ 141.416621] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.387Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"e32fa8dbe780d7eada1cd871","created_at":"2026-07-25T07:16:02.500Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"b2fbae5d9b1ab6ab2374b137434abbf0","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.504Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-e32fa8dbe780d7eada1cd871: done: 0.011419 sec","job_status":"done","queue_duration_s":0.871526,"scheduling_latency_s":0.871538,"redis_calls":10,"redis_duration_s":0.001232,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000236,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000182984,"duration_s":0.011419,"completed_at":"2026-07-25T07:16:03.387Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373vm-test-run-nixbot-gitlab> gitlab # [ 141.453196] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7229138d51151fc9580161cb","created_at":"2026-07-25T07:16:02.511Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.515Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7229138d51151fc9580161cb: start","job_status":"start","queue_duration_s":0.872663,"scheduling_latency_s":0.872676}1374vm-test-run-nixbot-gitlab> gitlab # [ 141.487863] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"7229138d51151fc9580161cb","created_at":"2026-07-25T07:16:02.511Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.515Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-7229138d51151fc9580161cb: done: 0.061434 sec","job_status":"done","queue_duration_s":0.872663,"scheduling_latency_s":0.872676,"redis_calls":71,"redis_duration_s":0.009446,"redis_read_bytes":121,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001221,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000388,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.00745,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367644,"duration_s":0.061434,"completed_at":"2026-07-25T07:16:03.449Z","load_balancing_strategy":"primary","db_duration_s":0.000935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375vm-test-run-nixbot-gitlab> gitlab # [ 141.494019] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"4ede4505a71264dca0c8891e","created_at":"2026-07-25T07:16:02.520Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4718b3c21abea45f14ed3693e77674a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.525Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-4ede4505a71264dca0c8891e: start","job_status":"start","queue_duration_s":0.925759,"scheduling_latency_s":0.925772}1376vm-test-run-nixbot-gitlab> gitlab # [ 141.535757] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.458Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1377vm-test-run-nixbot-gitlab> gitlab # [ 141.536703] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"4ede4505a71264dca0c8891e","created_at":"2026-07-25T07:16:02.520Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4718b3c21abea45f14ed3693e77674a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.525Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-4ede4505a71264dca0c8891e: done: 0.011989 sec","job_status":"done","queue_duration_s":0.925759,"scheduling_latency_s":0.925772,"redis_calls":10,"redis_duration_s":0.001207,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000186895,"duration_s":0.011989,"completed_at":"2026-07-25T07:16:03.462Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378vm-test-run-nixbot-gitlab> gitlab # [ 141.581276] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d401dd560e05b89ac49c7c82","created_at":"2026-07-25T07:16:02.530Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe9b18421081d195eab32af2d3828e69","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.534Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d401dd560e05b89ac49c7c82: start","job_status":"start","queue_duration_s":0.929155,"scheduling_latency_s":0.929167}1379vm-test-run-nixbot-gitlab> gitlab # [ 141.581976] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.470Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1380vm-test-run-nixbot-gitlab> gitlab # [ 141.582664] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d401dd560e05b89ac49c7c82","created_at":"2026-07-25T07:16:02.530Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe9b18421081d195eab32af2d3828e69","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.534Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d401dd560e05b89ac49c7c82: done: 0.010975 sec","job_status":"done","queue_duration_s":0.929155,"scheduling_latency_s":0.929167,"redis_calls":10,"redis_duration_s":0.001217,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00018913,"duration_s":0.010975,"completed_at":"2026-07-25T07:16:03.474Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381vm-test-run-nixbot-gitlab> gitlab # [ 141.623779] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.476Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c82be28a7a274258763f6fcb","created_at":"2026-07-25T07:16:02.538Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb62fa908f738b4ac42ab01ca2e4df8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T07:16:02.542Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c82be28a7a274258763f6fcb: start","job_status":"start","queue_duration_s":0.932979,"scheduling_latency_s":0.932992}1382vm-test-run-nixbot-gitlab> gitlab # [ 141.624700] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"c82be28a7a274258763f6fcb","created_at":"2026-07-25T07:16:02.538Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb62fa908f738b4ac42ab01ca2e4df8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-07-25T07:16:02.542Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-c82be28a7a274258763f6fcb: done: 0.022089 sec","job_status":"done","queue_duration_s":0.932979,"scheduling_latency_s":0.932992,"redis_calls":10,"redis_duration_s":0.0012439999999999999,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000235,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0001936,"duration_s":0.022089,"completed_at":"2026-07-25T07:16:03.498Z","load_balancing_strategy":"primary","db_duration_s":0.005087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383vm-test-run-nixbot-gitlab> gitlab # [ 141.683769] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ba2e89b8395fd5dd4d11c02d","created_at":"2026-07-25T07:16:02.558Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7236635cfa2e2e7bb0b6eb205856c44","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.563Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ba2e89b8395fd5dd4d11c02d: start","job_status":"start","queue_duration_s":0.935364,"scheduling_latency_s":0.935377}1384vm-test-run-nixbot-gitlab> gitlab # [ 141.684670] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"ba2e89b8395fd5dd4d11c02d","created_at":"2026-07-25T07:16:02.558Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7236635cfa2e2e7bb0b6eb205856c44","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.563Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-ba2e89b8395fd5dd4d11c02d: done: 0.062747 sec","job_status":"done","queue_duration_s":0.935364,"scheduling_latency_s":0.935377,"redis_calls":12,"redis_duration_s":0.001806,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000266,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000745,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000363733,"exclusive_lock_hold_duration_s":0.00329623,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.062747,"completed_at":"2026-07-25T07:16:03.561Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385vm-test-run-nixbot-gitlab> gitlab # [ 141.726114] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.562Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"741c6af0da8aede752ac0cc0","created_at":"2026-07-25T07:16:02.567Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af4b70213f7d64c0ce7982de51b11127","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.572Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-741c6af0da8aede752ac0cc0: start","job_status":"start","queue_duration_s":0.990631,"scheduling_latency_s":0.990645}1386vm-test-run-nixbot-gitlab> gitlab # [ 141.726859] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.583Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"741c6af0da8aede752ac0cc0","created_at":"2026-07-25T07:16:02.567Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af4b70213f7d64c0ce7982de51b11127","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.572Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-741c6af0da8aede752ac0cc0: done: 0.020659 sec","job_status":"done","queue_duration_s":0.990631,"scheduling_latency_s":0.990645,"redis_calls":16,"redis_duration_s":0.002066,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001024,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201142,"duration_s":0.020659,"completed_at":"2026-07-25T07:16:03.583Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387vm-test-run-nixbot-gitlab> gitlab # [ 141.777573] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"456ecbd4d696816a3abab46e","created_at":"2026-07-25T07:16:02.579Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"324d41fc716d608ecf7352aab9d3eb9b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.584Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-456ecbd4d696816a3abab46e: start","job_status":"start","queue_duration_s":1.000136,"scheduling_latency_s":1.000149}1388vm-test-run-nixbot-gitlab> gitlab # [ 141.778476] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"456ecbd4d696816a3abab46e","created_at":"2026-07-25T07:16:02.579Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"324d41fc716d608ecf7352aab9d3eb9b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.584Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-456ecbd4d696816a3abab46e: done: 0.026339 sec","job_status":"done","queue_duration_s":1.000136,"scheduling_latency_s":1.000149,"redis_calls":14,"redis_duration_s":0.001812,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000300597,"exclusive_lock_hold_duration_s":0.013601449,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.026339,"completed_at":"2026-07-25T07:16:03.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389vm-test-run-nixbot-gitlab> gitlab # [ 141.823663] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2d5ede6d5dc57e351f8429f0","created_at":"2026-07-25T07:16:02.590Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86686c7a78d1f544774e800c56d10562","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.595Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2d5ede6d5dc57e351f8429f0: start","job_status":"start","queue_duration_s":1.016098,"scheduling_latency_s":1.016111}1390vm-test-run-nixbot-gitlab> gitlab # [ 141.824597] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2d5ede6d5dc57e351f8429f0","created_at":"2026-07-25T07:16:02.590Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-365c72eef684449a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"86686c7a78d1f544774e800c56d10562","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:02.595Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2d5ede6d5dc57e351f8429f0: done: 0.015119 sec","job_status":"done","queue_duration_s":1.016098,"scheduling_latency_s":1.016111,"redis_calls":12,"redis_duration_s":0.001504,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000316242,"exclusive_lock_hold_duration_s":0.003482566,"duration_s":0.015119,"completed_at":"2026-07-25T07:16:03.626Z","load_balancing_strategy":"primary","db_duration_s":0.00167,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391vm-test-run-nixbot-gitlab> gitlab # [ 141.872241] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e609da12d530111c540a7494","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e609da12d530111c540a7494: start","job_status":"start","queue_duration_s":0.294645,"scheduling_latency_s":0.294658}1392vm-test-run-nixbot-gitlab> gitlab # [ 141.872918] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e609da12d530111c540a7494","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e609da12d530111c540a7494: done: 0.016968 sec","job_status":"done","queue_duration_s":0.294645,"scheduling_latency_s":0.294658,"redis_calls":13,"redis_duration_s":0.001682,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189689,"duration_s":0.016968,"completed_at":"2026-07-25T07:16:03.644Z","load_balancing_strategy":"primary","db_duration_s":0.00261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393vm-test-run-nixbot-gitlab> gitlab # [ 141.911166] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a78dede6994bf4cd787cca4","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a78dede6994bf4cd787cca4: start","job_status":"start","queue_duration_s":0.312434,"scheduling_latency_s":0.312447}1394vm-test-run-nixbot-gitlab> gitlab # [ 141.911792] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a78dede6994bf4cd787cca4","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a78dede6994bf4cd787cca4: done: 0.010219 sec","job_status":"done","queue_duration_s":0.312434,"scheduling_latency_s":0.312447,"redis_calls":10,"redis_duration_s":0.0012959999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000789,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010219,"completed_at":"2026-07-25T07:16:03.655Z","load_balancing_strategy":"primary","db_duration_s":0.000878,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395vm-test-run-nixbot-gitlab> gitlab # [ 141.951235] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"66088e39c3c8e7a54091ffda","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-66088e39c3c8e7a54091ffda: start","job_status":"start","queue_duration_s":0.32348,"scheduling_latency_s":0.323493}1396vm-test-run-nixbot-gitlab> gitlab # [ 141.951931] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"66088e39c3c8e7a54091ffda","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-66088e39c3c8e7a54091ffda: done: 0.010006 sec","job_status":"done","queue_duration_s":0.32348,"scheduling_latency_s":0.323493,"redis_calls":10,"redis_duration_s":0.001338,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010006,"completed_at":"2026-07-25T07:16:03.666Z","load_balancing_strategy":"primary","db_duration_s":0.00091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397vm-test-run-nixbot-gitlab> gitlab # [ 141.999545] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b4667a81675f77cabefa8b92","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b4667a81675f77cabefa8b92: start","job_status":"start","queue_duration_s":0.334317,"scheduling_latency_s":0.334331}1398vm-test-run-nixbot-gitlab> gitlab # [ 142.000212] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b4667a81675f77cabefa8b92","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b4667a81675f77cabefa8b92: done: 0.010944 sec","job_status":"done","queue_duration_s":0.334317,"scheduling_latency_s":0.334331,"redis_calls":10,"redis_duration_s":0.0012720000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000773,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010944,"completed_at":"2026-07-25T07:16:03.678Z","load_balancing_strategy":"primary","db_duration_s":0.001216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399vm-test-run-nixbot-gitlab> gitlab # [ 142.038962] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e2fb2319d4082642caf1a345","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e2fb2319d4082642caf1a345: start","job_status":"start","queue_duration_s":0.346066,"scheduling_latency_s":0.34608}1400vm-test-run-nixbot-gitlab> gitlab # [ 142.039656] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e2fb2319d4082642caf1a345","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e2fb2319d4082642caf1a345: done: 0.010007 sec","job_status":"done","queue_duration_s":0.346066,"scheduling_latency_s":0.34608,"redis_calls":10,"redis_duration_s":0.001275,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00077,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010007,"completed_at":"2026-07-25T07:16:03.688Z","load_balancing_strategy":"primary","db_duration_s":0.000828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401vm-test-run-nixbot-gitlab> gitlab # [ 142.075467] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"826272ef61c0a8f57f28b816","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-826272ef61c0a8f57f28b816: start","job_status":"start","queue_duration_s":0.356837,"scheduling_latency_s":0.356871}1402vm-test-run-nixbot-gitlab> gitlab # [ 142.076082] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"826272ef61c0a8f57f28b816","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-826272ef61c0a8f57f28b816: done: 0.009927 sec","job_status":"done","queue_duration_s":0.356837,"scheduling_latency_s":0.356871,"redis_calls":10,"redis_duration_s":0.001258,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009927,"completed_at":"2026-07-25T07:16:03.699Z","load_balancing_strategy":"primary","db_duration_s":0.000888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403vm-test-run-nixbot-gitlab> gitlab # [ 142.093888] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d1544c791b68f1dae4cc1c87","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d1544c791b68f1dae4cc1c87: start","job_status":"start","queue_duration_s":0.367563,"scheduling_latency_s":0.367576}1404vm-test-run-nixbot-gitlab> gitlab # [ 142.130650] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d1544c791b68f1dae4cc1c87","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d1544c791b68f1dae4cc1c87: done: 0.009955 sec","job_status":"done","queue_duration_s":0.367563,"scheduling_latency_s":0.367576,"redis_calls":10,"redis_duration_s":0.001359,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000853,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009955,"completed_at":"2026-07-25T07:16:03.710Z","load_balancing_strategy":"primary","db_duration_s":0.000898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405vm-test-run-nixbot-gitlab> gitlab # [ 142.133845] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"933119b0d4d0075de1c89428","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-933119b0d4d0075de1c89428: start","job_status":"start","queue_duration_s":0.37831,"scheduling_latency_s":0.378323}1406vm-test-run-nixbot-gitlab> gitlab # [ 142.175216] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"933119b0d4d0075de1c89428","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-933119b0d4d0075de1c89428: done: 0.010174 sec","job_status":"done","queue_duration_s":0.37831,"scheduling_latency_s":0.378323,"redis_calls":10,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000662,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000829,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010174,"completed_at":"2026-07-25T07:16:03.721Z","load_balancing_strategy":"primary","db_duration_s":0.000894,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407vm-test-run-nixbot-gitlab> gitlab # [ 142.176152] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"91aa11be47dc14a71097518c","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-91aa11be47dc14a71097518c: start","job_status":"start","queue_duration_s":0.389705,"scheduling_latency_s":0.389719}1408vm-test-run-nixbot-gitlab> gitlab # [ 142.183673] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"91aa11be47dc14a71097518c","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-91aa11be47dc14a71097518c: done: 0.00994 sec","job_status":"done","queue_duration_s":0.389705,"scheduling_latency_s":0.389719,"redis_calls":10,"redis_duration_s":0.001325,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00994,"completed_at":"2026-07-25T07:16:03.732Z","load_balancing_strategy":"primary","db_duration_s":0.000868,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409vm-test-run-nixbot-gitlab> gitlab # [ 142.242676] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8cc8f2210cb1b8f03a63ef23","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8cc8f2210cb1b8f03a63ef23: start","job_status":"start","queue_duration_s":0.400423,"scheduling_latency_s":0.400436}1410vm-test-run-nixbot-gitlab> gitlab # [ 142.243421] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8cc8f2210cb1b8f03a63ef23","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8cc8f2210cb1b8f03a63ef23: done: 0.010004 sec","job_status":"done","queue_duration_s":0.400423,"scheduling_latency_s":0.400436,"redis_calls":10,"redis_duration_s":0.001264,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010004,"completed_at":"2026-07-25T07:16:03.743Z","load_balancing_strategy":"primary","db_duration_s":0.000871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411vm-test-run-nixbot-gitlab> gitlab # [ 142.254770] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"87ad6ccdf530b7ed291f354c","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-87ad6ccdf530b7ed291f354c: start","job_status":"start","queue_duration_s":0.411228,"scheduling_latency_s":0.411241}1412vm-test-run-nixbot-gitlab> gitlab # [ 142.264755] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"87ad6ccdf530b7ed291f354c","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-87ad6ccdf530b7ed291f354c: done: 0.009936 sec","job_status":"done","queue_duration_s":0.411228,"scheduling_latency_s":0.411241,"redis_calls":10,"redis_duration_s":0.001243,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009936,"completed_at":"2026-07-25T07:16:03.754Z","load_balancing_strategy":"primary","db_duration_s":0.000879,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413vm-test-run-nixbot-gitlab> gitlab # [ 142.320981] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"64fa3cb582038e6ed289d558","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-64fa3cb582038e6ed289d558: start","job_status":"start","queue_duration_s":0.421963,"scheduling_latency_s":0.421976}1414vm-test-run-nixbot-gitlab> gitlab # [ 142.321682] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"64fa3cb582038e6ed289d558","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-64fa3cb582038e6ed289d558: done: 0.010418 sec","job_status":"done","queue_duration_s":0.421963,"scheduling_latency_s":0.421976,"redis_calls":10,"redis_duration_s":0.001276,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00075,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010418,"completed_at":"2026-07-25T07:16:03.765Z","load_balancing_strategy":"primary","db_duration_s":0.000872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415vm-test-run-nixbot-gitlab> gitlab # [ 142.356925] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3d824970b79f431c59fd358c","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3d824970b79f431c59fd358c: start","job_status":"start","queue_duration_s":0.433174,"scheduling_latency_s":0.433187}1416vm-test-run-nixbot-gitlab> gitlab # [ 142.357621] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3d824970b79f431c59fd358c","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3d824970b79f431c59fd358c: done: 0.009963 sec","job_status":"done","queue_duration_s":0.433174,"scheduling_latency_s":0.433187,"redis_calls":10,"redis_duration_s":0.00125,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009963,"completed_at":"2026-07-25T07:16:03.776Z","load_balancing_strategy":"primary","db_duration_s":0.000828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417vm-test-run-nixbot-gitlab> gitlab # [ 142.392880] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ee2ff295a1300c15e3acd070","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ee2ff295a1300c15e3acd070: start","job_status":"start","queue_duration_s":0.443956,"scheduling_latency_s":0.44397}1418vm-test-run-nixbot-gitlab> gitlab # [ 142.393608] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ee2ff295a1300c15e3acd070","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ee2ff295a1300c15e3acd070: done: 0.009969 sec","job_status":"done","queue_duration_s":0.443956,"scheduling_latency_s":0.44397,"redis_calls":10,"redis_duration_s":0.001261,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009969,"completed_at":"2026-07-25T07:16:03.786Z","load_balancing_strategy":"primary","db_duration_s":0.000866,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419vm-test-run-nixbot-gitlab> gitlab # [ 142.440968] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5e40fe0709ad445a9752b95f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5e40fe0709ad445a9752b95f: start","job_status":"start","queue_duration_s":0.454698,"scheduling_latency_s":0.454711}1420vm-test-run-nixbot-gitlab> gitlab # [ 142.441671] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5e40fe0709ad445a9752b95f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5e40fe0709ad445a9752b95f: done: 0.009925 sec","job_status":"done","queue_duration_s":0.454698,"scheduling_latency_s":0.454711,"redis_calls":10,"redis_duration_s":0.001252,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000721,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009925,"completed_at":"2026-07-25T07:16:03.797Z","load_balancing_strategy":"primary","db_duration_s":0.000825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421vm-test-run-nixbot-gitlab> gitlab # [ 142.477261] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f32c5d961de60b712509cd65","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f32c5d961de60b712509cd65: start","job_status":"start","queue_duration_s":0.465885,"scheduling_latency_s":0.465899}1422vm-test-run-nixbot-gitlab> gitlab # [ 142.477940] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f32c5d961de60b712509cd65","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f32c5d961de60b712509cd65: done: 0.009974 sec","job_status":"done","queue_duration_s":0.465885,"scheduling_latency_s":0.465899,"redis_calls":10,"redis_duration_s":0.0012829999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009974,"completed_at":"2026-07-25T07:16:03.808Z","load_balancing_strategy":"primary","db_duration_s":0.000906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423vm-test-run-nixbot-gitlab> gitlab # [ 142.518475] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c20c7a343bceb7f4b47a794d","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c20c7a343bceb7f4b47a794d: start","job_status":"start","queue_duration_s":0.476636,"scheduling_latency_s":0.476649}1424vm-test-run-nixbot-gitlab> gitlab # [ 142.519056] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c20c7a343bceb7f4b47a794d","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c20c7a343bceb7f4b47a794d: done: 0.01037 sec","job_status":"done","queue_duration_s":0.476636,"scheduling_latency_s":0.476649,"redis_calls":10,"redis_duration_s":0.0012599999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01037,"completed_at":"2026-07-25T07:16:03.819Z","load_balancing_strategy":"primary","db_duration_s":0.001246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425vm-test-run-nixbot-gitlab> gitlab # [ 142.564273] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"eef36b0ddf07c6465406228e","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-eef36b0ddf07c6465406228e: start","job_status":"start","queue_duration_s":0.487779,"scheduling_latency_s":0.487792}1426vm-test-run-nixbot-gitlab> gitlab # [ 142.564946] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"eef36b0ddf07c6465406228e","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-eef36b0ddf07c6465406228e: done: 0.0103 sec","job_status":"done","queue_duration_s":0.487779,"scheduling_latency_s":0.487792,"redis_calls":10,"redis_duration_s":0.0012929999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000732,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0103,"completed_at":"2026-07-25T07:16:03.830Z","load_balancing_strategy":"primary","db_duration_s":0.000865,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427vm-test-run-nixbot-gitlab> gitlab # [ 142.610113] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"80879850ea7b85c6d975b5f5","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-80879850ea7b85c6d975b5f5: start","job_status":"start","queue_duration_s":0.49948,"scheduling_latency_s":0.499492}1428vm-test-run-nixbot-gitlab> gitlab # [ 142.610851] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"80879850ea7b85c6d975b5f5","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-80879850ea7b85c6d975b5f5: done: 0.010371 sec","job_status":"done","queue_duration_s":0.49948,"scheduling_latency_s":0.499492,"redis_calls":10,"redis_duration_s":0.001271,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000769,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010371,"completed_at":"2026-07-25T07:16:03.842Z","load_balancing_strategy":"primary","db_duration_s":0.000868,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429vm-test-run-nixbot-gitlab> gitlab # [ 142.617053] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"59f5bff4e4611742ec2c701b","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-59f5bff4e4611742ec2c701b: start","job_status":"start","queue_duration_s":0.51064,"scheduling_latency_s":0.510653}1430vm-test-run-nixbot-gitlab> gitlab # [ 142.658529] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"59f5bff4e4611742ec2c701b","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-59f5bff4e4611742ec2c701b: done: 0.011332 sec","job_status":"done","queue_duration_s":0.51064,"scheduling_latency_s":0.510653,"redis_calls":10,"redis_duration_s":0.001283,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000729,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011332,"completed_at":"2026-07-25T07:16:03.854Z","load_balancing_strategy":"primary","db_duration_s":0.00092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431vm-test-run-nixbot-gitlab> gitlab # [ 142.659608] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dbad711c0e388be7ef5bef9f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dbad711c0e388be7ef5bef9f: start","job_status":"start","queue_duration_s":0.522778,"scheduling_latency_s":0.52279}1432vm-test-run-nixbot-gitlab> gitlab # [ 142.668833] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dbad711c0e388be7ef5bef9f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dbad711c0e388be7ef5bef9f: done: 0.010377 sec","job_status":"done","queue_duration_s":0.522778,"scheduling_latency_s":0.52279,"redis_calls":10,"redis_duration_s":0.001335,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010377,"completed_at":"2026-07-25T07:16:03.866Z","load_balancing_strategy":"primary","db_duration_s":0.000903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433vm-test-run-nixbot-gitlab> gitlab # [ 142.712020] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f7061d96e68b749526ad6f5f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f7061d96e68b749526ad6f5f: start","job_status":"start","queue_duration_s":0.533965,"scheduling_latency_s":0.533978}1434vm-test-run-nixbot-gitlab> gitlab # [ 142.712674] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f7061d96e68b749526ad6f5f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f7061d96e68b749526ad6f5f: done: 0.010463 sec","job_status":"done","queue_duration_s":0.533965,"scheduling_latency_s":0.533978,"redis_calls":10,"redis_duration_s":0.0013059999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010463,"completed_at":"2026-07-25T07:16:03.877Z","load_balancing_strategy":"primary","db_duration_s":0.00162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435vm-test-run-nixbot-gitlab> gitlab # [ 142.756909] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81920078aa2d4156995f40e9","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81920078aa2d4156995f40e9: start","job_status":"start","queue_duration_s":0.545224,"scheduling_latency_s":0.545237}1436vm-test-run-nixbot-gitlab> gitlab # [ 142.757585] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"81920078aa2d4156995f40e9","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-81920078aa2d4156995f40e9: done: 0.010382 sec","job_status":"done","queue_duration_s":0.545224,"scheduling_latency_s":0.545237,"redis_calls":10,"redis_duration_s":0.001323,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010382,"completed_at":"2026-07-25T07:16:03.888Z","load_balancing_strategy":"primary","db_duration_s":0.000902,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437vm-test-run-nixbot-gitlab> gitlab # [ 142.802604] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"55e1d2f83f286a5b936bd78f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-55e1d2f83f286a5b936bd78f: start","job_status":"start","queue_duration_s":0.557103,"scheduling_latency_s":0.557116}1438vm-test-run-nixbot-gitlab> gitlab # [ 142.803402] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"55e1d2f83f286a5b936bd78f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-55e1d2f83f286a5b936bd78f: done: 0.010285 sec","job_status":"done","queue_duration_s":0.557103,"scheduling_latency_s":0.557116,"redis_calls":10,"redis_duration_s":0.001269,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00077,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010285,"completed_at":"2026-07-25T07:16:03.900Z","load_balancing_strategy":"primary","db_duration_s":0.000886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439vm-test-run-nixbot-gitlab> gitlab # [ 142.837807] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1469d0cca5a26f44276341c6","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1469d0cca5a26f44276341c6: start","job_status":"start","queue_duration_s":0.568259,"scheduling_latency_s":0.568271}1440vm-test-run-nixbot-gitlab> gitlab # [ 142.838531] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1469d0cca5a26f44276341c6","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1469d0cca5a26f44276341c6: done: 0.011175 sec","job_status":"done","queue_duration_s":0.568259,"scheduling_latency_s":0.568271,"redis_calls":10,"redis_duration_s":0.0013050000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000799,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011175,"completed_at":"2026-07-25T07:16:03.912Z","load_balancing_strategy":"primary","db_duration_s":0.00092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441vm-test-run-nixbot-gitlab> gitlab # [ 142.860086] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"37fa1da814435119f8cba958","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-37fa1da814435119f8cba958: start","job_status":"start","queue_duration_s":0.580256,"scheduling_latency_s":0.580269}1442vm-test-run-nixbot-gitlab> gitlab # [ 142.900883] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"37fa1da814435119f8cba958","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-37fa1da814435119f8cba958: done: 0.010776 sec","job_status":"done","queue_duration_s":0.580256,"scheduling_latency_s":0.580269,"redis_calls":10,"redis_duration_s":0.001413,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010776,"completed_at":"2026-07-25T07:16:03.923Z","load_balancing_strategy":"primary","db_duration_s":0.000863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443vm-test-run-nixbot-gitlab> gitlab # [ 142.901900] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"11a0001d4e033a7d2233ffee","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-11a0001d4e033a7d2233ffee: start","job_status":"start","queue_duration_s":0.591867,"scheduling_latency_s":0.59188}1444vm-test-run-nixbot-gitlab> gitlab # [ 142.937526] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"11a0001d4e033a7d2233ffee","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-11a0001d4e033a7d2233ffee: done: 0.012584 sec","job_status":"done","queue_duration_s":0.591867,"scheduling_latency_s":0.59188,"redis_calls":10,"redis_duration_s":0.0012920000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000786,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012584,"completed_at":"2026-07-25T07:16:03.937Z","load_balancing_strategy":"primary","db_duration_s":0.000857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445vm-test-run-nixbot-gitlab> gitlab # [ 142.972226] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a7804a519518fb942a6f906","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a7804a519518fb942a6f906: start","job_status":"start","queue_duration_s":0.605236,"scheduling_latency_s":0.605249}1446vm-test-run-nixbot-gitlab> gitlab # [ 142.972900] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8a7804a519518fb942a6f906","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8a7804a519518fb942a6f906: done: 0.009727 sec","job_status":"done","queue_duration_s":0.605236,"scheduling_latency_s":0.605249,"redis_calls":10,"redis_duration_s":0.0012929999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009727,"completed_at":"2026-07-25T07:16:03.947Z","load_balancing_strategy":"primary","db_duration_s":0.000883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447vm-test-run-nixbot-gitlab> gitlab # [ 142.979640] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6cfcbccc72e4203571cf167e","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6cfcbccc72e4203571cf167e: start","job_status":"start","queue_duration_s":0.615734,"scheduling_latency_s":0.615746}1448vm-test-run-nixbot-gitlab> gitlab # [ 143.020631] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6cfcbccc72e4203571cf167e","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6cfcbccc72e4203571cf167e: done: 0.010658 sec","job_status":"done","queue_duration_s":0.615734,"scheduling_latency_s":0.615746,"redis_calls":10,"redis_duration_s":0.001386,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000814,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010658,"completed_at":"2026-07-25T07:16:03.959Z","load_balancing_strategy":"primary","db_duration_s":0.000868,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449vm-test-run-nixbot-gitlab> gitlab # [ 143.021495] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"28783e642b9611ee4bda4df1","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-28783e642b9611ee4bda4df1: start","job_status":"start","queue_duration_s":0.627188,"scheduling_latency_s":0.627201}1450vm-test-run-nixbot-gitlab> gitlab # [ 143.058228] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"28783e642b9611ee4bda4df1","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-28783e642b9611ee4bda4df1: done: 0.009975 sec","job_status":"done","queue_duration_s":0.627188,"scheduling_latency_s":0.627201,"redis_calls":10,"redis_duration_s":0.0012859999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009975,"completed_at":"2026-07-25T07:16:03.970Z","load_balancing_strategy":"primary","db_duration_s":0.000852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451vm-test-run-nixbot-gitlab> gitlab # [ 143.060510] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5f5f912babdd3e29eda9eda3","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5f5f912babdd3e29eda9eda3: start","job_status":"start","queue_duration_s":0.638298,"scheduling_latency_s":0.638311}1452vm-test-run-nixbot-gitlab> gitlab # [ 143.070667] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5f5f912babdd3e29eda9eda3","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5f5f912babdd3e29eda9eda3: done: 0.010002 sec","job_status":"done","queue_duration_s":0.638298,"scheduling_latency_s":0.638311,"redis_calls":10,"redis_duration_s":0.001243,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010002,"completed_at":"2026-07-25T07:16:03.981Z","load_balancing_strategy":"primary","db_duration_s":0.000852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453vm-test-run-nixbot-gitlab> gitlab # [ 143.111546] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9f728303b8215205e8647106","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9f728303b8215205e8647106: start","job_status":"start","queue_duration_s":0.64909,"scheduling_latency_s":0.649103}1454vm-test-run-nixbot-gitlab> gitlab # [ 143.112113] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9f728303b8215205e8647106","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9f728303b8215205e8647106: done: 0.009943 sec","job_status":"done","queue_duration_s":0.64909,"scheduling_latency_s":0.649103,"redis_calls":10,"redis_duration_s":0.001235,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000737,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009943,"completed_at":"2026-07-25T07:16:03.991Z","load_balancing_strategy":"primary","db_duration_s":0.000853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455vm-test-run-nixbot-gitlab> gitlab # [ 143.157619] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:03.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c8f03b75fb7e2b3d71a6022e","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c8f03b75fb7e2b3d71a6022e: start","job_status":"start","queue_duration_s":0.659907,"scheduling_latency_s":0.65992}1456vm-test-run-nixbot-gitlab> gitlab # [ 143.195137] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c8f03b75fb7e2b3d71a6022e","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c8f03b75fb7e2b3d71a6022e: done: 1.27261 sec","job_status":"done","queue_duration_s":0.659907,"scheduling_latency_s":0.65992,"redis_calls":10,"redis_duration_s":0.001498,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.27261,"completed_at":"2026-07-25T07:16:05.265Z","load_balancing_strategy":"primary","db_duration_s":0.000867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457vm-test-run-nixbot-gitlab> gitlab # [ 143.228800] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9e610c31d4ecd065838c297a","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9e610c31d4ecd065838c297a: start","job_status":"start","queue_duration_s":1.966288,"scheduling_latency_s":1.966319}1458vm-test-run-nixbot-gitlab> gitlab # [ 143.252348] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9e610c31d4ecd065838c297a","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9e610c31d4ecd065838c297a: done: 0.02357 sec","job_status":"done","queue_duration_s":1.966288,"scheduling_latency_s":1.966319,"redis_calls":10,"redis_duration_s":0.001613,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02357,"completed_at":"2026-07-25T07:16:05.322Z","load_balancing_strategy":"primary","db_duration_s":0.001475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459vm-test-run-nixbot-gitlab> gitlab # [ 143.285413] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a423bdb8661f23b6b2b0e362","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a423bdb8661f23b6b2b0e362: start","job_status":"start","queue_duration_s":2.022559,"scheduling_latency_s":2.022607}1460vm-test-run-nixbot-gitlab> gitlab # [ 143.311711] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a423bdb8661f23b6b2b0e362","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a423bdb8661f23b6b2b0e362: done: 0.026363 sec","job_status":"done","queue_duration_s":2.022559,"scheduling_latency_s":2.022607,"redis_calls":10,"redis_duration_s":0.002632,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001545,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026363,"completed_at":"2026-07-25T07:16:05.381Z","load_balancing_strategy":"primary","db_duration_s":0.002016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461vm-test-run-nixbot-gitlab> gitlab # [ 143.345398] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7d06e5d8ed65ec4da8b3a453","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7d06e5d8ed65ec4da8b3a453: start","job_status":"start","queue_duration_s":2.082517,"scheduling_latency_s":2.08257}1462vm-test-run-nixbot-gitlab> gitlab # [ 143.374957] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7d06e5d8ed65ec4da8b3a453","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7d06e5d8ed65ec4da8b3a453: done: 0.029596 sec","job_status":"done","queue_duration_s":2.082517,"scheduling_latency_s":2.08257,"redis_calls":10,"redis_duration_s":0.003549,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002168,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029596,"completed_at":"2026-07-25T07:16:05.444Z","load_balancing_strategy":"primary","db_duration_s":0.002001,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463vm-test-run-nixbot-gitlab> gitlab # [ 143.407838] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ad8ece525ae3f94e7206106f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ad8ece525ae3f94e7206106f: start","job_status":"start","queue_duration_s":2.145006,"scheduling_latency_s":2.145048}1464vm-test-run-nixbot-gitlab> gitlab # [ 143.442484] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ad8ece525ae3f94e7206106f","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ad8ece525ae3f94e7206106f: done: 0.03453 sec","job_status":"done","queue_duration_s":2.145006,"scheduling_latency_s":2.145048,"redis_calls":10,"redis_duration_s":0.00242,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001406,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03453,"completed_at":"2026-07-25T07:16:05.512Z","load_balancing_strategy":"primary","db_duration_s":0.00194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465vm-test-run-nixbot-gitlab> gitlab # [ 143.475586] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d89e0eba049e6f43d4757157","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d89e0eba049e6f43d4757157: start","job_status":"start","queue_duration_s":2.212716,"scheduling_latency_s":2.212758}1466vm-test-run-nixbot-gitlab> gitlab # [ 143.506062] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d89e0eba049e6f43d4757157","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d89e0eba049e6f43d4757157: done: 0.030751 sec","job_status":"done","queue_duration_s":2.212716,"scheduling_latency_s":2.212758,"redis_calls":10,"redis_duration_s":0.00456,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00217,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00239,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030751,"completed_at":"2026-07-25T07:16:05.576Z","load_balancing_strategy":"primary","db_duration_s":0.002368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467vm-test-run-nixbot-gitlab> gitlab # [ 143.538733] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1b77a80074e78cf846853052","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1b77a80074e78cf846853052: start","job_status":"start","queue_duration_s":2.276249,"scheduling_latency_s":2.276274}1468vm-test-run-nixbot-gitlab> gitlab # [ 143.575385] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1b77a80074e78cf846853052","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1b77a80074e78cf846853052: done: 0.036207 sec","job_status":"done","queue_duration_s":2.276249,"scheduling_latency_s":2.276274,"redis_calls":10,"redis_duration_s":0.003175,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001265,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00191,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036207,"completed_at":"2026-07-25T07:16:05.645Z","load_balancing_strategy":"primary","db_duration_s":0.001914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469vm-test-run-nixbot-gitlab> gitlab # [ 143.609462] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"48eda7a74b3536f1a7b14dad","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-48eda7a74b3536f1a7b14dad: start","job_status":"start","queue_duration_s":2.346596,"scheduling_latency_s":2.346648}1470vm-test-run-nixbot-gitlab> gitlab # [ 143.637735] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"48eda7a74b3536f1a7b14dad","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-48eda7a74b3536f1a7b14dad: done: 0.02827 sec","job_status":"done","queue_duration_s":2.346596,"scheduling_latency_s":2.346648,"redis_calls":10,"redis_duration_s":0.003347,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001445,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02827,"completed_at":"2026-07-25T07:16:05.707Z","load_balancing_strategy":"primary","db_duration_s":0.001929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471vm-test-run-nixbot-gitlab> gitlab # [ 143.670696] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"199133195db213f6990bd6e4","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-199133195db213f6990bd6e4: start","job_status":"start","queue_duration_s":2.407793,"scheduling_latency_s":2.407834}1472vm-test-run-nixbot-gitlab> gitlab # [ 143.705595] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"199133195db213f6990bd6e4","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-199133195db213f6990bd6e4: done: 0.034613 sec","job_status":"done","queue_duration_s":2.407793,"scheduling_latency_s":2.407834,"redis_calls":10,"redis_duration_s":0.002979,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001237,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001742,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034613,"completed_at":"2026-07-25T07:16:05.775Z","load_balancing_strategy":"primary","db_duration_s":0.001875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473vm-test-run-nixbot-gitlab> gitlab # [ 143.739233] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fa9e6e9ff0492a134e2024a3","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fa9e6e9ff0492a134e2024a3: start","job_status":"start","queue_duration_s":2.476267,"scheduling_latency_s":2.476315}1474vm-test-run-nixbot-gitlab> gitlab # [ 143.764992] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fa9e6e9ff0492a134e2024a3","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fa9e6e9ff0492a134e2024a3: done: 0.025947 sec","job_status":"done","queue_duration_s":2.476267,"scheduling_latency_s":2.476315,"redis_calls":10,"redis_duration_s":0.003379,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001991,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025947,"completed_at":"2026-07-25T07:16:05.835Z","load_balancing_strategy":"primary","db_duration_s":0.001759,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475vm-test-run-nixbot-gitlab> gitlab # [ 143.799076] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"68a1d072d89ef9c98888922b","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-68a1d072d89ef9c98888922b: start","job_status":"start","queue_duration_s":2.536188,"scheduling_latency_s":2.536239}1476vm-test-run-nixbot-gitlab> gitlab # [ 143.828498] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"68a1d072d89ef9c98888922b","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-68a1d072d89ef9c98888922b: done: 0.029408 sec","job_status":"done","queue_duration_s":2.536188,"scheduling_latency_s":2.536239,"redis_calls":10,"redis_duration_s":0.003211,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001277,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029408,"completed_at":"2026-07-25T07:16:05.898Z","load_balancing_strategy":"primary","db_duration_s":0.001925,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477vm-test-run-nixbot-gitlab> gitlab # [ 143.861515] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8818d1d7067ecd902f4e91b7","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8818d1d7067ecd902f4e91b7: start","job_status":"start","queue_duration_s":2.598721,"scheduling_latency_s":2.598762}1478vm-test-run-nixbot-gitlab> gitlab # [ 143.888647] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8818d1d7067ecd902f4e91b7","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8818d1d7067ecd902f4e91b7: done: 0.026801 sec","job_status":"done","queue_duration_s":2.598721,"scheduling_latency_s":2.598762,"redis_calls":10,"redis_duration_s":0.003209,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026801,"completed_at":"2026-07-25T07:16:05.958Z","load_balancing_strategy":"primary","db_duration_s":0.001918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479vm-test-run-nixbot-gitlab> gitlab # [ 143.921759] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:05.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ffb8af601c9aa0c293dd0924","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ffb8af601c9aa0c293dd0924: start","job_status":"start","queue_duration_s":2.658838,"scheduling_latency_s":2.658953}1480vm-test-run-nixbot-gitlab> gitlab # [ 143.956106] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ffb8af601c9aa0c293dd0924","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ffb8af601c9aa0c293dd0924: done: 0.034219 sec","job_status":"done","queue_duration_s":2.658838,"scheduling_latency_s":2.658953,"redis_calls":10,"redis_duration_s":0.002251,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001384,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034219,"completed_at":"2026-07-25T07:16:06.025Z","load_balancing_strategy":"primary","db_duration_s":0.001971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481vm-test-run-nixbot-gitlab> gitlab # [ 143.989909] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c8b824da0d226ab104e4893c","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c8b824da0d226ab104e4893c: start","job_status":"start","queue_duration_s":2.727052,"scheduling_latency_s":2.727097}1482vm-test-run-nixbot-gitlab> gitlab # [ 144.017308] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"c8b824da0d226ab104e4893c","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-c8b824da0d226ab104e4893c: done: 0.027294 sec","job_status":"done","queue_duration_s":2.727052,"scheduling_latency_s":2.727097,"redis_calls":10,"redis_duration_s":0.0032300000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001362,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027294,"completed_at":"2026-07-25T07:16:06.087Z","load_balancing_strategy":"primary","db_duration_s":0.001814,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483vm-test-run-nixbot-gitlab> gitlab # [ 144.050692] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"41c029abb1acbd5ebc54121e","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-41c029abb1acbd5ebc54121e: start","job_status":"start","queue_duration_s":2.788003,"scheduling_latency_s":2.788034}1484vm-test-run-nixbot-gitlab> gitlab # [ 144.091676] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"41c029abb1acbd5ebc54121e","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-41c029abb1acbd5ebc54121e: done: 0.039828 sec","job_status":"done","queue_duration_s":2.788003,"scheduling_latency_s":2.788034,"redis_calls":10,"redis_duration_s":0.003171,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039828,"completed_at":"2026-07-25T07:16:06.160Z","load_balancing_strategy":"primary","db_duration_s":0.002795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485vm-test-run-nixbot-gitlab> gitlab # [ 144.093442] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5306b5346247c3f378e4c8d","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5306b5346247c3f378e4c8d: start","job_status":"start","queue_duration_s":2.829827,"scheduling_latency_s":2.829915}1486vm-test-run-nixbot-gitlab> gitlab # [ 144.159653] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d5306b5346247c3f378e4c8d","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d5306b5346247c3f378e4c8d: done: 0.066773 sec","job_status":"done","queue_duration_s":2.829827,"scheduling_latency_s":2.829915,"redis_calls":10,"redis_duration_s":0.002474,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066773,"completed_at":"2026-07-25T07:16:06.229Z","load_balancing_strategy":"primary","db_duration_s":0.003107,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487vm-test-run-nixbot-gitlab> gitlab # [ 144.194163] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0704ac30140ace1a56f478f7","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0704ac30140ace1a56f478f7: start","job_status":"start","queue_duration_s":2.930773,"scheduling_latency_s":2.930816}1488vm-test-run-nixbot-gitlab> gitlab # [ 144.227817] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"0704ac30140ace1a56f478f7","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-0704ac30140ace1a56f478f7: done: 0.03402 sec","job_status":"done","queue_duration_s":2.930773,"scheduling_latency_s":2.930816,"redis_calls":10,"redis_duration_s":0.0044280000000000005,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003468,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.002075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03402,"completed_at":"2026-07-25T07:16:06.297Z","load_balancing_strategy":"primary","db_duration_s":0.00505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489vm-test-run-nixbot-gitlab> gitlab # [ 144.261435] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"18982929e4bf90ac32b113a0","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-18982929e4bf90ac32b113a0: start","job_status":"start","queue_duration_s":2.998587,"scheduling_latency_s":2.998633}1490vm-test-run-nixbot-gitlab> gitlab # [ 144.289706] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.359Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"18982929e4bf90ac32b113a0","created_at":"2026-07-25T07:16:03.287Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-77fd3ba2f2e54731","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"5f2bec14f85b7e1b1fd430837f036382","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.332Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-18982929e4bf90ac32b113a0: done: 0.028212 sec","job_status":"done","queue_duration_s":2.998587,"scheduling_latency_s":2.998633,"redis_calls":10,"redis_duration_s":0.003425,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028212,"completed_at":"2026-07-25T07:16:06.359Z","load_balancing_strategy":"primary","db_duration_s":0.002097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491vm-test-run-nixbot-gitlab> gitlab # [ 144.323839] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.393Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3dd2af1299cd4b7ca3899267","created_at":"2026-07-25T07:16:03.349Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-eeaff99b3c5f4b4a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.358Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3dd2af1299cd4b7ca3899267: start","job_status":"start","queue_duration_s":3.035696,"scheduling_latency_s":3.035743}1492vm-test-run-nixbot-gitlab> gitlab # [ 144.353149] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.423Z","message":"No existing merge request to be cleaned up."}1493vm-test-run-nixbot-gitlab> gitlab # [ 144.371531] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.441Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3dd2af1299cd4b7ca3899267","created_at":"2026-07-25T07:16:03.349Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-eeaff99b3c5f4b4a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.358Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3dd2af1299cd4b7ca3899267: done: 0.047903 sec","job_status":"done","queue_duration_s":3.035696,"scheduling_latency_s":3.035743,"redis_calls":13,"redis_duration_s":0.004326,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000406197,"duration_s":0.047903,"completed_at":"2026-07-25T07:16:06.441Z","load_balancing_strategy":"primary","db_duration_s":0.005384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494vm-test-run-nixbot-gitlab> gitlab # [ 144.406721] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.476Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e14819fb4c3cad8b7b53e4ab","created_at":"2026-07-25T07:16:03.349Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-eeaff99b3c5f4b4a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.358Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e14819fb4c3cad8b7b53e4ab: start","job_status":"start","queue_duration_s":3.118745,"scheduling_latency_s":3.118861}1495vm-test-run-nixbot-gitlab> gitlab # [ 144.424224] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.494Z","message":"No existing merge request to be cleaned up."}1496vm-test-run-nixbot-gitlab> gitlab # [ 144.437569] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.507Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e14819fb4c3cad8b7b53e4ab","created_at":"2026-07-25T07:16:03.349Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-eeaff99b3c5f4b4a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.358Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e14819fb4c3cad8b7b53e4ab: done: 0.030848 sec","job_status":"done","queue_duration_s":3.118745,"scheduling_latency_s":3.118861,"redis_calls":10,"redis_duration_s":0.004632,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003441,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030848,"completed_at":"2026-07-25T07:16:06.507Z","load_balancing_strategy":"primary","db_duration_s":0.003076,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497vm-test-run-nixbot-gitlab> gitlab # [ 144.470798] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.540Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1216861a2b5a92247325cb04","created_at":"2026-07-25T07:16:03.349Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-eeaff99b3c5f4b4a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.358Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1216861a2b5a92247325cb04: start","job_status":"start","queue_duration_s":3.182924,"scheduling_latency_s":3.182966}1498vm-test-run-nixbot-gitlab> gitlab # [ 144.494606] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.565Z","message":"No existing merge request to be cleaned up."}1499vm-test-run-nixbot-gitlab> gitlab # [ 144.507704] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.577Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1216861a2b5a92247325cb04","created_at":"2026-07-25T07:16:03.349Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-eeaff99b3c5f4b4a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.358Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1216861a2b5a92247325cb04: done: 0.036789 sec","job_status":"done","queue_duration_s":3.182924,"scheduling_latency_s":3.182966,"redis_calls":10,"redis_duration_s":0.003772,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002931,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036789,"completed_at":"2026-07-25T07:16:06.577Z","load_balancing_strategy":"primary","db_duration_s":0.003102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500vm-test-run-nixbot-gitlab> gitlab # [ 144.540334] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.610Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"15c9ec8180497849dda9e4c2","created_at":"2026-07-25T07:16:03.349Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-eeaff99b3c5f4b4a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.358Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-15c9ec8180497849dda9e4c2: start","job_status":"start","queue_duration_s":3.252367,"scheduling_latency_s":3.252425}1501vm-test-run-nixbot-gitlab> gitlab # [ 144.564415] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.634Z","message":"No existing merge request to be cleaned up."}1502vm-test-run-nixbot-gitlab> gitlab # [ 144.577479] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.647Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"15c9ec8180497849dda9e4c2","created_at":"2026-07-25T07:16:03.349Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-eeaff99b3c5f4b4a","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"559a7cc63c06aa60a144c988df1f4a1f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.358Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-15c9ec8180497849dda9e4c2: done: 0.037078 sec","job_status":"done","queue_duration_s":3.252367,"scheduling_latency_s":3.252425,"redis_calls":10,"redis_duration_s":0.004532,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003215,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037078,"completed_at":"2026-07-25T07:16:06.647Z","load_balancing_strategy":"primary","db_duration_s":0.002784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503vm-test-run-nixbot-gitlab> gitlab # [ 144.610141] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8fee29708e5f2cc54182526","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8fee29708e5f2cc54182526: start","job_status":"start","queue_duration_s":3.236247,"scheduling_latency_s":3.236289}1504vm-test-run-nixbot-gitlab> gitlab # [ 144.650551] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8fee29708e5f2cc54182526","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8fee29708e5f2cc54182526: done: 0.04014 sec","job_status":"done","queue_duration_s":3.236247,"scheduling_latency_s":3.236289,"redis_calls":16,"redis_duration_s":0.003523,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000497,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000437207,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04014,"completed_at":"2026-07-25T07:16:06.720Z","load_balancing_strategy":"primary","db_duration_s":0.000846,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505vm-test-run-nixbot-gitlab> gitlab # [ 144.685549] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba92f6403f79ecdb11faaff9","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba92f6403f79ecdb11faaff9: start","job_status":"start","queue_duration_s":3.311566,"scheduling_latency_s":3.311611}1506vm-test-run-nixbot-gitlab> gitlab # [ 144.708907] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba92f6403f79ecdb11faaff9","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba92f6403f79ecdb11faaff9: done: 0.02346 sec","job_status":"done","queue_duration_s":3.311566,"scheduling_latency_s":3.311611,"redis_calls":13,"redis_duration_s":0.0038640000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002664,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02346,"completed_at":"2026-07-25T07:16:06.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507vm-test-run-nixbot-gitlab> gitlab # [ 144.742165] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7008d217158e30be9a95ec03","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7008d217158e30be9a95ec03: start","job_status":"start","queue_duration_s":3.368209,"scheduling_latency_s":3.368246}1508vm-test-run-nixbot-gitlab> gitlab # [ 144.764150] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7008d217158e30be9a95ec03","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7008d217158e30be9a95ec03: done: 0.022017 sec","job_status":"done","queue_duration_s":3.368209,"scheduling_latency_s":3.368246,"redis_calls":13,"redis_duration_s":0.003687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002488,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022017,"completed_at":"2026-07-25T07:16:06.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509vm-test-run-nixbot-gitlab> gitlab # [ 144.797748] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f868b0228676f5de111045d","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f868b0228676f5de111045d: start","job_status":"start","queue_duration_s":3.423943,"scheduling_latency_s":3.42398}1510vm-test-run-nixbot-gitlab> gitlab # [ 144.826586] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f868b0228676f5de111045d","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f868b0228676f5de111045d: done: 0.028558 sec","job_status":"done","queue_duration_s":3.423943,"scheduling_latency_s":3.42398,"redis_calls":13,"redis_duration_s":0.002405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000835,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028558,"completed_at":"2026-07-25T07:16:06.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511vm-test-run-nixbot-gitlab> gitlab # [ 144.859672] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"706b6422d2ee5006671aa36c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-706b6422d2ee5006671aa36c: start","job_status":"start","queue_duration_s":3.48585,"scheduling_latency_s":3.485888}1512vm-test-run-nixbot-gitlab> gitlab # [ 144.881672] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"706b6422d2ee5006671aa36c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-706b6422d2ee5006671aa36c: done: 0.02188 sec","job_status":"done","queue_duration_s":3.48585,"scheduling_latency_s":3.485888,"redis_calls":13,"redis_duration_s":0.003872,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002575,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02188,"completed_at":"2026-07-25T07:16:06.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513vm-test-run-nixbot-gitlab> gitlab # [ 144.916293] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:06.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90e1d78ba7a51888702bb26","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90e1d78ba7a51888702bb26: start","job_status":"start","queue_duration_s":3.542275,"scheduling_latency_s":3.542325}1514vm-test-run-nixbot-gitlab> gitlab # [ 144.942608] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90e1d78ba7a51888702bb26","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90e1d78ba7a51888702bb26: done: 0.026295 sec","job_status":"done","queue_duration_s":3.542275,"scheduling_latency_s":3.542325,"redis_calls":13,"redis_duration_s":0.003979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002656,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026295,"completed_at":"2026-07-25T07:16:07.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515vm-test-run-nixbot-gitlab> gitlab # [ 144.976478] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acf021cd90a604058ce4e23f","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acf021cd90a604058ce4e23f: start","job_status":"start","queue_duration_s":3.602548,"scheduling_latency_s":3.602589}1516vm-test-run-nixbot-gitlab> gitlab # [ 145.008160] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acf021cd90a604058ce4e23f","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acf021cd90a604058ce4e23f: done: 0.03142 sec","job_status":"done","queue_duration_s":3.602548,"scheduling_latency_s":3.602589,"redis_calls":13,"redis_duration_s":0.0026709999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03142,"completed_at":"2026-07-25T07:16:07.077Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517vm-test-run-nixbot-gitlab> gitlab # [ 145.042424] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c986e71b0b258a4b96d138c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c986e71b0b258a4b96d138c: start","job_status":"start","queue_duration_s":3.668522,"scheduling_latency_s":3.668565}1518vm-test-run-nixbot-gitlab> gitlab # [ 145.067124] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c986e71b0b258a4b96d138c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c986e71b0b258a4b96d138c: done: 0.024433 sec","job_status":"done","queue_duration_s":3.668522,"scheduling_latency_s":3.668565,"redis_calls":13,"redis_duration_s":0.0037719999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002567,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024433,"completed_at":"2026-07-25T07:16:07.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519vm-test-run-nixbot-gitlab> gitlab # [ 145.101304] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"095af5ee12115df0f87f7a5b","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-095af5ee12115df0f87f7a5b: start","job_status":"start","queue_duration_s":3.72681,"scheduling_latency_s":3.726853}1520vm-test-run-nixbot-gitlab> gitlab # [ 145.125280] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"095af5ee12115df0f87f7a5b","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-095af5ee12115df0f87f7a5b: done: 0.024298 sec","job_status":"done","queue_duration_s":3.72681,"scheduling_latency_s":3.726853,"redis_calls":13,"redis_duration_s":0.003657,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002465,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024298,"completed_at":"2026-07-25T07:16:07.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521vm-test-run-nixbot-gitlab> gitlab # [ 145.158827] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90e091219240f3ed68519cce","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90e091219240f3ed68519cce: start","job_status":"start","queue_duration_s":3.78487,"scheduling_latency_s":3.784912}1522vm-test-run-nixbot-gitlab> gitlab # [ 145.189863] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90e091219240f3ed68519cce","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90e091219240f3ed68519cce: done: 0.030948 sec","job_status":"done","queue_duration_s":3.78487,"scheduling_latency_s":3.784912,"redis_calls":13,"redis_duration_s":0.0025310000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001667,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030948,"completed_at":"2026-07-25T07:16:07.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523vm-test-run-nixbot-gitlab> gitlab # [ 145.224676] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90823ef817ede24b39bf1fb4","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90823ef817ede24b39bf1fb4: start","job_status":"start","queue_duration_s":3.850638,"scheduling_latency_s":3.850688}1524vm-test-run-nixbot-gitlab> gitlab # [ 145.245880] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90823ef817ede24b39bf1fb4","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90823ef817ede24b39bf1fb4: done: 0.021414 sec","job_status":"done","queue_duration_s":3.850638,"scheduling_latency_s":3.850688,"redis_calls":13,"redis_duration_s":0.004255,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021414,"completed_at":"2026-07-25T07:16:07.315Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525vm-test-run-nixbot-gitlab> gitlab # [ 145.279516] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f52ee583b9fdde5f9d9b961","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f52ee583b9fdde5f9d9b961: start","job_status":"start","queue_duration_s":3.905904,"scheduling_latency_s":3.905928}1526vm-test-run-nixbot-gitlab> gitlab # [ 145.433947] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f52ee583b9fdde5f9d9b961","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f52ee583b9fdde5f9d9b961: done: 0.153776 sec","job_status":"done","queue_duration_s":3.905904,"scheduling_latency_s":3.905928,"redis_calls":13,"redis_duration_s":0.11656399999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.115405,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.153776,"completed_at":"2026-07-25T07:16:07.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527vm-test-run-nixbot-gitlab> gitlab # [ 145.502584] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd34756338e949a08814ea59","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd34756338e949a08814ea59: start","job_status":"start","queue_duration_s":4.061844,"scheduling_latency_s":4.061884}1528vm-test-run-nixbot-gitlab> gitlab # [ 145.512643] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd34756338e949a08814ea59","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd34756338e949a08814ea59: done: 0.021902 sec","job_status":"done","queue_duration_s":4.061844,"scheduling_latency_s":4.061884,"redis_calls":13,"redis_duration_s":0.002658,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021902,"completed_at":"2026-07-25T07:16:07.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529vm-test-run-nixbot-gitlab> gitlab # [ 145.544266] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39a4f21b6172c22206ef409c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39a4f21b6172c22206ef409c: start","job_status":"start","queue_duration_s":4.085676,"scheduling_latency_s":4.085701}1530vm-test-run-nixbot-gitlab> gitlab # [ 145.554310] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39a4f21b6172c22206ef409c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39a4f21b6172c22206ef409c: done: 0.016965 sec","job_status":"done","queue_duration_s":4.085676,"scheduling_latency_s":4.085701,"redis_calls":13,"redis_duration_s":0.002993,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016965,"completed_at":"2026-07-25T07:16:07.546Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531vm-test-run-nixbot-gitlab> gitlab # [ 145.586351] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"944ae9ff6e1e9f4d6b9a095a","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-944ae9ff6e1e9f4d6b9a095a: start","job_status":"start","queue_duration_s":4.10422,"scheduling_latency_s":4.104244}1532vm-test-run-nixbot-gitlab> gitlab # [ 145.587388] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"944ae9ff6e1e9f4d6b9a095a","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-944ae9ff6e1e9f4d6b9a095a: done: 0.01295 sec","job_status":"done","queue_duration_s":4.10422,"scheduling_latency_s":4.104244,"redis_calls":13,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001686,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01295,"completed_at":"2026-07-25T07:16:07.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533vm-test-run-nixbot-gitlab> gitlab # [ 145.592668] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f90e8585c6ae6ee671be4c4","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f90e8585c6ae6ee671be4c4: start","job_status":"start","queue_duration_s":4.118179,"scheduling_latency_s":4.118192}1534vm-test-run-nixbot-gitlab> gitlab # [ 145.634924] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f90e8585c6ae6ee671be4c4","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f90e8585c6ae6ee671be4c4: done: 0.009657 sec","job_status":"done","queue_duration_s":4.118179,"scheduling_latency_s":4.118192,"redis_calls":13,"redis_duration_s":0.00243,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009657,"completed_at":"2026-07-25T07:16:07.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535vm-test-run-nixbot-gitlab> gitlab # [ 145.636231] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d43eb606e915fe12380e81db","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d43eb606e915fe12380e81db: start","job_status":"start","queue_duration_s":4.128829,"scheduling_latency_s":4.128842}1536vm-test-run-nixbot-gitlab> gitlab # [ 145.644819] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d43eb606e915fe12380e81db","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d43eb606e915fe12380e81db: done: 0.009718 sec","job_status":"done","queue_duration_s":4.128829,"scheduling_latency_s":4.128842,"redis_calls":13,"redis_duration_s":0.002554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001746,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009718,"completed_at":"2026-07-25T07:16:07.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537vm-test-run-nixbot-gitlab> gitlab # [ 145.696850] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"354896d5b5a86156f063629f","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-354896d5b5a86156f063629f: start","job_status":"start","queue_duration_s":4.139547,"scheduling_latency_s":4.13956}1538vm-test-run-nixbot-gitlab> gitlab # [ 145.698115] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"354896d5b5a86156f063629f","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-354896d5b5a86156f063629f: done: 0.009752 sec","job_status":"done","queue_duration_s":4.139547,"scheduling_latency_s":4.13956,"redis_calls":13,"redis_duration_s":0.002476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001698,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009752,"completed_at":"2026-07-25T07:16:07.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539vm-test-run-nixbot-gitlab> gitlab # [ 145.733561] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca2baad0f90116a8c48008ae","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca2baad0f90116a8c48008ae: start","job_status":"start","queue_duration_s":4.150365,"scheduling_latency_s":4.150377}1540vm-test-run-nixbot-gitlab> gitlab # [ 145.734416] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca2baad0f90116a8c48008ae","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca2baad0f90116a8c48008ae: done: 0.009659 sec","job_status":"done","queue_duration_s":4.150365,"scheduling_latency_s":4.150377,"redis_calls":13,"redis_duration_s":0.0024850000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001639,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009659,"completed_at":"2026-07-25T07:16:07.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541vm-test-run-nixbot-gitlab> gitlab # [ 145.762055] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e93eb762bbeb2d756724d9","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e93eb762bbeb2d756724d9: start","job_status":"start","queue_duration_s":4.16101,"scheduling_latency_s":4.161023}1542vm-test-run-nixbot-gitlab> gitlab # [ 145.772499] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7e93eb762bbeb2d756724d9","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7e93eb762bbeb2d756724d9: done: 0.009522 sec","job_status":"done","queue_duration_s":4.16101,"scheduling_latency_s":4.161023,"redis_calls":13,"redis_duration_s":0.0024549999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009522,"completed_at":"2026-07-25T07:16:07.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543vm-test-run-nixbot-gitlab> gitlab # [ 145.826614] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e6a525551b11c5413fb73be","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e6a525551b11c5413fb73be: start","job_status":"start","queue_duration_s":4.171537,"scheduling_latency_s":4.17155}1544vm-test-run-nixbot-gitlab> gitlab # [ 145.827287] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e6a525551b11c5413fb73be","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e6a525551b11c5413fb73be: done: 0.009532 sec","job_status":"done","queue_duration_s":4.171537,"scheduling_latency_s":4.17155,"redis_calls":13,"redis_duration_s":0.002398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001616,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009532,"completed_at":"2026-07-25T07:16:07.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545vm-test-run-nixbot-gitlab> gitlab # [ 145.845245] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091b41cb20c8f038c6d7492e","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091b41cb20c8f038c6d7492e: start","job_status":"start","queue_duration_s":4.182111,"scheduling_latency_s":4.182125}1546vm-test-run-nixbot-gitlab> gitlab # [ 145.883553] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091b41cb20c8f038c6d7492e","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091b41cb20c8f038c6d7492e: done: 0.009936 sec","job_status":"done","queue_duration_s":4.182111,"scheduling_latency_s":4.182125,"redis_calls":13,"redis_duration_s":0.0028269999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001145,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001682,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009936,"completed_at":"2026-07-25T07:16:07.636Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547vm-test-run-nixbot-gitlab> gitlab # [ 145.885879] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e4d275bf8380c44671022c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e4d275bf8380c44671022c: start","job_status":"start","queue_duration_s":4.193011,"scheduling_latency_s":4.193023}1548vm-test-run-nixbot-gitlab> gitlab # [ 145.922269] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3e4d275bf8380c44671022c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3e4d275bf8380c44671022c: done: 0.009545 sec","job_status":"done","queue_duration_s":4.193011,"scheduling_latency_s":4.193023,"redis_calls":13,"redis_duration_s":0.002479,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001687,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009545,"completed_at":"2026-07-25T07:16:07.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549vm-test-run-nixbot-gitlab> gitlab # [ 145.958751] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb1ccc676eb28e5ab98c73a5","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb1ccc676eb28e5ab98c73a5: start","job_status":"start","queue_duration_s":4.203562,"scheduling_latency_s":4.203575}1550vm-test-run-nixbot-gitlab> gitlab # [ 145.959751] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:07.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb1ccc676eb28e5ab98c73a5","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb1ccc676eb28e5ab98c73a5: done: 0.009557 sec","job_status":"done","queue_duration_s":4.203562,"scheduling_latency_s":4.203575,"redis_calls":13,"redis_duration_s":0.002438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001653,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009557,"completed_at":"2026-07-25T07:16:07.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551vm-test-run-nixbot-gitlab> gitlab # [ 146.005534] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae0dcba6364822f7d5d84cff","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae0dcba6364822f7d5d84cff: start","job_status":"start","queue_duration_s":4.631466,"scheduling_latency_s":4.631516}1552vm-test-run-nixbot-gitlab> gitlab # [ 146.037148] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae0dcba6364822f7d5d84cff","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae0dcba6364822f7d5d84cff: done: 0.031665 sec","job_status":"done","queue_duration_s":4.631466,"scheduling_latency_s":4.631516,"redis_calls":13,"redis_duration_s":0.0026449999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031665,"completed_at":"2026-07-25T07:16:08.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553vm-test-run-nixbot-gitlab> gitlab # [ 146.071870] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03651986188101cb66c41304","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03651986188101cb66c41304: start","job_status":"start","queue_duration_s":4.697941,"scheduling_latency_s":4.697987}1554vm-test-run-nixbot-gitlab> gitlab # [ 146.094563] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03651986188101cb66c41304","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03651986188101cb66c41304: done: 0.022709 sec","job_status":"done","queue_duration_s":4.697941,"scheduling_latency_s":4.697987,"redis_calls":13,"redis_duration_s":0.003806,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002535,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022709,"completed_at":"2026-07-25T07:16:08.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555vm-test-run-nixbot-gitlab> gitlab # [ 146.130214] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e01c541c50ca45fdf7e1549","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e01c541c50ca45fdf7e1549: start","job_status":"start","queue_duration_s":4.755564,"scheduling_latency_s":4.755613}1556vm-test-run-nixbot-gitlab> gitlab # [ 146.154574] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e01c541c50ca45fdf7e1549","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e01c541c50ca45fdf7e1549: done: 0.025031 sec","job_status":"done","queue_duration_s":4.755564,"scheduling_latency_s":4.755613,"redis_calls":13,"redis_duration_s":0.003903,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001267,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002636,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025031,"completed_at":"2026-07-25T07:16:08.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557vm-test-run-nixbot-gitlab> gitlab # [ 146.188468] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e340eeb6f1cc75fc4beadd87","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e340eeb6f1cc75fc4beadd87: start","job_status":"start","queue_duration_s":4.814584,"scheduling_latency_s":4.814626}1558vm-test-run-nixbot-gitlab> gitlab # [ 146.219495] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e340eeb6f1cc75fc4beadd87","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e340eeb6f1cc75fc4beadd87: done: 0.030787 sec","job_status":"done","queue_duration_s":4.814584,"scheduling_latency_s":4.814626,"redis_calls":13,"redis_duration_s":0.00272,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030787,"completed_at":"2026-07-25T07:16:08.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559vm-test-run-nixbot-gitlab> gitlab # [ 146.253665] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b1dd46f720f061c3c8006a9","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b1dd46f720f061c3c8006a9: start","job_status":"start","queue_duration_s":4.879682,"scheduling_latency_s":4.879785}1560vm-test-run-nixbot-gitlab> gitlab # [ 146.276657] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b1dd46f720f061c3c8006a9","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b1dd46f720f061c3c8006a9: done: 0.023036 sec","job_status":"done","queue_duration_s":4.879682,"scheduling_latency_s":4.879785,"redis_calls":13,"redis_duration_s":0.0039380000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023036,"completed_at":"2026-07-25T07:16:08.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561vm-test-run-nixbot-gitlab> gitlab # [ 146.311483] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f53d81bf61df19b23d4d95d4","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f53d81bf61df19b23d4d95d4: start","job_status":"start","queue_duration_s":4.937498,"scheduling_latency_s":4.937548}1562vm-test-run-nixbot-gitlab> gitlab # [ 146.342142] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f53d81bf61df19b23d4d95d4","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f53d81bf61df19b23d4d95d4: done: 0.030648 sec","job_status":"done","queue_duration_s":4.937498,"scheduling_latency_s":4.937548,"redis_calls":13,"redis_duration_s":0.007344,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002794,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00455,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030648,"completed_at":"2026-07-25T07:16:08.412Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563vm-test-run-nixbot-gitlab> gitlab # [ 146.375561] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f59fa7be8a4dca6368d96c5d","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f59fa7be8a4dca6368d96c5d: start","job_status":"start","queue_duration_s":5.001722,"scheduling_latency_s":5.001817}1564vm-test-run-nixbot-gitlab> gitlab # [ 146.399639] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f59fa7be8a4dca6368d96c5d","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f59fa7be8a4dca6368d96c5d: done: 0.023881 sec","job_status":"done","queue_duration_s":5.001722,"scheduling_latency_s":5.001817,"redis_calls":13,"redis_duration_s":0.0037090000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002478,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023881,"completed_at":"2026-07-25T07:16:08.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565vm-test-run-nixbot-gitlab> gitlab # [ 146.432998] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10ac8137fa1fbdee76cef8f5","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10ac8137fa1fbdee76cef8f5: start","job_status":"start","queue_duration_s":5.059031,"scheduling_latency_s":5.059072}1566vm-test-run-nixbot-gitlab> gitlab # [ 146.463860] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10ac8137fa1fbdee76cef8f5","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10ac8137fa1fbdee76cef8f5: done: 0.030706 sec","job_status":"done","queue_duration_s":5.059031,"scheduling_latency_s":5.059072,"redis_calls":13,"redis_duration_s":0.002606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001728,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030706,"completed_at":"2026-07-25T07:16:08.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567vm-test-run-nixbot-gitlab> gitlab # [ 146.497258] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6d36c1f8bc0fe13d04ec37c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6d36c1f8bc0fe13d04ec37c: start","job_status":"start","queue_duration_s":5.123366,"scheduling_latency_s":5.123397}1568vm-test-run-nixbot-gitlab> gitlab # [ 146.522055] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6d36c1f8bc0fe13d04ec37c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6d36c1f8bc0fe13d04ec37c: done: 0.02462 sec","job_status":"done","queue_duration_s":5.123366,"scheduling_latency_s":5.123397,"redis_calls":13,"redis_duration_s":0.0038840000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001325,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002559,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02462,"completed_at":"2026-07-25T07:16:08.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569vm-test-run-nixbot-gitlab> gitlab # [ 146.555109] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef056e89c4f5016a90ff61a","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef056e89c4f5016a90ff61a: start","job_status":"start","queue_duration_s":5.181099,"scheduling_latency_s":5.18114}1570vm-test-run-nixbot-gitlab> gitlab # [ 146.585886] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef056e89c4f5016a90ff61a","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef056e89c4f5016a90ff61a: done: 0.030676 sec","job_status":"done","queue_duration_s":5.181099,"scheduling_latency_s":5.18114,"redis_calls":13,"redis_duration_s":0.0026030000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030676,"completed_at":"2026-07-25T07:16:08.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571vm-test-run-nixbot-gitlab> gitlab # [ 146.619107] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10b0667a911642aa437f19a7","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10b0667a911642aa437f19a7: start","job_status":"start","queue_duration_s":5.245248,"scheduling_latency_s":5.245278}1572vm-test-run-nixbot-gitlab> gitlab # [ 146.654174] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10b0667a911642aa437f19a7","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10b0667a911642aa437f19a7: done: 0.034918 sec","job_status":"done","queue_duration_s":5.245248,"scheduling_latency_s":5.245278,"redis_calls":13,"redis_duration_s":0.003999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002634,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034918,"completed_at":"2026-07-25T07:16:08.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573vm-test-run-nixbot-gitlab> gitlab # [ 146.687322] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7550df26d4a8ad7b67709b3","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7550df26d4a8ad7b67709b3: start","job_status":"start","queue_duration_s":5.313214,"scheduling_latency_s":5.313273}1574vm-test-run-nixbot-gitlab> gitlab # [ 146.712800] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7550df26d4a8ad7b67709b3","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7550df26d4a8ad7b67709b3: done: 0.025654 sec","job_status":"done","queue_duration_s":5.313214,"scheduling_latency_s":5.313273,"redis_calls":13,"redis_duration_s":0.003833,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002572,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025654,"completed_at":"2026-07-25T07:16:08.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575vm-test-run-nixbot-gitlab> gitlab # [ 146.747715] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef208b013a22686628cd7925","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef208b013a22686628cd7925: start","job_status":"start","queue_duration_s":5.373596,"scheduling_latency_s":5.373638}1576vm-test-run-nixbot-gitlab> gitlab # [ 146.779093] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef208b013a22686628cd7925","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef208b013a22686628cd7925: done: 0.031353 sec","job_status":"done","queue_duration_s":5.373596,"scheduling_latency_s":5.373638,"redis_calls":13,"redis_duration_s":0.002715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031353,"completed_at":"2026-07-25T07:16:08.848Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577vm-test-run-nixbot-gitlab> gitlab # [ 146.813992] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad7b39078b8f4ae6e34a759c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad7b39078b8f4ae6e34a759c: start","job_status":"start","queue_duration_s":5.440015,"scheduling_latency_s":5.440065}1578vm-test-run-nixbot-gitlab> gitlab # [ 146.846101] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad7b39078b8f4ae6e34a759c","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad7b39078b8f4ae6e34a759c: done: 0.03207 sec","job_status":"done","queue_duration_s":5.440015,"scheduling_latency_s":5.440065,"redis_calls":13,"redis_duration_s":0.003711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00261,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03207,"completed_at":"2026-07-25T07:16:08.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579vm-test-run-nixbot-gitlab> gitlab # [ 146.881445] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c46cde1b0281cb6706b5854","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c46cde1b0281cb6706b5854: start","job_status":"start","queue_duration_s":5.507433,"scheduling_latency_s":5.507485}1580vm-test-run-nixbot-gitlab> gitlab # [ 146.906893] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:08.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c46cde1b0281cb6706b5854","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c46cde1b0281cb6706b5854: done: 0.025534 sec","job_status":"done","queue_duration_s":5.507433,"scheduling_latency_s":5.507485,"redis_calls":13,"redis_duration_s":0.00379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001239,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002551,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025534,"completed_at":"2026-07-25T07:16:08.976Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581vm-test-run-nixbot-gitlab> gitlab # [ 146.943576] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eee48f9c4dcf158989e4e34","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eee48f9c4dcf158989e4e34: start","job_status":"start","queue_duration_s":5.569583,"scheduling_latency_s":5.569632}1582vm-test-run-nixbot-gitlab> gitlab # [ 146.968136] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eee48f9c4dcf158989e4e34","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eee48f9c4dcf158989e4e34: done: 0.024594 sec","job_status":"done","queue_duration_s":5.569583,"scheduling_latency_s":5.569632,"redis_calls":13,"redis_duration_s":0.003924,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001337,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002587,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024594,"completed_at":"2026-07-25T07:16:09.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583vm-test-run-nixbot-gitlab> gitlab # [ 147.004539] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ea89da29e46a8c005b8b67b","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ea89da29e46a8c005b8b67b: start","job_status":"start","queue_duration_s":5.630428,"scheduling_latency_s":5.630474}1584vm-test-run-nixbot-gitlab> gitlab # [ 147.034557] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ea89da29e46a8c005b8b67b","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ea89da29e46a8c005b8b67b: done: 0.030058 sec","job_status":"done","queue_duration_s":5.630428,"scheduling_latency_s":5.630474,"redis_calls":13,"redis_duration_s":0.002558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001713,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030058,"completed_at":"2026-07-25T07:16:09.104Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585vm-test-run-nixbot-gitlab> gitlab # [ 147.067884] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b7265c3e4b4726848475654","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b7265c3e4b4726848475654: start","job_status":"start","queue_duration_s":5.693952,"scheduling_latency_s":5.693992}1586vm-test-run-nixbot-gitlab> gitlab # [ 147.090985] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b7265c3e4b4726848475654","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b7265c3e4b4726848475654: done: 0.023106 sec","job_status":"done","queue_duration_s":5.693952,"scheduling_latency_s":5.693992,"redis_calls":13,"redis_duration_s":0.004104,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00282,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023106,"completed_at":"2026-07-25T07:16:09.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587vm-test-run-nixbot-gitlab> gitlab # [ 147.125608] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb83433db8c61c18289cc669","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb83433db8c61c18289cc669: start","job_status":"start","queue_duration_s":5.751585,"scheduling_latency_s":5.751624}1588vm-test-run-nixbot-gitlab> gitlab # [ 147.156143] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb83433db8c61c18289cc669","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb83433db8c61c18289cc669: done: 0.029819 sec","job_status":"done","queue_duration_s":5.751585,"scheduling_latency_s":5.751624,"redis_calls":13,"redis_duration_s":0.002559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001677,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029819,"completed_at":"2026-07-25T07:16:09.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589vm-test-run-nixbot-gitlab> gitlab # [ 147.157760] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fedc7b03c0dadec30e02009","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fedc7b03c0dadec30e02009: start","job_status":"start","queue_duration_s":5.783097,"scheduling_latency_s":5.783127}1590vm-test-run-nixbot-gitlab> gitlab # [ 147.218156] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fedc7b03c0dadec30e02009","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fedc7b03c0dadec30e02009: done: 0.060963 sec","job_status":"done","queue_duration_s":5.783097,"scheduling_latency_s":5.783127,"redis_calls":13,"redis_duration_s":0.002679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060963,"completed_at":"2026-07-25T07:16:09.288Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591vm-test-run-nixbot-gitlab> gitlab # [ 147.252090] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59ef7ce5bc9d0aeb7442d200","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59ef7ce5bc9d0aeb7442d200: start","job_status":"start","queue_duration_s":5.878086,"scheduling_latency_s":5.878137}1592vm-test-run-nixbot-gitlab> gitlab # [ 147.290893] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59ef7ce5bc9d0aeb7442d200","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59ef7ce5bc9d0aeb7442d200: done: 0.03865 sec","job_status":"done","queue_duration_s":5.878086,"scheduling_latency_s":5.878137,"redis_calls":13,"redis_duration_s":0.002856,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03865,"completed_at":"2026-07-25T07:16:09.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593vm-test-run-nixbot-gitlab> gitlab # [ 147.324146] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffa57065fefdc877b3131d92","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffa57065fefdc877b3131d92: start","job_status":"start","queue_duration_s":5.950253,"scheduling_latency_s":5.950296}1594vm-test-run-nixbot-gitlab> gitlab # [ 147.361167] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffa57065fefdc877b3131d92","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffa57065fefdc877b3131d92: done: 0.036735 sec","job_status":"done","queue_duration_s":5.950253,"scheduling_latency_s":5.950296,"redis_calls":13,"redis_duration_s":0.007121000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004634,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036735,"completed_at":"2026-07-25T07:16:09.430Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595vm-test-run-nixbot-gitlab> gitlab # [ 147.394568] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11b3293d17ecd23b510b91c0","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11b3293d17ecd23b510b91c0: start","job_status":"start","queue_duration_s":6.02062,"scheduling_latency_s":6.020669}1596vm-test-run-nixbot-gitlab> gitlab # [ 147.424922] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11b3293d17ecd23b510b91c0","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11b3293d17ecd23b510b91c0: done: 0.030369 sec","job_status":"done","queue_duration_s":6.02062,"scheduling_latency_s":6.020669,"redis_calls":13,"redis_duration_s":0.002554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030369,"completed_at":"2026-07-25T07:16:09.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597vm-test-run-nixbot-gitlab> gitlab # [ 147.458743] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31dd948a79a3ac0d2cad0c14","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31dd948a79a3ac0d2cad0c14: start","job_status":"start","queue_duration_s":6.084808,"scheduling_latency_s":6.084859}1598vm-test-run-nixbot-gitlab> gitlab # [ 147.484120] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31dd948a79a3ac0d2cad0c14","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31dd948a79a3ac0d2cad0c14: done: 0.0254 sec","job_status":"done","queue_duration_s":6.084808,"scheduling_latency_s":6.084859,"redis_calls":13,"redis_duration_s":0.003752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002524,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0254,"completed_at":"2026-07-25T07:16:09.554Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599vm-test-run-nixbot-gitlab> gitlab # [ 147.520331] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adfddc2c5fdcda19d034c339","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adfddc2c5fdcda19d034c339: start","job_status":"start","queue_duration_s":6.146422,"scheduling_latency_s":6.146464}1600vm-test-run-nixbot-gitlab> gitlab # [ 147.551598] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adfddc2c5fdcda19d034c339","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adfddc2c5fdcda19d034c339: done: 0.03108 sec","job_status":"done","queue_duration_s":6.146422,"scheduling_latency_s":6.146464,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03108,"completed_at":"2026-07-25T07:16:09.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601vm-test-run-nixbot-gitlab> gitlab # [ 147.584953] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5adb74909edaa7ac2cce98d3","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5adb74909edaa7ac2cce98d3: start","job_status":"start","queue_duration_s":6.210986,"scheduling_latency_s":6.211035}1602vm-test-run-nixbot-gitlab> gitlab # [ 147.615455] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:09.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5adb74909edaa7ac2cce98d3","created_at":"2026-07-25T07:16:03.399Z","trace_propagation_headers":{"sentry-trace":"d38618f03b6844ff954c4f4e7e86f80f-f200e5e769534cdc","baggage":"sentry-trace_id=d38618f03b6844ff954c4f4e7e86f80f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"1ba7f45f20fd4660341a4092f202b7eb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:03.444Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5adb74909edaa7ac2cce98d3: done: 0.030405 sec","job_status":"done","queue_duration_s":6.210986,"scheduling_latency_s":6.211035,"redis_calls":13,"redis_duration_s":0.002724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030405,"completed_at":"2026-07-25T07:16:09.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603vm-test-run-nixbot-gitlab> gitlab # [ 153.030308] setup-gitlab-start[2596]: W, [2026-07-25T07:16:15.100121 #2596] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1604vm-test-run-nixbot-gitlab> gitlab # [ 174.424931] runuser[2595]: pam_unix(runuser:session): session closed for user gitlab1605vm-test-run-nixbot-gitlab> gitlab # [ 174.429532] setup-gitlab-start[2803]: ++ jq -r .token1606vm-test-run-nixbot-gitlab> gitlab # [ 174.431947] setup-gitlab-start[2804]: +++ date -d '+7 days' +%F1607vm-test-run-nixbot-gitlab> gitlab # [ 174.434451] setup-gitlab-start[2802]: ++ curl -fs -X POST -H 'Authorization: Bearer 2b8b82118a81118e2eade78024581a225f5188cb4d204d25d712198f66406ac2' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-08-01"}' http://gitlab/api/v4/users/1/personal_access_tokens1608vm-test-run-nixbot-gitlab> gitlab # [ 175.071423] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:37.141Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"61ccf5c3105fff2b1f6e2627","created_at":"2026-07-25T07:16:37.119Z","trace_propagation_headers":{"sentry-trace":"adf4a494f33f4d178d6234a2ee54df2d-dc6d9e1e8dab4fe7","baggage":"sentry-trace_id=adf4a494f33f4d178d6234a2ee54df2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC243GZD5F4T9MNZ3MM0RWH","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:6dbd496935b171e18cca53291a5cabd3de03610996c57c0f35290f9c1d14fd4b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:37.138Z","job_size_bytes":451,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-61ccf5c3105fff2b1f6e2627: start","job_status":"start","queue_duration_s":0.002294,"scheduling_latency_s":0.002322}1609vm-test-run-nixbot-gitlab> gitlab # [ 175.114153] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:37 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 6721610vm-test-run-nixbot-gitlab> gitlab # [ 175.118183] setup-gitlab-start[2557]: + TOKEN=glpat-_9A5YdvmBfGpWk-0JA6hyG86MQp1OjEH.01.0w1vdler91611vm-test-run-nixbot-gitlab> gitlab # [ 175.120396] setup-gitlab-start[2557]: + test -n glpat-_9A5YdvmBfGpWk-0JA6hyG86MQp1OjEH.01.0w1vdler91612vm-test-run-nixbot-gitlab> gitlab # [ 175.122601] setup-gitlab-start[2557]: + test glpat-_9A5YdvmBfGpWk-0JA6hyG86MQp1OjEH.01.0w1vdler9 '!=' null1613vm-test-run-nixbot-gitlab> gitlab # [ 175.124873] setup-gitlab-start[2557]: + mkdir -p /var/lib/secrets1614vm-test-run-nixbot-gitlab> gitlab # [ 175.126466] setup-gitlab-start[2557]: + echo glpat-_9A5YdvmBfGpWk-0JA6hyG86MQp1OjEH.01.0w1vdler91615vm-test-run-nixbot-gitlab> gitlab # [ 175.128576] setup-gitlab-start[2557]: + chmod 644 /var/lib/secrets/gitlab-token1616vm-test-run-nixbot-gitlab> gitlab # [ 175.130368] setup-gitlab-start[2557]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-_9A5YdvmBfGpWk-0JA6hyG86MQp1OjEH.01.0w1vdler9' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1617vm-test-run-nixbot-gitlab> gitlab # [ 175.207146] sidekiq-cluster[2039]: {"severity":"WARN","time":"2026-07-25T07:16:37.276Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"61ccf5c3105fff2b1f6e2627","created_at":"2026-07-25T07:16:37.119Z","trace_propagation_headers":{"sentry-trace":"adf4a494f33f4d178d6234a2ee54df2d-dc6d9e1e8dab4fe7","baggage":"sentry-trace_id=adf4a494f33f4d178d6234a2ee54df2d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC243GZD5F4T9MNZ3MM0RWH","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:6dbd496935b171e18cca53291a5cabd3de03610996c57c0f35290f9c1d14fd4b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:37.138Z","job_size_bytes":451,"pid":2039,"sidekiq_tid":"m0p3","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-61ccf5c3105fff2b1f6e2627: fail: 0.134468 sec","job_status":"fail","queue_duration_s":0.002294,"scheduling_latency_s":0.002322,"redis_calls":11,"redis_duration_s":0.002666,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000666,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00152,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00048,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000559848,"duration_s":0.134468,"completed_at":"2026-07-25T07:16:37.275Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.038769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1618vm-test-run-nixbot-gitlab> gitlab # [ 175.683198] gitaly[1347]: time="2026-07-25T07:16:37.753Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:47.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:37.752" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619vm-test-run-nixbot-gitlab> gitlab # [ 175.685206] gitaly[1347]: time="2026-07-25T07:16:37.753Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:47.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:37.752" grpc.time_ms=0.27 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620vm-test-run-nixbot-gitlab> gitlab # [ 175.839333] gitaly[1347]: time="2026-07-25T07:16:37.909Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:47.158" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:37.909" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621vm-test-run-nixbot-gitlab> gitlab # [ 175.841284] gitaly[1347]: time="2026-07-25T07:16:37.910Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:47.158" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:37.909" grpc.time_ms=0.443 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622vm-test-run-nixbot-gitlab> gitlab # [ 175.922666] gitaly[1347]: time="2026-07-25T07:16:37.993Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 diskcache=e7ad0ff2-7859-4717-8652-82749564d514 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T07:16:47.208" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:37.958" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1623vm-test-run-nixbot-gitlab> gitlab # [ 175.924294] gitaly[1347]: time="2026-07-25T07:16:37.993Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=32 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T07:16:47.208" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:37.958" grpc.time_ms=34.522 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1624vm-test-run-nixbot-gitlab> gitlab # [ 175.938524] gitaly[1347]: time="2026-07-25T07:16:38.009Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:48.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.008" pid=1347 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1625vm-test-run-nixbot-gitlab> gitlab # [ 175.940341] gitaly[1347]: time="2026-07-25T07:16:38.009Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:48.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.008" grpc.time_ms=0.845 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1626vm-test-run-nixbot-gitlab> gitlab # [ 175.955474] gitaly[1347]: time="2026-07-25T07:16:38.026Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T07:16:48.013" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.014" grpc.time_ms=11.684 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627vm-test-run-nixbot-gitlab> gitlab # [ 175.980172] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.050Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6af29b0f4d5a463255af9ed4","created_at":"2026-07-25T07:16:38.036Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.048Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6af29b0f4d5a463255af9ed4: start","job_status":"start","queue_duration_s":0.001967,"scheduling_latency_s":0.002017}1628vm-test-run-nixbot-gitlab> gitlab # [ 175.999247] gitaly[1347]: time="2026-07-25T07:16:38.069Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:48.069" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.069" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1629vm-test-run-nixbot-gitlab> gitlab # [ 176.000140] gitaly[1347]: time="2026-07-25T07:16:38.070Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:48.069" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.069" grpc.time_ms=0.407 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1630vm-test-run-nixbot-gitlab> gitlab # [ 176.034076] gitaly[1347]: time="2026-07-25T07:16:38.104Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 diskcache=8471581d-4792-4a24-aa8d-687ffff1df10 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T07:16:48.073" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.073" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1631vm-test-run-nixbot-gitlab> gitlab # [ 176.035290] gitaly[1347]: time="2026-07-25T07:16:38.104Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=326 command.oublock=32 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-07-25T07:16:48.073" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.073" grpc.time_ms=31.138 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1632vm-test-run-nixbot-gitlab> gitlab # [ 176.039896] gitaly[1347]: time="2026-07-25T07:16:38.110Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:48.109" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.110" pid=1347 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1633vm-test-run-nixbot-gitlab> gitlab # [ 176.040788] gitaly[1347]: time="2026-07-25T07:16:38.110Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:48.109" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.110" grpc.time_ms=0.343 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1634vm-test-run-nixbot-gitlab> gitlab # [ 176.048133] gitaly[1347]: time="2026-07-25T07:16:38.118Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T07:16:48.113" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.113" grpc.time_ms=5.272 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1635vm-test-run-nixbot-gitlab> gitlab # [ 176.064088] gitaly[1347]: time="2026-07-25T07:16:38.134Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:48.134" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.134" grpc.time_ms=0.117 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1636vm-test-run-nixbot-gitlab> gitlab # [ 176.069407] gitaly[1347]: time="2026-07-25T07:16:38.140Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T07:16:48.139" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.139" grpc.time_ms=0.14 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1637vm-test-run-nixbot-gitlab> gitlab # [ 176.116680] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.186Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"6af29b0f4d5a463255af9ed4","created_at":"2026-07-25T07:16:38.036Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.048Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-6af29b0f4d5a463255af9ed4: done: 0.136442 sec","job_status":"done","queue_duration_s":0.001967,"scheduling_latency_s":0.002017,"redis_calls":10,"redis_duration_s":0.0025399999999999997,"redis_read_bytes":8,"redis_write_bytes":1165,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":7,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.114436891,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.136442,"completed_at":"2026-07-25T07:16:38.186Z","load_balancing_strategy":"primary","db_duration_s":0.008958,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1638vm-test-run-nixbot-gitlab> gitlab # [ 176.152554] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.222Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"823e9f0318e42b56061d7586","created_at":"2026-07-25T07:16:38.061Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.065Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-823e9f0318e42b56061d7586: start","job_status":"start","queue_duration_s":0.157092,"scheduling_latency_s":0.157114}1639vm-test-run-nixbot-gitlab> gitlab # [ 176.239453] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.309Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"823e9f0318e42b56061d7586","created_at":"2026-07-25T07:16:38.061Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.065Z","job_size_bytes":2,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-823e9f0318e42b56061d7586: done: 0.086751 sec","job_status":"done","queue_duration_s":0.157092,"scheduling_latency_s":0.157114,"redis_calls":14,"redis_duration_s":0.003171,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000631,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001457,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.059108071,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.086751,"completed_at":"2026-07-25T07:16:38.309Z","load_balancing_strategy":"primary","db_duration_s":0.027849,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1640vm-test-run-nixbot-gitlab> gitlab # [ 176.307202] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.377Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0e55209de4819117a17abfd8","created_at":"2026-07-25T07:16:38.365Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.375Z","job_size_bytes":5,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0e55209de4819117a17abfd8: start","job_status":"start","queue_duration_s":0.001826,"scheduling_latency_s":0.001871}1641vm-test-run-nixbot-gitlab> gitlab # [ 176.391680] gitaly[1347]: time="2026-07-25T07:16:38.462Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC2446WMRDKN0JWQM5DXJN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T07:16:48.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:38.451" grpc.time_ms=10.884 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1642vm-test-run-nixbot-gitlab> gitlab # [ 176.433089] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.503Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0e55209de4819117a17abfd8","created_at":"2026-07-25T07:16:38.365Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.375Z","job_size_bytes":5,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0e55209de4819117a17abfd8: done: 0.126152 sec","job_status":"done","queue_duration_s":0.001826,"scheduling_latency_s":0.001871,"redis_calls":12,"redis_duration_s":0.002893,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000666,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001752,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000280204,"duration_s":0.126152,"completed_at":"2026-07-25T07:16:38.503Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039019,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1643vm-test-run-nixbot-gitlab> gitlab # [ 176.435749] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.505Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"3a18c8c74e156daeebf1bb5a","created_at":"2026-07-25T07:16:38.411Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.419Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-3a18c8c74e156daeebf1bb5a: start","job_status":"start","queue_duration_s":0.086142,"scheduling_latency_s":0.086192}1644vm-test-run-nixbot-gitlab> gitlab # [ 176.682678] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.752Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"3a18c8c74e156daeebf1bb5a","created_at":"2026-07-25T07:16:38.411Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.419Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-3a18c8c74e156daeebf1bb5a: done: 0.247051 sec","job_status":"done","queue_duration_s":0.086142,"scheduling_latency_s":0.086192,"redis_calls":11,"redis_duration_s":0.003507,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001357,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.072,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.153,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.153,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.071,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.132049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000438045,"duration_s":0.247051,"completed_at":"2026-07-25T07:16:38.752Z","load_balancing_strategy":"primary","db_duration_s":0.111566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645vm-test-run-nixbot-gitlab> gitlab # [ 176.724270] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.794Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"41dc4bf61ba184ff8ee41392","created_at":"2026-07-25T07:16:38.423Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.430Z","job_size_bytes":89,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-41dc4bf61ba184ff8ee41392: start","job_status":"start","queue_duration_s":0.363611,"scheduling_latency_s":0.363656}1646vm-test-run-nixbot-gitlab> gitlab # [ 176.795133] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:38.865Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"41dc4bf61ba184ff8ee41392","created_at":"2026-07-25T07:16:38.423Z","trace_propagation_headers":{"sentry-trace":"805a890b67f3490b98415f5f50e25cbd-84e5ad65e7484835","baggage":"sentry-trace_id=805a890b67f3490b98415f5f50e25cbd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC2446WMRDKN0JWQM5DXJN6","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:38.430Z","job_size_bytes":89,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-41dc4bf61ba184ff8ee41392: done: 0.070982 sec","job_status":"done","queue_duration_s":0.363611,"scheduling_latency_s":0.363656,"redis_calls":11,"redis_duration_s":0.003307,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000919,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000545,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000410387,"duration_s":0.070982,"completed_at":"2026-07-25T07:16:38.865Z","load_balancing_strategy":"primary","db_duration_s":0.019276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647vm-test-run-nixbot-gitlab> gitlab # [ 177.643463] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:39 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 25001648vm-test-run-nixbot-gitlab> gitlab # [ 177.647889] setup-gitlab-start[2557]: + mkdir -p /tmp/test-flake1649vm-test-run-nixbot-gitlab> gitlab # [ 177.650095] setup-gitlab-start[2557]: + cd /tmp/test-flake1650vm-test-run-nixbot-gitlab> gitlab # [ 177.651858] setup-gitlab-start[2557]: + git init -b master1651vm-test-run-nixbot-gitlab> gitlab # [ 177.674523] setup-gitlab-start[2850]: Initialized empty Git repository in /tmp/test-flake/.git/1652vm-test-run-nixbot-gitlab> gitlab # [ 177.677182] setup-gitlab-start[2557]: + git config user.name test1653vm-test-run-nixbot-gitlab> gitlab # [ 177.679207] setup-gitlab-start[2557]: + git config user.email test@example.com1654vm-test-run-nixbot-gitlab> gitlab # [ 177.682937] setup-gitlab-start[2557]: + cat1655vm-test-run-nixbot-gitlab> gitlab # [ 177.686376] setup-gitlab-start[2557]: + git add flake.nix1656vm-test-run-nixbot-gitlab> gitlab # [ 177.690685] setup-gitlab-start[2557]: + git commit -m 'initial commit'1657vm-test-run-nixbot-gitlab> gitlab # [ 177.705445] setup-gitlab-start[2855]: [master (root-commit) c2adcf0] initial commit1658vm-test-run-nixbot-gitlab> gitlab # [ 177.706100] setup-gitlab-start[2855]: 1 file changed, 10 insertions(+)1659vm-test-run-nixbot-gitlab> gitlab # [ 177.706755] setup-gitlab-start[2855]: create mode 100644 flake.nix1660vm-test-run-nixbot-gitlab> gitlab # [ 177.707790] setup-gitlab-start[2557]: + git remote add origin http://oauth2:glpat-_9A5YdvmBfGpWk-0JA6hyG86MQp1OjEH.01.0w1vdler9@gitlab/root/test-flake.git1661vm-test-run-nixbot-gitlab> gitlab # [ 177.713464] setup-gitlab-start[2557]: + git push -u origin master1662vm-test-run-nixbot-gitlab> gitlab # [ 177.802101] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 561663vm-test-run-nixbot-gitlab> gitlab # [ 177.892455] gitaly[1347]: time="2026-07-25T07:16:39.962Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC246T135WPFSBJ8NBTVKBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:39.954" grpc.time_ms=7.545 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1664vm-test-run-nixbot-gitlab> gitlab # [ 177.897123] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 931665vm-test-run-nixbot-gitlab> gitlab # [ 178.088211] gitaly[1347]: time="2026-07-25T07:16:40.158Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T07:16:50.149" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:40.149" grpc.time_ms=8.972 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1666vm-test-run-nixbot-gitlab> gitlab # [ 178.149335] gitaly[1347]: time="2026-07-25T07:16:40.219Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-25T07:17:10.008" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-25T07:16:40.208" grpc.time_ms=11.169 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1667vm-test-run-nixbot-gitlab> gitlab # [ 178.163952] gitaly[1347]: time="2026-07-25T07:16:40.234Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW duration_ms=128ns method=POST pid=1347 status=200 url="http://unix/api/v4/internal/allowed"1668vm-test-run-nixbot-gitlab> gitlab # [ 178.184400] gitaly[1347]: time="2026-07-25T07:16:40.255Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW duration_ms=19ns method=POST pid=1347 status=200 url="http://unix/api/v4/internal/pre_receive"1669vm-test-run-nixbot-gitlab> gitlab # [ 178.189877] gitaly[1347]: time="2026-07-25T07:16:40.260Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5321 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:40.104" grpc.time_ms=155.74 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1670vm-test-run-nixbot-gitlab> gitlab # [ 178.227610] gitaly[1347]: time="2026-07-25T07:16:40.298Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:40.297" grpc.time_ms=0.62 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1671vm-test-run-nixbot-gitlab> gitlab # [ 178.270440] gitaly[1347]: time="2026-07-25T07:16:40.341Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4790 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:40.340" grpc.time_ms=0.36 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1672vm-test-run-nixbot-gitlab> gitlab # [ 178.311413] gitaly[1347]: time="2026-07-25T07:16:40.382Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:40.380" grpc.time_ms=1.139 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1673vm-test-run-nixbot-gitlab> gitlab # [ 178.465451] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:40.533Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 c2adcf0287e0a3a1c5c48f61db545dc9754d2518 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6ae17534c706d9f29c0bf68b","created_at":"2026-07-25T07:16:40.511Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-a113a9841ad7426b","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:40.530Z","job_size_bytes":185,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6ae17534c706d9f29c0bf68b: start","job_status":"start","queue_duration_s":0.002793,"scheduling_latency_s":0.002825}1674vm-test-run-nixbot-gitlab> gitlab # [ 178.495928] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:40.566Z","message":"changes: \"0000000000000000000000000000000000000000 c2adcf0287e0a3a1c5c48f61db545dc9754d2518 refs/heads/master\\n\""}1675vm-test-run-nixbot-gitlab> gitlab # [ 178.525715] gitaly[1347]: time="2026-07-25T07:16:40.596Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T07:16:50.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:40.590" grpc.time_ms=5.825 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676vm-test-run-nixbot-gitlab> gitlab # [ 178.538094] gitaly[1347]: time="2026-07-25T07:16:40.603Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=6 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T07:16:50.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:40.590" grpc.time_ms=13.015 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1677vm-test-run-nixbot-gitlab> gitlab # [ 178.563400] gitaly[1347]: time="2026-07-25T07:16:40.634Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:50.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:40.628" grpc.time_ms=5.031 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678vm-test-run-nixbot-gitlab> gitlab # [ 178.574980] gitaly[1347]: time="2026-07-25T07:16:40.635Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1565 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-25T07:16:50.042" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:40.622" grpc.time_ms=12.527 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679vm-test-run-nixbot-gitlab> gitlab # [ 178.587860] gitaly[1347]: time="2026-07-25T07:16:40.651Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW duration_ms=232ns method=POST pid=1347 status=200 url="http://unix/api/v4/internal/post_receive"1680vm-test-run-nixbot-gitlab> gitlab # [ 178.590669] gitaly[1347]: time="2026-07-25T07:16:40.652Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4815 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:40.418" grpc.time_ms=233.517 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1681vm-test-run-nixbot-gitlab> gitlab # [ 178.600700] gitaly[1347]: time="2026-07-25T07:16:40.669Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-25T07:16:50.081" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:40.662" grpc.time_ms=7.466 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1682vm-test-run-nixbot-gitlab> gitlab # [ 178.611641] gitaly[1347]: time="2026-07-25T07:16:40.672Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW diskcache=4dc8f430-757d-4ff6-8da7-dec2b8e342db grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:40.050" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1683vm-test-run-nixbot-gitlab> gitlab # [ 178.620193] gitlab-workhorse[1281]: time="2026-07-25T07:16:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521684vm-test-run-nixbot-gitlab> gitlab # [ 178.621868] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:40 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 6741685vm-test-run-nixbot-gitlab> gitlab # [ 178.623714] setup-gitlab-start[2859]: To http://gitlab/root/test-flake.git1686vm-test-run-nixbot-gitlab> gitlab # [ 178.624560] setup-gitlab-start[2859]: * [new branch] master -> master1687vm-test-run-nixbot-gitlab> gitlab # [ 178.625371] setup-gitlab-start[2859]: branch 'master' set up to track 'origin/master'.1688vm-test-run-nixbot-gitlab> gitlab # [ 178.626348] gitaly[1347]: time="2026-07-25T07:16:40.672Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=196 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13315 command.oublock=32 command.real_time_ms=608 command.spawn_token_fork_ms=2 command.system_time_ms=129 command.user_time_ms=67 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:40.050" grpc.time_ms=621.631 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1689vm-test-run-nixbot-gitlab> gitlab # [ 178.637565] systemd[1]: Finished setup-gitlab.service.1690vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit setup-gitlab.service, in 179.39 seconds)1691vm-test-run-nixbot-gitlab> gitlab # [ 178.638383] gitaly[1347]: time="2026-07-25T07:16:40.698Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3941 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:40.698" grpc.time_ms=0.274 pid=1347 span.kind=server system=grpc1692vm-test-run-nixbot-gitlab> gitlab: waiting for unit nixbot.service1693vm-test-run-nixbot-gitlab> gitlab # [ 178.646417] systemd[1]: Starting nixbot CI service...1694vm-test-run-nixbot-gitlab> gitlab # [ 178.648887] gitaly[1347]: time="2026-07-25T07:16:40.719Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3943 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:40.719" grpc.time_ms=0.281 pid=1347 span.kind=server system=grpc1695vm-test-run-nixbot-gitlab> gitlab # [ 178.659070] gitaly[1347]: time="2026-07-25T07:16:40.728Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW diskcache=0f2bee45-ec24-443c-986f-28cb3d138dcf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T07:16:50.096" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:40.676" pid=1347 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1696vm-test-run-nixbot-gitlab> gitlab # [ 178.659682] gitaly[1347]: time="2026-07-25T07:16:40.728Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=41 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4734 command.oublock=8 command.real_time_ms=44 command.spawn_token_fork_ms=0 command.system_time_ms=28 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T07:16:50.096" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:40.676" grpc.time_ms=51.724 pid=1347 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1697vm-test-run-nixbot-gitlab> gitlab # [ 178.677110] gitaly[1347]: time="2026-07-25T07:16:40.741Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-07-25T07:16:50.160" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:40.741" grpc.time_ms=0.097 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698vm-test-run-nixbot-gitlab> gitlab # [ 178.688048] gitaly[1347]: time="2026-07-25T07:16:40.758Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=941 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=9 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-07-25T07:16:50.163" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:40.743" grpc.time_ms=15.041 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699vm-test-run-nixbot-gitlab> gitlab # [ 178.752535] gitaly[1347]: time="2026-07-25T07:16:40.823Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-07-25T07:17:10.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:40.817" grpc.time_ms=5.989 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1700vm-test-run-nixbot-gitlab> gitlab # [ 178.770414] gitaly[1347]: time="2026-07-25T07:16:40.841Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T07:16:50.260" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:40.840" grpc.time_ms=0.177 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701vm-test-run-nixbot-gitlab> gitlab # [ 178.780188] gitaly[1347]: time="2026-07-25T07:16:40.847Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-25T07:16:50.262" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-07-25T07:16:40.842" grpc.time_ms=5.426 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1702vm-test-run-nixbot-gitlab> gitlab # [ 178.800837] gitaly[1347]: time="2026-07-25T07:16:40.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:50.286" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:40.866" grpc.time_ms=5.143 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703vm-test-run-nixbot-gitlab> gitlab # [ 178.813064] gitaly[1347]: time="2026-07-25T07:16:40.880Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:50.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:40.875" grpc.time_ms=4.809 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704vm-test-run-nixbot-gitlab> gitlab # [ 178.826418] gitaly[1347]: time="2026-07-25T07:16:40.897Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T07:17:10.088" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:40.888" grpc.time_ms=8.048 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705vm-test-run-nixbot-gitlab> gitlab # [ 179.065302] gitaly[1347]: time="2026-07-25T07:16:41.135Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-25T07:16:51.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:41.134" grpc.time_ms=0.964 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1706vm-test-run-nixbot-gitlab> gitlab # [ 179.093790] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:41.163Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 c2adcf0287e0a3a1c5c48f61db545dc9754d2518 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6ae17534c706d9f29c0bf68b","created_at":"2026-07-25T07:16:40.511Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-a113a9841ad7426b","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:40.530Z","job_size_bytes":185,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6ae17534c706d9f29c0bf68b: done: 0.630675 sec","job_status":"done","queue_duration_s":0.002793,"scheduling_latency_s":0.002825,"gitaly_calls":13,"gitaly_duration_s":0.165696,"redis_calls":196,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.042299,"redis_read_bytes":1445,"redis_write_bytes":19020,"redis_cache_calls":14,"redis_cache_duration_s":0.002937,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":28,"redis_feature_flag_duration_s":0.014528,"redis_feature_flag_read_bytes":1044,"redis_feature_flag_write_bytes":3487,"redis_queues_calls":8,"redis_queues_duration_s":0.00134,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4936,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003662,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":91,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.010751,"redis_repository_cache_read_bytes":233,"redis_repository_cache_write_bytes":6319,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.009081,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.164,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.182,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.345104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000464026,"exclusive_lock_hold_duration_s":0.02611952,"duration_s":0.630675,"completed_at":"2026-07-25T07:16:41.163Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.073591,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1707vm-test-run-nixbot-gitlab> gitlab # [ 179.159160] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:41.165Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b2b456d615b9589197911f2b","created_at":"2026-07-25T07:16:40.637Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-26a3b78b903d4ee7","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:40.644Z","job_size_bytes":46,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b2b456d615b9589197911f2b: start","job_status":"start","queue_duration_s":0.521344,"scheduling_latency_s":0.52142}1708vm-test-run-nixbot-gitlab> gitlab # [ 179.173564] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:41.227Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b2b456d615b9589197911f2b","created_at":"2026-07-25T07:16:40.637Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-26a3b78b903d4ee7","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:40.644Z","job_size_bytes":46,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b2b456d615b9589197911f2b: done: 0.061652 sec","job_status":"done","queue_duration_s":0.521344,"scheduling_latency_s":0.52142,"gitaly_calls":2,"gitaly_duration_s":0.010652,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.004548,"redis_read_bytes":68,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000989,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000349,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.001719,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":752,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000232712,"duration_s":0.061652,"completed_at":"2026-07-25T07:16:41.227Z","load_balancing_strategy":"primary","db_duration_s":0.007539,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1709vm-test-run-nixbot-gitlab> gitlab # [ 179.218113] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:41.228Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f90787d072934f2a8779843e","created_at":"2026-07-25T07:16:40.656Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-26a3b78b903d4ee7","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:40.658Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f90787d072934f2a8779843e: start","job_status":"start","queue_duration_s":0.569434,"scheduling_latency_s":0.569447}1710vm-test-run-nixbot-gitlab> gitlab # [ 179.218711] gitaly[1347]: time="2026-07-25T07:16:41.200Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-07-25T13:16:41.198" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:41.198" grpc.time_ms=1.924 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1711vm-test-run-nixbot-gitlab> gitlab # [ 179.218838] gitaly[1347]: time="2026-07-25T07:16:41.211Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-25T07:17:11.004" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:41.205" grpc.time_ms=5.71 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1712vm-test-run-nixbot-gitlab> gitlab # [ 179.219485] gitaly[1347]: time="2026-07-25T07:16:41.276Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW diskcache=c6980b62-0b63-4aed-a538-ab4d12ac93b6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T13:16:41.241" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:41.241" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1713vm-test-run-nixbot-gitlab> gitlab # [ 179.223166] gitaly[1347]: time="2026-07-25T07:16:41.276Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1283 command.oublock=0 command.real_time_ms=46 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T13:16:41.241" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:41.241" grpc.time_ms=34.839 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1714vm-test-run-nixbot-gitlab> gitlab # [ 179.289339] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:41.359Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f90787d072934f2a8779843e","created_at":"2026-07-25T07:16:40.656Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-26a3b78b903d4ee7","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:40.658Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f90787d072934f2a8779843e: done: 0.131152 sec","job_status":"done","queue_duration_s":0.569434,"scheduling_latency_s":0.569447,"gitaly_calls":1,"gitaly_duration_s":0.036385,"redis_calls":15,"redis_duration_s":0.00201,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000231,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000362,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000674,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.014,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.115934846,"duration_s":0.131152,"completed_at":"2026-07-25T07:16:41.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.119851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1715vm-test-run-nixbot-gitlab> gitlab # [ 179.311395] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:41.361Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"5c5a948753b9082f2485201f","created_at":"2026-07-25T07:16:40.737Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-26a3b78b903d4ee7","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:40.739Z","job_size_bytes":23,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5c5a948753b9082f2485201f: start","job_status":"start","queue_duration_s":0.621666,"scheduling_latency_s":0.621688}1716vm-test-run-nixbot-gitlab> gitlab # [ 179.316442] gitaly[1347]: time="2026-07-25T07:16:41.387Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-07-25T07:17:11.181" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:41.381" grpc.time_ms=5.21 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1717vm-test-run-nixbot-gitlab> gitlab # [ 179.323558] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:41.393Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"5c5a948753b9082f2485201f","created_at":"2026-07-25T07:16:40.737Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-26a3b78b903d4ee7","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:40.739Z","job_size_bytes":23,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5c5a948753b9082f2485201f: done: 0.032829 sec","job_status":"done","queue_duration_s":0.621666,"scheduling_latency_s":0.621688,"gitaly_calls":1,"gitaly_duration_s":0.008447,"redis_calls":16,"redis_duration_s":0.003424,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000279,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001625,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000574,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032829,"completed_at":"2026-07-25T07:16:41.393Z","load_balancing_strategy":"primary","db_duration_s":0.002794,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1718vm-test-run-nixbot-gitlab> gitlab # [ 179.373561] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:41.396Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c0509c393d60aae9dcaf7cd6","created_at":"2026-07-25T07:16:41.103Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-26a3b78b903d4ee7","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:353bc1693e2eb5070fb163c6e9620ad749274342ef205d0b0b13b0737464383e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:41.107Z","job_size_bytes":467,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c0509c393d60aae9dcaf7cd6: start","job_status":"start","queue_duration_s":0.28843,"scheduling_latency_s":0.288446}1719vm-test-run-nixbot-gitlab> gitlab # [ 179.374250] gitaly[1347]: time="2026-07-25T07:16:41.427Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:11.226" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:41.427" grpc.time_ms=0.367 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1720vm-test-run-nixbot-gitlab> gitlab # [ 179.415543] gitaly[1347]: time="2026-07-25T07:16:41.439Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T07:16:51.300" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:41.431" grpc.time_ms=8.324 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1721vm-test-run-nixbot-gitlab> gitlab # [ 179.443770] gitaly[1347]: time="2026-07-25T07:16:41.514Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T07:17:11.313" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:41.513" grpc.time_ms=0.946 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1722vm-test-run-nixbot-gitlab> gitlab # [ 179.457515] gitaly[1347]: time="2026-07-25T07:16:41.528Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=57 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-25T07:17:11.326" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:41.526" grpc.time_ms=1.667 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1723vm-test-run-nixbot-gitlab> gitlab # [ 179.545991] gitaly[1347]: time="2026-07-25T07:16:41.616Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:51.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:41.609" grpc.time_ms=7.015 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1724vm-test-run-nixbot-gitlab> gitlab # [ 179.670087] nixbot[2969]: {"ts": "2026-07-25T07:16:41.739Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1725vm-test-run-nixbot-gitlab> gitlab # [ 179.695531] nixbot[2969]: {"ts": "2026-07-25T07:16:41.766Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1726vm-test-run-nixbot-gitlab> gitlab # [ 179.723110] nixbot[2969]: {"ts": "2026-07-25T07:16:41.793Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1727vm-test-run-nixbot-gitlab> gitlab # [ 179.731444] nixbot[2969]: {"ts": "2026-07-25T07:16:41.801Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1728vm-test-run-nixbot-gitlab> gitlab # [ 179.736320] nixbot[2969]: {"ts": "2026-07-25T07:16:41.805Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1729vm-test-run-nixbot-gitlab> gitlab # [ 179.741418] nixbot[2969]: {"ts": "2026-07-25T07:16:41.811Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1730vm-test-run-nixbot-gitlab> gitlab # [ 179.746205] nixbot[2969]: {"ts": "2026-07-25T07:16:41.815Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1731vm-test-run-nixbot-gitlab> gitlab # [ 179.748109] nixbot[2969]: {"ts": "2026-07-25T07:16:41.818Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1732vm-test-run-nixbot-gitlab> gitlab # [ 179.754383] nixbot[2969]: {"ts": "2026-07-25T07:16:41.824Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1733vm-test-run-nixbot-gitlab> gitlab # [ 179.757231] nixbot[2969]: {"ts": "2026-07-25T07:16:41.827Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1734vm-test-run-nixbot-gitlab> gitlab # [ 179.760798] nixbot[2969]: {"ts": "2026-07-25T07:16:41.831Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1735vm-test-run-nixbot-gitlab> gitlab # [ 179.764984] nixbot[2969]: {"ts": "2026-07-25T07:16:41.835Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1736vm-test-run-nixbot-gitlab> gitlab # [ 179.767481] nixbot[2969]: {"ts": "2026-07-25T07:16:41.838Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1737vm-test-run-nixbot-gitlab> gitlab # [ 179.770219] nixbot[2969]: {"ts": "2026-07-25T07:16:41.840Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1738vm-test-run-nixbot-gitlab> gitlab # [ 179.774707] nixbot[2969]: {"ts": "2026-07-25T07:16:41.845Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1739vm-test-run-nixbot-gitlab> gitlab # [ 179.777426] nixbot[2969]: {"ts": "2026-07-25T07:16:41.848Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1740vm-test-run-nixbot-gitlab> gitlab # [ 179.779108] nixbot[2969]: {"ts": "2026-07-25T07:16:41.849Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1741vm-test-run-nixbot-gitlab> gitlab # [ 179.780565] nixbot[2969]: {"ts": "2026-07-25T07:16:41.851Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1742vm-test-run-nixbot-gitlab> gitlab # [ 179.783635] nixbot[2969]: {"ts": "2026-07-25T07:16:41.854Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1743vm-test-run-nixbot-gitlab> gitlab # [ 179.786507] nixbot[2969]: {"ts": "2026-07-25T07:16:41.857Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1744vm-test-run-nixbot-gitlab> gitlab # [ 179.788470] nixbot[2969]: {"ts": "2026-07-25T07:16:41.859Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1745vm-test-run-nixbot-gitlab> gitlab # [ 179.793658] nixbot[2969]: {"ts": "2026-07-25T07:16:41.864Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1746vm-test-run-nixbot-gitlab> gitlab # [ 179.796276] nixbot[2969]: {"ts": "2026-07-25T07:16:41.866Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1747vm-test-run-nixbot-gitlab> gitlab # [ 179.958883] gitaly[1347]: time="2026-07-25T07:16:42.029Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T07:17:12.011" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:42.011" grpc.time_ms=17.531 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1748vm-test-run-nixbot-gitlab> gitlab # [ 180.003798] gitaly[1347]: time="2026-07-25T07:16:42.074Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYC246XYAEFGGXRJGTTZ1BHW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-25T07:17:12.062" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:42.062" grpc.time_ms=11.378 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1749vm-test-run-nixbot-gitlab> gitlab # [ 180.038965] sidekiq-cluster[2039]: {"severity":"WARN","time":"2026-07-25T07:16:42.108Z","class":"CreatePipelineWorker","correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"c2adcf0287e0a3a1c5c48f61db545dc9754d2518","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"c2adcf0287e0a3a1c5c48f61db545dc9754d2518","ref":"refs/heads/master"},"retry":0}1750vm-test-run-nixbot-gitlab> gitlab # [ 180.054332] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:42.124Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c0509c393d60aae9dcaf7cd6","created_at":"2026-07-25T07:16:41.103Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-26a3b78b903d4ee7","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:353bc1693e2eb5070fb163c6e9620ad749274342ef205d0b0b13b0737464383e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:41.107Z","job_size_bytes":467,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c0509c393d60aae9dcaf7cd6: done: 0.728639 sec","job_status":"done","queue_duration_s":0.28843,"scheduling_latency_s":0.288446,"gitaly_calls":7,"gitaly_duration_s":0.114469,"redis_calls":53,"redis_duration_s":0.02171,"redis_read_bytes":171,"redis_write_bytes":4425,"redis_cache_calls":4,"redis_cache_duration_s":0.000532,"redis_cache_read_bytes":10,"redis_cache_write_bytes":341,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.00628,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002028,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.011772,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":43,"db_write_count":1,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":43,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":38,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.522688,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000291099,"duration_s":0.728639,"completed_at":"2026-07-25T07:16:42.124Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.070899,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1751vm-test-run-nixbot-gitlab> gitlab # [ 180.096212] nixbot[2969]: INFO: Started server process [2969]1752vm-test-run-nixbot-gitlab> gitlab # [ 180.096949] nixbot[2969]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1753vm-test-run-nixbot-gitlab> gitlab # [ 180.103707] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:42.174Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ababb8e72f43e1b3ac92f457","created_at":"2026-07-25T07:16:41.217Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-beccb45a9bb94555","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:41.220Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ababb8e72f43e1b3ac92f457: start","job_status":"start","queue_duration_s":0.953413,"scheduling_latency_s":0.953448}1754vm-test-run-nixbot-gitlab> gitlab # [ 180.106289] nixbot[2969]: INFO: ::ffff:127.0.0.1:44002 - "GET /health HTTP/1.1" 200 OK1755vm-test-run-nixbot-gitlab> gitlab # [ 180.119654] systemd[1]: Started nixbot CI service.1756vm-test-run-nixbot-gitlab> gitlab # [ 180.121480] systemd[1]: Reached target Multi-User System.1757vm-test-run-nixbot-gitlab> gitlab # [ 180.123586] systemd[1]: Startup finished in 1.112s (kernel) + 3.951s (initrd) + 2min 55.059s (userspace) = 3min 123ms.1758vm-test-run-nixbot-gitlab> gitlab # [ 180.139902] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:42.210Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ababb8e72f43e1b3ac92f457","created_at":"2026-07-25T07:16:41.217Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-beccb45a9bb94555","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:41.220Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ababb8e72f43e1b3ac92f457: done: 0.036324 sec","job_status":"done","queue_duration_s":0.953413,"scheduling_latency_s":0.953448,"redis_calls":19,"redis_duration_s":0.002581,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000555,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000316,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001165,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000545,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004931072999999999,"duration_s":0.036324,"completed_at":"2026-07-25T07:16:42.210Z","load_balancing_strategy":"primary","db_duration_s":0.005989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1759vm-test-run-nixbot-gitlab> gitlab # [ 180.178505] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:42.248Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"93a6be7eba246fc55ea7377e","created_at":"2026-07-25T07:16:42.201Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-4c037e133aa44ede","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:42.205Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-93a6be7eba246fc55ea7377e: start","job_status":"start","queue_duration_s":0.043532,"scheduling_latency_s":0.04357}1760vm-test-run-nixbot-gitlab> gitlab # [ 180.251865] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:42.322Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"93a6be7eba246fc55ea7377e","created_at":"2026-07-25T07:16:42.201Z","trace_propagation_headers":{"sentry-trace":"412e0394c4824c08a285ec871d83ee48-4c037e133aa44ede","baggage":"sentry-trace_id=412e0394c4824c08a285ec871d83ee48,sentry-release=Unknown"},"correlation_id":"01KYC246XYAEFGGXRJGTTZ1BHW","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:42.205Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-93a6be7eba246fc55ea7377e: done: 0.073674 sec","job_status":"done","queue_duration_s":0.043532,"scheduling_latency_s":0.04357,"redis_calls":11,"redis_duration_s":0.001885,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277409,"duration_s":0.073674,"completed_at":"2026-07-25T07:16:42.322Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021514,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1761vm-test-run-nixbot-gitlab> gitlab # [ 180.350297] gitaly[1347]: time="2026-07-25T07:16:42.419Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=968 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC2492CVCN5ZGRZ9F33K1XW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T07:17:12.204" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:42.405" grpc.time_ms=14.312 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1762vm-test-run-nixbot-gitlab> gitlab # [ 180.371615] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:42 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 2521763vm-test-run-nixbot-gitlab> gitlab # [ 180.373572] nixbot[2969]: {"ts": "2026-07-25T07:16:42.444Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1764vm-test-run-nixbot-gitlab> gitlab # [ 180.393296] nixbot[2969]: {"ts": "2026-07-25T07:16:42.463Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1765vm-test-run-nixbot-gitlab> gitlab # [ 180.446224] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 381766vm-test-run-nixbot-gitlab> gitlab # [ 180.448109] nixbot[2969]: {"ts": "2026-07-25T07:16:42.518Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1767vm-test-run-nixbot-gitlab> gitlab # [ 180.449938] nixbot[2969]: {"ts": "2026-07-25T07:16:42.520Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1768vm-test-run-nixbot-gitlab> gitlab # [ 180.532652] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 791769vm-test-run-nixbot-gitlab> gitlab # [ 180.537306] nixbot[2969]: {"ts": "2026-07-25T07:16:42.604Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1770vm-test-run-nixbot-gitlab> gitlab # [ 180.672915] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:42 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 1291771vm-test-run-nixbot-gitlab> gitlab # [ 180.678658] nixbot[2969]: {"ts": "2026-07-25T07:16:42.744Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1772vm-test-run-nixbot-gitlab> gitlab # [ 180.715304] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 311773vm-test-run-nixbot-gitlab> gitlab # [ 180.717190] nixbot[2969]: {"ts": "2026-07-25T07:16:42.786Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1774vm-test-run-nixbot-gitlab> gitlab # [ 180.837153] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:42 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 1121775vm-test-run-nixbot-gitlab> gitlab # [ 180.839132] nixbot[2969]: {"ts": "2026-07-25T07:16:42.909Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1776vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit nixbot.service, in 2.12 seconds)1777vm-test-run-nixbot-gitlab> gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1778vm-test-run-nixbot-gitlab> gitlab # [ 180.896160] nixbot[2969]: INFO: ::ffff:127.0.0.1:44004 - "GET /health HTTP/1.1" 200 OK1779vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1780vm-test-run-nixbot-gitlab> subtest: project discovered and webhook registered1781vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1782vm-test-run-nixbot-gitlab> gitlab # [ 180.904278] gitaly[1347]: time="2026-07-25T07:16:42.974Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC249S5TZWRZ83JQAKQ0FMJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-07-25T07:17:12.062" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:42.963" grpc.time_ms=11.113 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783vm-test-run-nixbot-gitlab> gitlab # [ 180.924570] gitaly[1347]: time="2026-07-25T07:16:42.995Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC249S5TZWRZ83JQAKQ0FMJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:12.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:42.994" grpc.time_ms=0.567 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784vm-test-run-nixbot-gitlab> gitlab # [ 180.935780] gitaly[1347]: time="2026-07-25T07:16:43.006Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC249S5TZWRZ83JQAKQ0FMJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-25T07:16:52.008" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:42.998" grpc.time_ms=8.06 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785vm-test-run-nixbot-gitlab> gitlab # [ 181.004170] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 1541786vm-test-run-nixbot-gitlab> gitlab # [ 181.005277] nixbot[2969]: {"ts": "2026-07-25T07:16:43.073Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1787vm-test-run-nixbot-gitlab> gitlab # [ 181.016182] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 371788vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1789vm-test-run-nixbot-gitlab> (finished: subtest: project discovered and webhook registered, in 0.12 seconds)1790vm-test-run-nixbot-gitlab> subtest: push delivers the webhook1791vm-test-run-nixbot-gitlab> gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1792vm-test-run-nixbot-gitlab> gitlab # [ 181.060439] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 501793vm-test-run-nixbot-gitlab> gitlab # [ 181.063967] nixbot[2969]: {"ts": "2026-07-25T07:16:43.133Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1794vm-test-run-nixbot-gitlab> gitlab # [ 181.065740] nixbot[2969]: {"ts": "2026-07-25T07:16:43.136Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1795vm-test-run-nixbot-gitlab> gitlab # [ 181.078055] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 221796vm-test-run-nixbot-gitlab> gitlab # [ 181.134071] gitaly[1347]: time="2026-07-25T07:16:43.204Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A0W0RBNPYEK4R5D8M27 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.198" grpc.time_ms=6.085 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1797vm-test-run-nixbot-gitlab> gitlab # [ 181.134844] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 401798vm-test-run-nixbot-gitlab> gitlab # [ 181.155209] gitaly[1347]: time="2026-07-25T07:16:43.225Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A0EJSJCHAW6Q9GJM2BW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.217" grpc.time_ms=7.877 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1799vm-test-run-nixbot-gitlab> gitlab # [ 181.155872] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.54.0" 741800vm-test-run-nixbot-gitlab> gitlab # Enumerating objects: 5, done.1801vm-test-run-nixbot-gitlab> gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1802vm-test-run-nixbot-gitlab> gitlab # Delta compression using up to 4 threads1803vm-test-run-nixbot-gitlab> gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1804vm-test-run-nixbot-gitlab> gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1805vm-test-run-nixbot-gitlab> gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1806vm-test-run-nixbot-gitlab> gitlab # [ 181.213672] gitaly[1347]: time="2026-07-25T07:16:43.282Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A2KQ474SGP7QCKYQQRR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.273" pid=1347 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1807vm-test-run-nixbot-gitlab> gitlab # [ 181.214497] gitlab-workhorse[1281]: time="2026-07-25T07:16:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491808vm-test-run-nixbot-gitlab> gitlab # [ 181.214964] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 641809vm-test-run-nixbot-gitlab> gitlab # [ 181.215630] gitaly[1347]: time="2026-07-25T07:16:43.282Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A2KQ474SGP7QCKYQQRR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.273" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1810vm-test-run-nixbot-gitlab> gitlab # [ 181.216980] gitaly[1347]: time="2026-07-25T07:16:43.282Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A2KQ474SGP7QCKYQQRR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.273" grpc.time_ms=8.995 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1811vm-test-run-nixbot-gitlab> gitlab # [ 181.280139] gitaly[1347]: time="2026-07-25T07:16:43.350Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A4Q008BJH0PZ106KXA8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.339" pid=1347 remote_ip="2001:db8:1::1" request_sha=b83646c64e3804d88b8ec45ce73bbb837b5a5d49 response_bytes=222 span.kind=server system=grpc1812vm-test-run-nixbot-gitlab> gitlab # [ 181.280885] gitaly[1347]: time="2026-07-25T07:16:43.350Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1203 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A4Q008BJH0PZ106KXA8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.339" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1813vm-test-run-nixbot-gitlab> gitlab # [ 181.281651] gitaly[1347]: time="2026-07-25T07:16:43.351Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1203 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A4Q008BJH0PZ106KXA8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.339" grpc.time_ms=11.861 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1814vm-test-run-nixbot-gitlab> gitlab # [ 181.282432] gitlab-workhorse[1281]: time="2026-07-25T07:16:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2221815vm-test-run-nixbot-gitlab> gitlab # [ 181.282887] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 222 "" "git/2.54.0" 641816vm-test-run-nixbot-gitlab> gitlab # [ 181.393307] gitaly[1347]: time="2026-07-25T07:16:43.463Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-07-25T07:16:53.016" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:43.456" grpc.time_ms=6.984 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817vm-test-run-nixbot-gitlab> gitlab # [ 181.461097] gitaly[1347]: time="2026-07-25T07:16:43.531Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A8G52JT6GJHENTGBR9S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.522" grpc.time_ms=9.05 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1818vm-test-run-nixbot-gitlab> gitlab # [ 181.473379] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1351819vm-test-run-nixbot-gitlab> gitlab # [ 181.498342] gitaly[1347]: time="2026-07-25T07:16:43.568Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-07-25T07:17:13.361" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-07-25T07:16:43.562" grpc.time_ms=6.8 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820vm-test-run-nixbot-gitlab> gitlab # [ 181.509281] gitaly[1347]: time="2026-07-25T07:16:43.579Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KYC24A3NDBB910RENE78YRCK duration_ms=168ns method=POST pid=1347 status=200 url="http://unix/api/v4/internal/allowed"1821vm-test-run-nixbot-gitlab> gitlab # [ 181.529615] gitaly[1347]: time="2026-07-25T07:16:43.598Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KYC24A3NDBB910RENE78YRCK duration_ms=17ns method=POST pid=1347 status=200 url="http://unix/api/v4/internal/pre_receive"1822vm-test-run-nixbot-gitlab> gitlab # [ 181.530411] gitaly[1347]: time="2026-07-25T07:16:43.599Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5321 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:43.410" grpc.time_ms=187.782 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1823vm-test-run-nixbot-gitlab> gitlab # [ 181.547579] gitaly[1347]: time="2026-07-25T07:16:43.618Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ACT6YYSYD844NXZCWS3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.611" pid=1347 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1824vm-test-run-nixbot-gitlab> gitlab # [ 181.556526] gitaly[1347]: time="2026-07-25T07:16:43.618Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ACT6YYSYD844NXZCWS3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.611" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1825vm-test-run-nixbot-gitlab> gitlab # [ 181.562258] gitaly[1347]: time="2026-07-25T07:16:43.632Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ACT6YYSYD844NXZCWS3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.611" grpc.time_ms=21.191 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1826vm-test-run-nixbot-gitlab> gitlab # [ 181.582208] gitlab-workhorse[1281]: time="2026-07-25T07:16:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671827vm-test-run-nixbot-gitlab> gitlab # [ 181.584092] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 1051828vm-test-run-nixbot-gitlab> gitlab # [ 181.586024] gitaly[1347]: time="2026-07-25T07:16:43.656Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4791 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:43.655" grpc.time_ms=0.649 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1829vm-test-run-nixbot-gitlab> gitlab # [ 181.617019] gitaly[1347]: time="2026-07-25T07:16:43.687Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4790 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:43.687" grpc.time_ms=0.254 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1830vm-test-run-nixbot-gitlab> gitlab # [ 181.646030] gitaly[1347]: time="2026-07-25T07:16:43.716Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4792 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:43.715" grpc.time_ms=0.56 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1831vm-test-run-nixbot-gitlab> gitlab # [ 181.684977] gitaly[1347]: time="2026-07-25T07:16:43.755Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KYC24AH6K31WMND6V18CPAVD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.736" grpc.time_ms=19.019 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1832vm-test-run-nixbot-gitlab> gitlab # [ 181.685716] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 691833vm-test-run-nixbot-gitlab> gitlab # [ 181.697881] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:43.768Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","c2adcf0287e0a3a1c5c48f61db545dc9754d2518 547c2ff06a1e0719efc2952e979f436c7a881ba9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c8dd5e4c02acb64a972b32ef","created_at":"2026-07-25T07:16:43.764Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-57bad052cbdc417c","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:43.766Z","job_size_bytes":185,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c8dd5e4c02acb64a972b32ef: start","job_status":"start","queue_duration_s":0.001118,"scheduling_latency_s":0.00115}1834vm-test-run-nixbot-gitlab> gitlab # [ 181.707325] gitaly[1347]: time="2026-07-25T07:16:43.778Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KYC24A3NDBB910RENE78YRCK duration_ms=44ns method=POST pid=1347 status=200 url="http://unix/api/v4/internal/post_receive"1835vm-test-run-nixbot-gitlab> gitlab # [ 181.709278] gitaly[1347]: time="2026-07-25T07:16:43.779Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4815 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:43.733" grpc.time_ms=45.806 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1836vm-test-run-nixbot-gitlab> gitlab # [ 181.713091] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:43.783Z","message":"changes: \"c2adcf0287e0a3a1c5c48f61db545dc9754d2518 547c2ff06a1e0719efc2952e979f436c7a881ba9 refs/heads/master\\n\""}1837vm-test-run-nixbot-gitlab> gitlab # [ 181.733503] gitaly[1347]: time="2026-07-25T07:16:43.804Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK diskcache=6ea18f75-49e4-430f-ba71-8163b0cedde9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.327" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1838vm-test-run-nixbot-gitlab> gitlab # [ 181.734163] gitaly[1347]: time="2026-07-25T07:16:43.804Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=159 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=864256 command.minflt=13365 command.oublock=32 command.real_time_ms=458 command.spawn_token_fork_ms=0 command.system_time_ms=120 command.user_time_ms=39 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.327" grpc.time_ms=477.158 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1839vm-test-run-nixbot-gitlab> gitlab # [ 181.734744] gitlab-workhorse[1281]: time="2026-07-25T07:16:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521840vm-test-run-nixbot-gitlab> gitlab # [ 181.735153] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 5511841vm-test-run-nixbot-gitlab> gitlab # To http://gitlab/root/test-flake.git1842vm-test-run-nixbot-gitlab> gitlab # c2adcf0..547c2ff master -> master1843vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.75 seconds)1844vm-test-run-nixbot-gitlab> gitlab: must succeed: git -C /tmp/test-flake rev-parse master1845vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1846vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=547c2ff06a1e0719efc2952e979f436c7a881ba9'1847vm-test-run-nixbot-gitlab> gitlab # [ 181.802388] gitaly[1347]: time="2026-07-25T07:16:43.873Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:53.267" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:43.867" grpc.time_ms=5.579 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1848vm-test-run-nixbot-gitlab> gitlab # [ 181.808599] nixbot[2969]: INFO: ::ffff:127.0.0.1:44020 - "GET /api/repos/gitlab/root/test-flake/builds?commit=547c2ff06a1e0719efc2952e979f436c7a881ba9 HTTP/1.1" 200 OK1849vm-test-run-nixbot-gitlab> gitlab # [ 181.812620] gitaly[1347]: time="2026-07-25T07:16:43.883Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-07-25T07:16:53.276" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:43.876" grpc.time_ms=6.662 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1850vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=547c2ff06a1e0719efc2952e979f436c7a881ba9', in 0.05 seconds)1851vm-test-run-nixbot-gitlab> gitlab # [ 181.829845] gitaly[1347]: time="2026-07-25T07:16:43.900Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-07-25T07:16:53.003" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:43.893" grpc.time_ms=6.498 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1852vm-test-run-nixbot-gitlab> gitlab # [ 181.842478] gitaly[1347]: time="2026-07-25T07:16:43.913Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24AKDGK8WVR2JH5JQCZ6Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.867" pid=1347 remote_ip="2001:db8:1::1" request_sha=69dcef142412daaffeeda28f6446e517599d516e response_bytes=214 span.kind=server system=grpc1853vm-test-run-nixbot-gitlab> gitlab # [ 181.843103] gitaly[1347]: time="2026-07-25T07:16:43.913Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=44 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24AKDGK8WVR2JH5JQCZ6Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.867" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1854vm-test-run-nixbot-gitlab> gitlab # [ 181.843683] gitaly[1347]: time="2026-07-25T07:16:43.913Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=44 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24AKDGK8WVR2JH5JQCZ6Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:43.867" grpc.time_ms=46.509 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1855vm-test-run-nixbot-gitlab> gitlab # [ 181.844358] gitlab-workhorse[1281]: time="2026-07-25T07:16:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2141856vm-test-run-nixbot-gitlab> gitlab # [ 181.844500] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 214 "" "git/2.54.0" 1561857vm-test-run-nixbot-gitlab> gitlab # [ 181.882339] gitaly[1347]: time="2026-07-25T07:16:43.952Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=33 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=661 command.oublock=0 command.real_time_ms=47 command.spawn_token_fork_ms=8 command.system_time_ms=1 command.user_time_ms=32 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-07-25T07:17:13.702" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:43.903" grpc.time_ms=49.392 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858vm-test-run-nixbot-gitlab> gitlab # [ 181.894569] gitaly[1347]: time="2026-07-25T07:16:43.965Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=347 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-07-25T07:16:53.071" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-07-25T07:16:43.961" grpc.time_ms=3.203 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1859vm-test-run-nixbot-gitlab> gitlab # [ 181.905121] gitaly[1347]: time="2026-07-25T07:16:43.975Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:53.081" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:43.971" grpc.time_ms=4.474 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860vm-test-run-nixbot-gitlab> gitlab # [ 181.959088] gitaly[1347]: time="2026-07-25T07:16:44.029Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:14.028" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.028" grpc.time_ms=0.431 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861vm-test-run-nixbot-gitlab> gitlab # [ 181.988569] gitaly[1347]: time="2026-07-25T07:16:44.059Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-25T07:17:14.052" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:44.052" grpc.time_ms=6.5 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862vm-test-run-nixbot-gitlab> gitlab # [ 182.010724] gitaly[1347]: time="2026-07-25T07:16:44.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:54.076" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:44.076" grpc.time_ms=4.705 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863vm-test-run-nixbot-gitlab> gitlab # [ 182.035583] gitaly[1347]: time="2026-07-25T07:16:44.106Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-07-25T07:16:54.005" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.105" grpc.time_ms=0.748 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1864vm-test-run-nixbot-gitlab> gitlab # [ 182.053471] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.123Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","c2adcf0287e0a3a1c5c48f61db545dc9754d2518 547c2ff06a1e0719efc2952e979f436c7a881ba9 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"c8dd5e4c02acb64a972b32ef","created_at":"2026-07-25T07:16:43.764Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-57bad052cbdc417c","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-07-25T07:16:43.766Z","job_size_bytes":185,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-c8dd5e4c02acb64a972b32ef: done: 0.355977 sec","job_status":"done","queue_duration_s":0.001118,"scheduling_latency_s":0.00115,"gitaly_calls":7,"gitaly_duration_s":0.090034,"redis_calls":112,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.020881999999999998,"redis_read_bytes":350,"redis_write_bytes":13066,"redis_cache_calls":9,"redis_cache_duration_s":0.001491,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.001176,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6766,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.00225,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007722,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.007987,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.018,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.212733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000576609,"exclusive_lock_hold_duration_s":0.015960129,"duration_s":0.355977,"completed_at":"2026-07-25T07:16:44.123Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029609,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1865vm-test-run-nixbot-gitlab> gitlab # [ 182.073233] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.124Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"f869a5f70c34252397c5278f","created_at":"2026-07-25T07:16:43.885Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-bd16e8795e41413e","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:43.886Z","job_size_bytes":46,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f869a5f70c34252397c5278f: start","job_status":"start","queue_duration_s":0.237932,"scheduling_latency_s":0.23795}1866vm-test-run-nixbot-gitlab> gitlab # [ 182.074042] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.137Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"f869a5f70c34252397c5278f","created_at":"2026-07-25T07:16:43.885Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-bd16e8795e41413e","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:43.886Z","job_size_bytes":46,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-f869a5f70c34252397c5278f: done: 0.012931 sec","job_status":"done","queue_duration_s":0.237932,"scheduling_latency_s":0.23795,"redis_calls":9,"redis_duration_s":0.001214,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000154,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012931,"completed_at":"2026-07-25T07:16:44.137Z","load_balancing_strategy":"primary","db_duration_s":0.001325,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1867vm-test-run-nixbot-gitlab> gitlab # [ 182.133665] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.138Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"affe590fda66b8669dbc8dbd","created_at":"2026-07-25T07:16:43.890Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-bd16e8795e41413e","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:43.891Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-affe590fda66b8669dbc8dbd: start","job_status":"start","queue_duration_s":0.247568,"scheduling_latency_s":0.247608}1868vm-test-run-nixbot-gitlab> gitlab # [ 182.134381] gitaly[1347]: time="2026-07-25T07:16:44.128Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T07:16:54.128" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:44.128" grpc.time_ms=0.195 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869vm-test-run-nixbot-gitlab> gitlab # [ 182.134943] gitaly[1347]: time="2026-07-25T07:16:44.138Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T07:16:54.133" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:44.133" grpc.time_ms=4.979 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1870vm-test-run-nixbot-gitlab> gitlab # [ 182.188306] gitaly[1347]: time="2026-07-25T07:16:44.258Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK diskcache=c7bdcb67-c54c-403b-a7a9-8f8e74de28b4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T13:16:44.150" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.150" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871vm-test-run-nixbot-gitlab> gitlab # [ 182.188860] gitaly[1347]: time="2026-07-25T07:16:44.259Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1636 command.oublock=0 command.real_time_ms=109 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-07-25T13:16:44.150" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.150" grpc.time_ms=108.333 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872vm-test-run-nixbot-gitlab> gitlab # [ 182.205528] gitaly[1347]: time="2026-07-25T07:16:44.276Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4158 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:44.275" grpc.time_ms=0.327 pid=1347 span.kind=server system=grpc1873vm-test-run-nixbot-gitlab> gitlab # [ 182.210446] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.280Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"affe590fda66b8669dbc8dbd","created_at":"2026-07-25T07:16:43.890Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-bd16e8795e41413e","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:43.891Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-affe590fda66b8669dbc8dbd: done: 0.142093 sec","job_status":"done","queue_duration_s":0.247568,"scheduling_latency_s":0.247608,"gitaly_calls":1,"gitaly_duration_s":0.110098,"redis_calls":12,"redis_duration_s":0.0036090000000000002,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000512,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001231,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.127229019,"duration_s":0.142093,"completed_at":"2026-07-25T07:16:44.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1874vm-test-run-nixbot-gitlab> gitlab # [ 182.249840] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.282Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b415ef447ebaa2677296edf1","created_at":"2026-07-25T07:16:44.014Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-bd16e8795e41413e","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a69bbbbfb1b24b30d8e1c6e6c7b4b07577e335e881ac7d9fa68aaaae098c8bae","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.015Z","job_size_bytes":467,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b415ef447ebaa2677296edf1: start","job_status":"start","queue_duration_s":0.266218,"scheduling_latency_s":0.266237}1875vm-test-run-nixbot-gitlab> gitlab # [ 182.250605] gitaly[1347]: time="2026-07-25T07:16:44.298Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:14.297" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.298" grpc.time_ms=0.538 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876vm-test-run-nixbot-gitlab> gitlab # [ 182.251228] gitaly[1347]: time="2026-07-25T07:16:44.307Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T07:16:54.199" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:44.300" grpc.time_ms=7.032 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877vm-test-run-nixbot-gitlab> gitlab # [ 182.255327] gitaly[1347]: time="2026-07-25T07:16:44.325Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T07:17:14.325" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.325" grpc.time_ms=0.626 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878vm-test-run-nixbot-gitlab> gitlab # [ 182.294028] gitaly[1347]: time="2026-07-25T07:16:44.331Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=327 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-07-25T07:17:14.327" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.328" grpc.time_ms=3.306 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879vm-test-run-nixbot-gitlab> gitlab # [ 182.297220] gitaly[1347]: time="2026-07-25T07:16:44.367Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:54.259" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:44.359" grpc.time_ms=8.431 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880vm-test-run-nixbot-gitlab> gitlab # [ 182.338378] gitaly[1347]: time="2026-07-25T07:16:44.409Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4160 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:44.408" grpc.time_ms=0.347 pid=1347 span.kind=server system=grpc1881vm-test-run-nixbot-gitlab> gitlab # [ 182.353424] gitaly[1347]: time="2026-07-25T07:16:44.424Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD diskcache=fbcb862d-b376-480c-89d5-032e76f8fa02 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T07:16:54.139" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:44.139" pid=1347 ref=refs/keep-around/c2adcf0287e0a3a1c5c48f61db545dc9754d2518 remote_ip="2001:db8:1::1" revision=c2adcf0287e0a3a1c5c48f61db545dc9754d2518 span.kind=server system=grpc username=root1882vm-test-run-nixbot-gitlab> gitlab # [ 182.354071] gitaly[1347]: time="2026-07-25T07:16:44.424Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=49 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5280 command.oublock=8 command.real_time_ms=277 command.spawn_token_fork_ms=102 command.system_time_ms=32 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T07:16:54.139" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:44.139" grpc.time_ms=284.219 pid=1347 ref=refs/keep-around/c2adcf0287e0a3a1c5c48f61db545dc9754d2518 remote_ip="2001:db8:1::1" revision=c2adcf0287e0a3a1c5c48f61db545dc9754d2518 span.kind=server system=grpc username=root1883vm-test-run-nixbot-gitlab> gitlab # [ 182.356529] gitaly[1347]: time="2026-07-25T07:16:44.427Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:14.226" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.426" grpc.time_ms=0.368 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884vm-test-run-nixbot-gitlab> gitlab # [ 182.469435] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c2adcf0287e0a3a1c5c48f61db545dc9754d2518 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5531885vm-test-run-nixbot-gitlab> gitlab # [ 182.475764] nixbot[2969]: {"ts": "2026-07-25T07:16:44.546Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c2adcf0287e0a3a1c5c48f61db545dc9754d2518 \"HTTP/1.1 201 Created\""}1886vm-test-run-nixbot-gitlab> gitlab # [ 182.484113] nixbot[2969]: {"ts": "2026-07-25T07:16:44.554Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-c2adcf0287e0-dac6327e", "argv0": "bwrap"}1887vm-test-run-nixbot-gitlab> gitlab # [ 182.561649] systemd[1]: Started Nix Daemon.1888vm-test-run-nixbot-gitlab> gitlab # [ 182.602635] nix-daemon[3250]: accepted connection from pid 3249, user nixbot1889vm-test-run-nixbot-gitlab> gitlab # [ 182.606970] nix-daemon[3250]: accepted connection from pid 3248, user nixbot1890vm-test-run-nixbot-gitlab> gitlab # [ 182.638848] gitaly[1347]: time="2026-07-25T07:16:44.709Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-07-25T07:17:14.694" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.694" grpc.time_ms=14.562 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891vm-test-run-nixbot-gitlab> gitlab # [ 182.673945] gitaly[1347]: time="2026-07-25T07:16:44.744Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24A3NDBB910RENE78YRCK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-07-25T07:17:14.736" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:44.736" grpc.time_ms=7.911 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1892vm-test-run-nixbot-gitlab> gitlab # [ 182.689224] sidekiq-cluster[2039]: {"severity":"WARN","time":"2026-07-25T07:16:44.759Z","class":"CreatePipelineWorker","correlation_id":"01KYC24A3NDBB910RENE78YRCK","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"c2adcf0287e0a3a1c5c48f61db545dc9754d2518","after":"547c2ff06a1e0719efc2952e979f436c7a881ba9","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"547c2ff06a1e0719efc2952e979f436c7a881ba9","ref":"refs/heads/master"},"retry":0}1893vm-test-run-nixbot-gitlab> gitlab # [ 182.697126] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.767Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"b415ef447ebaa2677296edf1","created_at":"2026-07-25T07:16:44.014Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-bd16e8795e41413e","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a69bbbbfb1b24b30d8e1c6e6c7b4b07577e335e881ac7d9fa68aaaae098c8bae","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.015Z","job_size_bytes":467,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-b415ef447ebaa2677296edf1: done: 0.484953 sec","job_status":"done","queue_duration_s":0.266218,"scheduling_latency_s":0.266237,"gitaly_calls":7,"gitaly_duration_s":0.079544,"redis_calls":33,"redis_duration_s":0.0053089999999999995,"redis_read_bytes":184,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000714,"redis_cache_read_bytes":43,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002355,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001119,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.371535,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.484953,"completed_at":"2026-07-25T07:16:44.767Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029236,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1894vm-test-run-nixbot-gitlab> gitlab # [ 182.737970] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.807Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"495783cb-5f2a-42fc-847b-a8154c7c2658\"}"],"class":"WebHookWorker","jid":"32342c5ee5f7316456319420","created_at":"2026-07-25T07:16:44.094Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-bd16e8795e41413e","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3d5fd7804b24911bedc0b387253551b3d1d990904142fd224f52d5b521c61bdd","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.098Z","job_size_bytes":1749,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-32342c5ee5f7316456319420: start","job_status":"start","queue_duration_s":0.708688,"scheduling_latency_s":0.708729}1895vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=547c2ff06a1e0719efc2952e979f436c7a881ba9'1896vm-test-run-nixbot-gitlab> gitlab # [ 182.859220] nixbot[2969]: INFO: ::ffff:127.0.0.1:44026 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1897vm-test-run-nixbot-gitlab> gitlab # [ 182.875730] nixbot[2969]: INFO: ::ffff:127.0.0.1:44040 - "GET /api/repos/gitlab/root/test-flake/builds?commit=547c2ff06a1e0719efc2952e979f436c7a881ba9 HTTP/1.1" 200 OK1898vm-test-run-nixbot-gitlab> gitlab # [ 182.877309] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.946Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"495783cb-5f2a-42fc-847b-a8154c7c2658\"}"],"class":"WebHookWorker","jid":"32342c5ee5f7316456319420","created_at":"2026-07-25T07:16:44.094Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-bd16e8795e41413e","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3d5fd7804b24911bedc0b387253551b3d1d990904142fd224f52d5b521c61bdd","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.098Z","job_size_bytes":1749,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-32342c5ee5f7316456319420: done: 0.139539 sec","job_status":"done","queue_duration_s":0.708688,"scheduling_latency_s":0.708729,"redis_calls":19,"redis_duration_s":0.005209,"redis_read_bytes":31,"redis_write_bytes":5282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001147,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.001278,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3644,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0017,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.02166560300000242,"cpu_s":0.088187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000391111,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.139539,"completed_at":"2026-07-25T07:16:44.946Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1899vm-test-run-nixbot-gitlab> gitlab # [ 182.887508] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.948Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4b80a8f3269d00bc3216fd44","created_at":"2026-07-25T07:16:44.430Z","trace_propagation_headers":{"sentry-trace":"5475a5f2ad554a6997dec9e1b19c00a3-d81c5582229f4793","baggage":"sentry-trace_id=5475a5f2ad554a6997dec9e1b19c00a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24ATJV7JWVWRSB4QNRXGD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.435Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4b80a8f3269d00bc3216fd44: start","job_status":"start","queue_duration_s":0.512726,"scheduling_latency_s":0.512741}1900vm-test-run-nixbot-gitlab> gitlab # [ 182.942243] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.988Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4b80a8f3269d00bc3216fd44","created_at":"2026-07-25T07:16:44.430Z","trace_propagation_headers":{"sentry-trace":"5475a5f2ad554a6997dec9e1b19c00a3-d81c5582229f4793","baggage":"sentry-trace_id=5475a5f2ad554a6997dec9e1b19c00a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24ATJV7JWVWRSB4QNRXGD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.435Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4b80a8f3269d00bc3216fd44: done: 0.040911 sec","job_status":"done","queue_duration_s":0.512726,"scheduling_latency_s":0.512741,"redis_calls":18,"redis_duration_s":0.002321,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001291,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000203657,"duration_s":0.040911,"completed_at":"2026-07-25T07:16:44.988Z","load_balancing_strategy":"primary","db_duration_s":0.016688,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1901vm-test-run-nixbot-gitlab> gitlab # [ 182.949489] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:44.989Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"11ea716844c0aa752aabe9ac","created_at":"2026-07-25T07:16:44.435Z","trace_propagation_headers":{"sentry-trace":"5475a5f2ad554a6997dec9e1b19c00a3-d81c5582229f4793","baggage":"sentry-trace_id=5475a5f2ad554a6997dec9e1b19c00a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24ATJV7JWVWRSB4QNRXGD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.438Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-11ea716844c0aa752aabe9ac: start","job_status":"start","queue_duration_s":0.551773,"scheduling_latency_s":0.551786}1902vm-test-run-nixbot-gitlab> gitlab # [ 182.988123] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.058Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"11ea716844c0aa752aabe9ac","created_at":"2026-07-25T07:16:44.435Z","trace_propagation_headers":{"sentry-trace":"5475a5f2ad554a6997dec9e1b19c00a3-d81c5582229f4793","baggage":"sentry-trace_id=5475a5f2ad554a6997dec9e1b19c00a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24ATJV7JWVWRSB4QNRXGD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.438Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-11ea716844c0aa752aabe9ac: done: 0.068628 sec","job_status":"done","queue_duration_s":0.551773,"scheduling_latency_s":0.551786,"redis_calls":15,"redis_duration_s":0.002148,"redis_read_bytes":142,"redis_write_bytes":1431,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000452,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":431,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000793,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227962,"duration_s":0.068628,"completed_at":"2026-07-25T07:16:45.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1903vm-test-run-nixbot-gitlab> gitlab # [ 183.002425] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.064Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d28e37f29bdb8c64a400dddd","created_at":"2026-07-25T07:16:44.523Z","trace_propagation_headers":{"sentry-trace":"5475a5f2ad554a6997dec9e1b19c00a3-d81c5582229f4793","baggage":"sentry-trace_id=5475a5f2ad554a6997dec9e1b19c00a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24ATJV7JWVWRSB4QNRXGD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.529Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d28e37f29bdb8c64a400dddd: start","job_status":"start","queue_duration_s":0.534572,"scheduling_latency_s":0.534601}1904vm-test-run-nixbot-gitlab> gitlab # [ 183.039878] gitaly[1347]: time="2026-07-25T07:16:45.110Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KYC24BVPEXZFAQ2F6VMKKNAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.099" grpc.time_ms=11.104 pid=1347 remote_ip=127.0.0.1 span.kind=server system=grpc1905vm-test-run-nixbot-gitlab> gitlab # [ 183.041973] gitlab-workhorse[1281]: gitlab 127.0.0.1 - - [2026/07/25:07:16:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 651906vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=547c2ff06a1e0719efc2952e979f436c7a881ba9', in 0.24 seconds)1907vm-test-run-nixbot-gitlab> gitlab # [ 183.075779] gitaly[1347]: time="2026-07-25T07:16:45.146Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T07:17:15.145" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.145" grpc.time_ms=0.676 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908vm-test-run-nixbot-gitlab> gitlab # [ 183.092582] gitaly[1347]: time="2026-07-25T07:16:45.163Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24BXSP5NZ8EYJJACFF95Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.150" pid=1347 remote_ip=127.0.0.1 request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1909vm-test-run-nixbot-gitlab> gitlab # [ 183.101429] gitaly[1347]: time="2026-07-25T07:16:45.163Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24BXSP5NZ8EYJJACFF95Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.150" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1347 remote_ip=127.0.0.1 span.kind=server system=grpc1910vm-test-run-nixbot-gitlab> gitlab # [ 183.114617] gitlab-workhorse[1281]: time="2026-07-25T07:16:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671911vm-test-run-nixbot-gitlab> gitlab # [ 183.115189] gitlab-workhorse[1281]: gitlab 127.0.0.1 - - [2026/07/25:07:16:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 501912vm-test-run-nixbot-gitlab> gitlab # [ 183.115695] gitaly[1347]: time="2026-07-25T07:16:45.163Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24BXSP5NZ8EYJJACFF95Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.150" grpc.time_ms=13.048 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1347 remote_ip=127.0.0.1 span.kind=server system=grpc1913vm-test-run-nixbot-gitlab> gitlab # [ 183.116391] gitaly[1347]: time="2026-07-25T07:16:45.184Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:15.183" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.183" grpc.time_ms=0.459 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1914vm-test-run-nixbot-gitlab> gitlab # [ 183.145076] gitaly[1347]: time="2026-07-25T07:16:45.215Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24BZDQWNHKYW982H4NW8D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.203" pid=1347 remote_ip=127.0.0.1 request_sha=963ea66d57e8068b204997f4887d7ee4842f166f response_bytes=337 span.kind=server system=grpc1915vm-test-run-nixbot-gitlab> gitlab # [ 183.145797] gitaly[1347]: time="2026-07-25T07:16:45.215Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24BZDQWNHKYW982H4NW8D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.203" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1347 remote_ip=127.0.0.1 span.kind=server system=grpc1916vm-test-run-nixbot-gitlab> gitlab # [ 183.148449] gitaly[1347]: time="2026-07-25T07:16:45.218Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24BZDQWNHKYW982H4NW8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.203" grpc.time_ms=14.779 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1347 remote_ip=127.0.0.1 span.kind=server system=grpc1917vm-test-run-nixbot-gitlab> gitlab # [ 183.149270] gitlab-workhorse[1281]: time="2026-07-25T07:16:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371918vm-test-run-nixbot-gitlab> gitlab # [ 183.151371] gitlab-workhorse[1281]: gitlab 127.0.0.1 - - [2026/07/25:07:16:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.54.0" 531919vm-test-run-nixbot-gitlab> gitlab # [ 183.163967] gitaly[1347]: time="2026-07-25T07:16:45.234Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24ATJV7JWVWRSB4QNRXGD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:15.233" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.234" grpc.time_ms=0.418 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920vm-test-run-nixbot-gitlab> gitlab # [ 183.174659] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.245Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d28e37f29bdb8c64a400dddd","created_at":"2026-07-25T07:16:44.523Z","trace_propagation_headers":{"sentry-trace":"5475a5f2ad554a6997dec9e1b19c00a3-d81c5582229f4793","baggage":"sentry-trace_id=5475a5f2ad554a6997dec9e1b19c00a3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24ATJV7JWVWRSB4QNRXGD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.529Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d28e37f29bdb8c64a400dddd: done: 0.181021 sec","job_status":"done","queue_duration_s":0.534572,"scheduling_latency_s":0.534601,"gitaly_calls":3,"gitaly_duration_s":0.007592,"redis_calls":48,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011787,"redis_read_bytes":208,"redis_write_bytes":6803,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000672,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":16,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001414,"redis_cache_read_bytes":32,"redis_cache_write_bytes":1470,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.004858,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000167,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002889,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000294,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000121,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0007,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.036,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084732,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.145584145,"duration_s":0.181021,"completed_at":"2026-07-25T07:16:45.245Z","load_balancing_strategy":"primary","db_duration_s":0.066761,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1921vm-test-run-nixbot-gitlab> gitlab # [ 183.197217] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.251Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","32342c5ee5f7316456319420"],"class":"WebHooks::LogExecutionWorker","jid":"a775e2dd2afea27dae2a5203","created_at":"2026-07-25T07:16:44.932Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-fc89d252a1f94c9a","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:32e439a73be7e2dedb6d0a5b4019cc4bfbc4599ae1c44cbff2359d8a13af33ba","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.938Z","job_size_bytes":2507,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a775e2dd2afea27dae2a5203: start","job_status":"start","queue_duration_s":0.312536,"scheduling_latency_s":0.312552}1922vm-test-run-nixbot-gitlab> gitlab # [ 183.273971] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.344Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","32342c5ee5f7316456319420"],"class":"WebHooks::LogExecutionWorker","jid":"a775e2dd2afea27dae2a5203","created_at":"2026-07-25T07:16:44.932Z","trace_propagation_headers":{"sentry-trace":"7dea7a77074b4d7f91fdc4e54fdc972a-fc89d252a1f94c9a","baggage":"sentry-trace_id=7dea7a77074b4d7f91fdc4e54fdc972a,sentry-release=Unknown"},"correlation_id":"01KYC24A3NDBB910RENE78YRCK","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:32e439a73be7e2dedb6d0a5b4019cc4bfbc4599ae1c44cbff2359d8a13af33ba","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:44.938Z","job_size_bytes":2507,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a775e2dd2afea27dae2a5203: done: 0.093055 sec","job_status":"done","queue_duration_s":0.312536,"scheduling_latency_s":0.312552,"redis_calls":10,"redis_duration_s":0.0045769999999999995,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000933,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000401,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000578844,"duration_s":0.093055,"completed_at":"2026-07-25T07:16:45.344Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006321,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1923vm-test-run-nixbot-gitlab> gitlab # [ 183.294255] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.345Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"328adc935c124ffa82c23890","created_at":"2026-07-25T07:16:45.133Z","trace_propagation_headers":{"sentry-trace":"5475a5f2ad554a6997dec9e1b19c00a3-8166c667def44d62","baggage":"sentry-trace_id=5475a5f2ad554a6997dec9e1b19c00a3,sentry-release=Unknown"},"correlation_id":"01KYC24ATJV7JWVWRSB4QNRXGD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.137Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-328adc935c124ffa82c23890: start","job_status":"start","queue_duration_s":0.208465,"scheduling_latency_s":0.208479}1924vm-test-run-nixbot-gitlab> gitlab # [ 183.296746] gitaly[1347]: time="2026-07-25T07:16:45.366Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24C400ZQWGZX37NR5H5AK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.358" grpc.time_ms=7.579 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925vm-test-run-nixbot-gitlab> gitlab # [ 183.333190] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 531926vm-test-run-nixbot-gitlab> gitlab # [ 183.333808] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.386Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"328adc935c124ffa82c23890","created_at":"2026-07-25T07:16:45.133Z","trace_propagation_headers":{"sentry-trace":"5475a5f2ad554a6997dec9e1b19c00a3-8166c667def44d62","baggage":"sentry-trace_id=5475a5f2ad554a6997dec9e1b19c00a3,sentry-release=Unknown"},"correlation_id":"01KYC24ATJV7JWVWRSB4QNRXGD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.137Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-328adc935c124ffa82c23890: done: 0.040586 sec","job_status":"done","queue_duration_s":0.208465,"scheduling_latency_s":0.208479,"redis_calls":10,"redis_duration_s":0.006232,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001301,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000267632,"duration_s":0.040586,"completed_at":"2026-07-25T07:16:45.386Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010761,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1927vm-test-run-nixbot-gitlab> gitlab # [ 183.374632] gitaly[1347]: time="2026-07-25T07:16:45.444Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C5SPGHSY824Z1G50R2R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.402" pid=1347 remote_ip="2001:db8:1::1" request_sha=f1e6bb59289c4d43fc3699ed3fc4760ee01ef0e9 response_bytes=216 span.kind=server system=grpc1928vm-test-run-nixbot-gitlab> gitlab # [ 183.375366] gitlab-workhorse[1281]: time="2026-07-25T07:16:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161929vm-test-run-nixbot-gitlab> gitlab # [ 183.375796] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.54.0" 751930vm-test-run-nixbot-gitlab> gitlab # [ 183.376371] gitaly[1347]: time="2026-07-25T07:16:45.444Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=39 command.spawn_token_fork_ms=29 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C5SPGHSY824Z1G50R2R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.402" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1931vm-test-run-nixbot-gitlab> gitlab # [ 183.377171] gitaly[1347]: time="2026-07-25T07:16:45.444Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=39 command.spawn_token_fork_ms=29 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C5SPGHSY824Z1G50R2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-07-25T07:16:45.402" grpc.time_ms=41.708 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=1 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc1932vm-test-run-nixbot-gitlab> gitlab # [ 183.424756] nixbot[2969]: {"ts": "2026-07-25T07:16:45.495Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}1933vm-test-run-nixbot-gitlab> gitlab # [ 183.429402] nix-daemon[3255]: unexpected Nix daemon error: error: interrupted by the user1934vm-test-run-nixbot-gitlab> gitlab # [ 183.464134] gitaly[1347]: time="2026-07-25T07:16:45.534Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:15.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.534" grpc.time_ms=0.446 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935vm-test-run-nixbot-gitlab> gitlab # [ 183.480433] gitaly[1347]: time="2026-07-25T07:16:45.551Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:15.350" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.550" grpc.time_ms=0.451 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936vm-test-run-nixbot-gitlab> gitlab # [ 183.506974] gitaly[1347]: time="2026-07-25T07:16:45.577Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-07-25T07:17:15.070" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:45.570" grpc.time_ms=6.793 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937vm-test-run-nixbot-gitlab> gitlab # [ 183.523775] gitaly[1347]: time="2026-07-25T07:16:45.594Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:55.137" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:45.589" grpc.time_ms=4.997 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938vm-test-run-nixbot-gitlab> gitlab # [ 183.529461] gitaly[1347]: time="2026-07-25T07:16:45.600Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:55.014" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:45.595" grpc.time_ms=5.014 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939vm-test-run-nixbot-gitlab> gitlab # [ 183.548260] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.618Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"78c2f2cbdebe9440b2bf08f2","created_at":"2026-07-25T07:16:45.614Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-934c453af4b044b6","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.616Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-78c2f2cbdebe9440b2bf08f2: start","job_status":"start","queue_duration_s":0.002214,"scheduling_latency_s":0.002246}1940vm-test-run-nixbot-gitlab> gitlab # [ 183.564071] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c2adcf0287e0a3a1c5c48f61db545dc9754d2518 HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 1221941vm-test-run-nixbot-gitlab> gitlab # [ 183.565079] nixbot[2969]: {"ts": "2026-07-25T07:16:45.635Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c2adcf0287e0a3a1c5c48f61db545dc9754d2518 \"HTTP/1.1 201 Created\""}1942vm-test-run-nixbot-gitlab> gitlab # [ 183.593645] gitaly[1347]: time="2026-07-25T07:16:45.664Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-07-25T07:16:55.083" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:45.663" grpc.time_ms=0.229 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943vm-test-run-nixbot-gitlab> gitlab # [ 183.604071] gitaly[1347]: time="2026-07-25T07:16:45.674Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-07-25T07:16:55.087" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:45.668" grpc.time_ms=6.324 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1944vm-test-run-nixbot-gitlab> gitlab # [ 183.621417] gitaly[1347]: time="2026-07-25T07:16:45.691Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24CE9GYY36A5C0CWJRKA3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:15.489" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.690" grpc.time_ms=1.774 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1945vm-test-run-nixbot-gitlab> gitlab # [ 183.650225] gitaly[1347]: time="2026-07-25T07:16:45.720Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KYC24CE9GYY36A5C0CWJRKA3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:16:55.274" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:45.714" grpc.time_ms=5.61 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946vm-test-run-nixbot-gitlab> gitlab # [ 183.666963] gitaly[1347]: time="2026-07-25T07:16:45.737Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:45.735" grpc.time_ms=0.531 pid=1347 span.kind=server system=grpc1947vm-test-run-nixbot-gitlab> gitlab # [ 183.668259] gitaly[1347]: time="2026-07-25T07:16:45.738Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4158 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:45.737" grpc.time_ms=1.488 pid=1347 span.kind=server system=grpc1948vm-test-run-nixbot-gitlab> gitlab # [ 183.690093] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:45 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/c2adcf0287e0a3a1c5c48f61db545dc9754d2518 HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 1191949vm-test-run-nixbot-gitlab> gitlab # [ 183.690729] nixbot[2969]: {"ts": "2026-07-25T07:16:45.761Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/c2adcf0287e0a3a1c5c48f61db545dc9754d2518 \"HTTP/1.1 201 Created\""}1950vm-test-run-nixbot-gitlab> gitlab # [ 183.701744] gitaly[1347]: time="2026-07-25T07:16:45.772Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4160 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:45.771" grpc.time_ms=0.881 pid=1347 span.kind=server system=grpc1951vm-test-run-nixbot-gitlab> gitlab # [ 183.715942] gitaly[1347]: time="2026-07-25T07:16:45.786Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3900 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:45.785" grpc.time_ms=1.052 pid=1347 span.kind=server system=grpc1952vm-test-run-nixbot-gitlab> gitlab # [ 183.728065] gitaly[1347]: time="2026-07-25T07:16:45.798Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J diskcache=c3228693-e490-452c-9db7-33208e51e0b4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T07:16:55.106" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:45.686" pid=1347 ref=refs/keep-around/547c2ff06a1e0719efc2952e979f436c7a881ba9 remote_ip="2001:db8:1::1" revision=547c2ff06a1e0719efc2952e979f436c7a881ba9 span.kind=server system=grpc username=root1953vm-test-run-nixbot-gitlab> gitlab # [ 183.737726] gitaly[1347]: time="2026-07-25T07:16:45.808Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=60 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5060 command.oublock=8 command.real_time_ms=93 command.spawn_token_fork_ms=0 command.system_time_ms=45 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-07-25T07:16:55.106" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-07-25T07:16:45.686" grpc.time_ms=111.933 pid=1347 ref=refs/keep-around/547c2ff06a1e0719efc2952e979f436c7a881ba9 remote_ip="2001:db8:1::1" revision=547c2ff06a1e0719efc2952e979f436c7a881ba9 span.kind=server system=grpc username=root1954vm-test-run-nixbot-gitlab> gitlab # [ 183.741414] gitaly[1347]: time="2026-07-25T07:16:45.812Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:15.311" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.811" grpc.time_ms=0.418 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955vm-test-run-nixbot-gitlab> gitlab # [ 183.742387] gitaly[1347]: time="2026-07-25T07:16:45.813Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:45.811" grpc.time_ms=1.843 pid=1347 span.kind=server system=grpc1956vm-test-run-nixbot-gitlab> gitlab # [ 183.751494] gitaly[1347]: time="2026-07-25T07:16:45.822Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V diskcache=fcd2a236-9b27-4bf2-9edb-43c4482efc07 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T07:17:15.700" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:45.701" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1957vm-test-run-nixbot-gitlab> gitlab # [ 183.752155] gitaly[1347]: time="2026-07-25T07:16:45.822Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=97 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7555 command.oublock=0 command.real_time_ms=113 command.spawn_token_fork_ms=0 command.system_time_ms=67 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T07:17:15.700" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:45.701" grpc.time_ms=120.815 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958vm-test-run-nixbot-gitlab> gitlab # [ 183.796040] gitaly[1347]: time="2026-07-25T07:16:45.866Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T07:17:15.865" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.866" grpc.time_ms=0.538 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1959vm-test-run-nixbot-gitlab> gitlab # [ 183.817306] gitaly[1347]: time="2026-07-25T07:16:45.887Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:15.886" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.887" grpc.time_ms=0.554 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960vm-test-run-nixbot-gitlab> gitlab # [ 183.864255] gitaly[1347]: time="2026-07-25T07:16:45.934Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:15.033" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:45.934" grpc.time_ms=0.545 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961vm-test-run-nixbot-gitlab> gitlab # [ 183.883053] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.953Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7ee19e6a3d422c3c41452d93","created_at":"2026-07-25T07:16:45.950Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"78c2f2cbdebe9440b2bf08f2","job_size_bytes":3,"pid":2039,"job_status":"deduplicated","message":"PipelineProcessWorker JID-7ee19e6a3d422c3c41452d93: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1962vm-test-run-nixbot-gitlab> gitlab # [ 183.901343] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.971Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"78c2f2cbdebe9440b2bf08f2","created_at":"2026-07-25T07:16:45.614Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-934c453af4b044b6","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.616Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2039,"job_status":"rescheduled","message":"PipelineProcessWorker JID-78c2f2cbdebe9440b2bf08f2: rescheduled"}1963vm-test-run-nixbot-gitlab> gitlab # [ 183.909558] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.979Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"78c2f2cbdebe9440b2bf08f2","created_at":"2026-07-25T07:16:45.614Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-934c453af4b044b6","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.616Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-78c2f2cbdebe9440b2bf08f2: done: 0.361143 sec","job_status":"done","queue_duration_s":0.002214,"scheduling_latency_s":0.002246,"gitaly_calls":4,"gitaly_duration_s":0.140386,"redis_calls":116,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.03877,"redis_read_bytes":1039,"redis_write_bytes":25218,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00087,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":17,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.00125,"redis_cache_read_bytes":33,"redis_cache_write_bytes":1526,"redis_feature_flag_calls":34,"redis_feature_flag_duration_s":0.017601,"redis_feature_flag_read_bytes":796,"redis_feature_flag_write_bytes":5083,"redis_queues_calls":22,"redis_queues_duration_s":0.001943,"redis_queues_read_bytes":25,"redis_queues_write_bytes":12385,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.003808,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000185,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00031,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011933,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":50,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":50,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.015,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.137873,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.294184316,"duration_s":0.361143,"completed_at":"2026-07-25T07:16:45.979Z","load_balancing_strategy":"primary","db_duration_s":0.045669,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1964vm-test-run-nixbot-gitlab> gitlab # [ 183.920433] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:45.981Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b1bd3d852dd3bfd69ce85ac0","created_at":"2026-07-25T07:16:45.692Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.695Z","job_size_bytes":23,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b1bd3d852dd3bfd69ce85ac0: start","job_status":"start","queue_duration_s":0.285952,"scheduling_latency_s":0.285981}1965vm-test-run-nixbot-gitlab> gitlab # [ 183.976906] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.047Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"b1bd3d852dd3bfd69ce85ac0","created_at":"2026-07-25T07:16:45.692Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.695Z","job_size_bytes":23,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-b1bd3d852dd3bfd69ce85ac0: done: 0.066008 sec","job_status":"done","queue_duration_s":0.285952,"scheduling_latency_s":0.285981,"redis_calls":15,"redis_duration_s":0.002046,"redis_read_bytes":13,"redis_write_bytes":3012,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_calls":2,"redis_queues_duration_s":0.000192,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1627,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000406,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":13,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051435,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000189689,"duration_s":0.066008,"completed_at":"2026-07-25T07:16:46.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008657,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1966vm-test-run-nixbot-gitlab> gitlab # [ 183.982102] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/547c2ff06a1e0719efc2952e979f436c7a881ba9 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5541967vm-test-run-nixbot-gitlab> gitlab # [ 183.983718] nixbot[2969]: {"ts": "2026-07-25T07:16:46.053Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/547c2ff06a1e0719efc2952e979f436c7a881ba9 \"HTTP/1.1 201 Created\""}1968vm-test-run-nixbot-gitlab> gitlab # [ 183.992414] nixbot[2969]: {"ts": "2026-07-25T07:16:46.062Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-547c2ff06a1e-616c14b1", "argv0": "bwrap"}1969vm-test-run-nixbot-gitlab> gitlab # [ 184.022307] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.092Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"12b6bf158a15e3f16beee136","created_at":"2026-07-25T07:16:46.041Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-2b971cfd4fd04602","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:c35df8cb59f284494f4776b41b37efcc31e4db35c9eefcdf835716101fac2ac4","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:46.042Z","job_size_bytes":464,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-12b6bf158a15e3f16beee136: start","job_status":"start","queue_duration_s":0.049761,"scheduling_latency_s":0.049784}1970vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=547c2ff06a1e0719efc2952e979f436c7a881ba9'1971vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=547c2ff06a1e0719efc2952e979f436c7a881ba9', in 0.03 seconds)1972vm-test-run-nixbot-gitlab> (finished: subtest: push delivers the webhook, in 3.09 seconds)1973vm-test-run-nixbot-gitlab> subtest: eval and build post commit statuses1974vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses1975vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses, in 0.26 seconds)1976vm-test-run-nixbot-gitlab> gitlab # [ 184.063161] sidekiq-cluster[2039]: {"severity":"WARN","time":"2026-07-25T07:16:46.133Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"12b6bf158a15e3f16beee136","created_at":"2026-07-25T07:16:46.041Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-2b971cfd4fd04602","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:c35df8cb59f284494f4776b41b37efcc31e4db35c9eefcdf835716101fac2ac4","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:46.042Z","job_size_bytes":464,"pid":2039,"sidekiq_tid":"m1aj","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-12b6bf158a15e3f16beee136: fail: 0.040136 sec","job_status":"fail","queue_duration_s":0.049761,"scheduling_latency_s":0.049784,"redis_calls":7,"redis_duration_s":0.00095,"redis_read_bytes":5,"redis_write_bytes":786,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000273,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040136,"completed_at":"2026-07-25T07:16:46.132Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/h836fb4ajnymmg0ash24wg1cb4qbhnpd-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/hapk8srbrjgzcpyn7snxh1713ans9a3k-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/abbaw4w9gll6p923md75p3h3rrmhrdqn-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/z2822z98p3wywq7nq70f3l458wb38x4k-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/bqz31s23z0jk4464lbybyz83ikl0gmyd-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/l71g3rmwn8nif8ik503h15pklil3njdz-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/wp2rnxa243q2gn2f8h04d48hnvfr0387-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/i614i7jgbmq8nfpazmpxhvhawszwyg1f-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/d2b87xpm5ksd634qirnkzkp7bav928v9-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/avw1z19zhyfbsdkh6mbsdbsv02mpq0k9-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/85h4805ad7n5qn7wq2m6icypga7rnk80-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/2cs1nrzqirc1nwy2h32akwq1w5899v7d-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/6b5b40g0i1g6c6ymmg8fd6c8cjf4nh5x-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.005904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1977vm-test-run-nixbot-gitlab> gitlab # [ 184.363510] nix-daemon[3250]: accepted connection from pid 3384, user nixbot1978vm-test-run-nixbot-gitlab> gitlab # [ 184.364124] nix-daemon[3250]: accepted connection from pid 3386, user nixbot1979vm-test-run-nixbot-gitlab> gitlab # [ 184.364813] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 791980vm-test-run-nixbot-gitlab> gitlab # [ 184.365443] gitaly[1347]: time="2026-07-25T07:16:46.255Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24CZKRWG24AT71VXG0MG9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:16.053" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:46.254" grpc.time_ms=1.004 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1981vm-test-run-nixbot-gitlab> gitlab # [ 184.366092] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.242Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"10a4f2660f2c079392e9ca76","created_at":"2026-07-25T07:16:45.826Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.829Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-10a4f2660f2c079392e9ca76: start","job_status":"start","queue_duration_s":0.412934,"scheduling_latency_s":0.412965}1982vm-test-run-nixbot-gitlab> gitlab # [ 184.366605] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.294Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"10a4f2660f2c079392e9ca76","created_at":"2026-07-25T07:16:45.826Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.829Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-10a4f2660f2c079392e9ca76: done: 0.051663 sec","job_status":"done","queue_duration_s":0.412934,"scheduling_latency_s":0.412965,"redis_calls":10,"redis_duration_s":0.001405,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000317,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214832,"duration_s":0.051663,"completed_at":"2026-07-25T07:16:46.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1983vm-test-run-nixbot-gitlab> gitlab # [ 184.406053] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"26c35569e2824f6689e20081","created_at":"2026-07-25T07:16:45.838Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.841Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-26c35569e2824f6689e20081: start","job_status":"start","queue_duration_s":0.453781,"scheduling_latency_s":0.453795}1984vm-test-run-nixbot-gitlab> gitlab # [ 184.406833] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.314Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"26c35569e2824f6689e20081","created_at":"2026-07-25T07:16:45.838Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.841Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-26c35569e2824f6689e20081: done: 0.019743 sec","job_status":"done","queue_duration_s":0.453781,"scheduling_latency_s":0.453795,"redis_calls":10,"redis_duration_s":0.001225,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000241,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000192762,"duration_s":0.019743,"completed_at":"2026-07-25T07:16:46.314Z","load_balancing_strategy":"primary","db_duration_s":0.00394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1985vm-test-run-nixbot-gitlab> gitlab # [ 184.452725] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.315Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8ba0a8c2b8c6b99c01e9b269","created_at":"2026-07-25T07:16:45.849Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.851Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8ba0a8c2b8c6b99c01e9b269: start","job_status":"start","queue_duration_s":0.464426,"scheduling_latency_s":0.464439}1986vm-test-run-nixbot-gitlab> gitlab # [ 184.453460] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.333Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8ba0a8c2b8c6b99c01e9b269","created_at":"2026-07-25T07:16:45.849Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.851Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8ba0a8c2b8c6b99c01e9b269: done: 0.017662 sec","job_status":"done","queue_duration_s":0.464426,"scheduling_latency_s":0.464439,"redis_calls":13,"redis_duration_s":0.001727,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000362,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000392,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00018494,"duration_s":0.017662,"completed_at":"2026-07-25T07:16:46.333Z","load_balancing_strategy":"primary","db_duration_s":0.002084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987vm-test-run-nixbot-gitlab> gitlab # [ 184.499991] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.334Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9fae95503fb0c01e500bbd4b","created_at":"2026-07-25T07:16:45.851Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.853Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9fae95503fb0c01e500bbd4b: start","job_status":"start","queue_duration_s":0.480415,"scheduling_latency_s":0.480427}1988vm-test-run-nixbot-gitlab> gitlab # [ 184.502608] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9fae95503fb0c01e500bbd4b","created_at":"2026-07-25T07:16:45.851Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.853Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9fae95503fb0c01e500bbd4b: done: 0.015734 sec","job_status":"done","queue_duration_s":0.480415,"scheduling_latency_s":0.480427,"redis_calls":10,"redis_duration_s":0.001202,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00018913,"duration_s":0.015734,"completed_at":"2026-07-25T07:16:46.349Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1989vm-test-run-nixbot-gitlab> gitlab # [ 184.556172] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.350Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6e8e3ecbf617a683567c97c3","created_at":"2026-07-25T07:16:45.854Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.856Z","job_size_bytes":19,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6e8e3ecbf617a683567c97c3: start","job_status":"start","queue_duration_s":0.494354,"scheduling_latency_s":0.494386}1990vm-test-run-nixbot-gitlab> gitlab # [ 184.556977] nixbot[2969]: INFO: ::ffff:127.0.0.1:40312 - "GET /api/repos/gitlab/root/test-flake/builds?commit=547c2ff06a1e0719efc2952e979f436c7a881ba9 HTTP/1.1" 200 OK1991vm-test-run-nixbot-gitlab> gitlab # [ 184.558612] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.439Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6e8e3ecbf617a683567c97c3","created_at":"2026-07-25T07:16:45.854Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.856Z","job_size_bytes":19,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6e8e3ecbf617a683567c97c3: done: 0.088366 sec","job_status":"done","queue_duration_s":0.494354,"scheduling_latency_s":0.494386,"redis_calls":11,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.069,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000194438,"duration_s":0.088366,"completed_at":"2026-07-25T07:16:46.439Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.070816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1992vm-test-run-nixbot-gitlab> gitlab # [ 184.613119] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.440Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"47bb83f615a3dd45a2c1f0d5","created_at":"2026-07-25T07:16:45.858Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.860Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-47bb83f615a3dd45a2c1f0d5: start","job_status":"start","queue_duration_s":0.579716,"scheduling_latency_s":0.57973}1993vm-test-run-nixbot-gitlab> gitlab # [ 184.613901] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.525Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"47bb83f615a3dd45a2c1f0d5","created_at":"2026-07-25T07:16:45.858Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.860Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-47bb83f615a3dd45a2c1f0d5: done: 0.085023 sec","job_status":"done","queue_duration_s":0.579716,"scheduling_latency_s":0.57973,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000187175,"duration_s":0.085023,"completed_at":"2026-07-25T07:16:46.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1994vm-test-run-nixbot-gitlab> gitlab # [ 184.649171] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.526Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"d9bacd254fd6add3169b5f34","created_at":"2026-07-25T07:16:45.861Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.862Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d9bacd254fd6add3169b5f34: start","job_status":"start","queue_duration_s":0.664476,"scheduling_latency_s":0.664496}1995vm-test-run-nixbot-gitlab> gitlab # [ 184.685680] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.545Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"d9bacd254fd6add3169b5f34","created_at":"2026-07-25T07:16:45.861Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.862Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d9bacd254fd6add3169b5f34: done: 0.018764 sec","job_status":"done","queue_duration_s":0.664476,"scheduling_latency_s":0.664496,"redis_calls":7,"redis_duration_s":0.000879,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018764,"completed_at":"2026-07-25T07:16:46.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1996vm-test-run-nixbot-gitlab> gitlab # [ 184.723915] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.546Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bb8e2d14182631ce31766130","created_at":"2026-07-25T07:16:45.861Z","trace_propagation_headers":{"sentry-trace":"92102a43f3b44aba98d0489a84d577c8-1d0e637975cc4df9","baggage":"sentry-trace_id=92102a43f3b44aba98d0489a84d577c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24C9S12JME0968SNA4M8J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.864Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bb8e2d14182631ce31766130: start","job_status":"start","queue_duration_s":0.68223,"scheduling_latency_s":0.682245}1997vm-test-run-nixbot-gitlab> gitlab # [ 184.724578] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.560Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bb8e2d14182631ce31766130","created_at":"2026-07-25T07:16:45.861Z","trace_propagation_headers":{"sentry-trace":"92102a43f3b44aba98d0489a84d577c8-1d0e637975cc4df9","baggage":"sentry-trace_id=92102a43f3b44aba98d0489a84d577c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24C9S12JME0968SNA4M8J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.864Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bb8e2d14182631ce31766130: done: 0.013486 sec","job_status":"done","queue_duration_s":0.68223,"scheduling_latency_s":0.682245,"redis_calls":7,"redis_duration_s":0.0008799999999999999,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000645,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013486,"completed_at":"2026-07-25T07:16:46.560Z","load_balancing_strategy":"primary","db_duration_s":0.00162,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1998vm-test-run-nixbot-gitlab> gitlab # [ 184.739688] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.561Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3810f875be2e222eb3412d80","created_at":"2026-07-25T07:16:45.864Z","trace_propagation_headers":{"sentry-trace":"92102a43f3b44aba98d0489a84d577c8-1d0e637975cc4df9","baggage":"sentry-trace_id=92102a43f3b44aba98d0489a84d577c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24C9S12JME0968SNA4M8J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.866Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3810f875be2e222eb3412d80: start","job_status":"start","queue_duration_s":0.694508,"scheduling_latency_s":0.694521}1999vm-test-run-nixbot-gitlab> gitlab # [ 184.782728] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.589Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"3810f875be2e222eb3412d80","created_at":"2026-07-25T07:16:45.864Z","trace_propagation_headers":{"sentry-trace":"92102a43f3b44aba98d0489a84d577c8-1d0e637975cc4df9","baggage":"sentry-trace_id=92102a43f3b44aba98d0489a84d577c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24C9S12JME0968SNA4M8J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.866Z","job_size_bytes":65,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-3810f875be2e222eb3412d80: done: 0.02885 sec","job_status":"done","queue_duration_s":0.694508,"scheduling_latency_s":0.694521,"redis_calls":10,"redis_duration_s":0.001434,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02885,"completed_at":"2026-07-25T07:16:46.589Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2000vm-test-run-nixbot-gitlab> gitlab # [ 184.789099] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.590Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2aaebfd456b93bc3934f878f","created_at":"2026-07-25T07:16:45.898Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.902Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2aaebfd456b93bc3934f878f: start","job_status":"start","queue_duration_s":0.688512,"scheduling_latency_s":0.688542}2001vm-test-run-nixbot-gitlab> gitlab # [ 184.832563] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.611Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2aaebfd456b93bc3934f878f","created_at":"2026-07-25T07:16:45.898Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.902Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2aaebfd456b93bc3934f878f: done: 0.020484 sec","job_status":"done","queue_duration_s":0.688512,"scheduling_latency_s":0.688542,"redis_calls":10,"redis_duration_s":0.001199,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000193879,"duration_s":0.020484,"completed_at":"2026-07-25T07:16:46.611Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005535,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2002vm-test-run-nixbot-gitlab> gitlab # [ 184.837655] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.612Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1673313a56b4e8572c93a002","created_at":"2026-07-25T07:16:45.902Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.904Z","job_size_bytes":6,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1673313a56b4e8572c93a002: start","job_status":"start","queue_duration_s":0.707221,"scheduling_latency_s":0.707233}2003vm-test-run-nixbot-gitlab> gitlab # [ 184.851307] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.629Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1673313a56b4e8572c93a002","created_at":"2026-07-25T07:16:45.902Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.904Z","job_size_bytes":6,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1673313a56b4e8572c93a002: done: 0.017843 sec","job_status":"done","queue_duration_s":0.707221,"scheduling_latency_s":0.707233,"redis_calls":10,"redis_duration_s":0.00166,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000323,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000280483,"duration_s":0.017843,"completed_at":"2026-07-25T07:16:46.629Z","load_balancing_strategy":"primary","db_duration_s":0.002625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2004vm-test-run-nixbot-gitlab> gitlab # [ 184.906935] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.631Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"939af50c0dd58c0cca07943f","created_at":"2026-07-25T07:16:45.962Z","trace_propagation_headers":{"sentry-trace":"92102a43f3b44aba98d0489a84d577c8-1d0e637975cc4df9","baggage":"sentry-trace_id=92102a43f3b44aba98d0489a84d577c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24C9S12JME0968SNA4M8J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.968Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-939af50c0dd58c0cca07943f: start","job_status":"start","queue_duration_s":0.662964,"scheduling_latency_s":0.662978}2005vm-test-run-nixbot-gitlab> gitlab # [ 184.907539] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.732Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"939af50c0dd58c0cca07943f","created_at":"2026-07-25T07:16:45.962Z","trace_propagation_headers":{"sentry-trace":"92102a43f3b44aba98d0489a84d577c8-1d0e637975cc4df9","baggage":"sentry-trace_id=92102a43f3b44aba98d0489a84d577c8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24C9S12JME0968SNA4M8J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.968Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-939af50c0dd58c0cca07943f: done: 0.10172 sec","job_status":"done","queue_duration_s":0.662964,"scheduling_latency_s":0.662978,"gitaly_calls":3,"gitaly_duration_s":0.006824,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006547,"redis_read_bytes":98,"redis_write_bytes":6011,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000863,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.001696,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000248,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1130,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001402,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000211,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000397,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":31,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":31,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061674,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08550528,"duration_s":0.10172,"completed_at":"2026-07-25T07:16:46.732Z","load_balancing_strategy":"primary","db_duration_s":0.031122,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2006vm-test-run-nixbot-gitlab> gitlab # [ 184.970543] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.734Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"31fe5fe7472dd12095e896ad","created_at":"2026-07-25T07:16:45.972Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.973Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-31fe5fe7472dd12095e896ad: start","job_status":"start","queue_duration_s":0.76017,"scheduling_latency_s":0.760185}2007vm-test-run-nixbot-gitlab> gitlab # [ 184.971165] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.798Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"31fe5fe7472dd12095e896ad","created_at":"2026-07-25T07:16:45.972Z","trace_propagation_headers":{"sentry-trace":"908a4e47d5eb4ae9a24cdad891a315d3-b84c995008174643","baggage":"sentry-trace_id=908a4e47d5eb4ae9a24cdad891a315d3,sentry-release=Unknown"},"correlation_id":"01KYC24CA8YSP5QM1SP6RE7Y4V","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:45.973Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-31fe5fe7472dd12095e896ad: done: 0.064396 sec","job_status":"done","queue_duration_s":0.76017,"scheduling_latency_s":0.760185,"gitaly_calls":2,"gitaly_duration_s":0.005016,"redis_calls":19,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.002919,"redis_read_bytes":42,"redis_write_bytes":1891,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000597,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001082,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000246,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":20,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":20,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":9,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.047202089,"duration_s":0.064396,"completed_at":"2026-07-25T07:16:46.798Z","load_balancing_strategy":"primary","db_duration_s":0.017519,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2008vm-test-run-nixbot-gitlab> gitlab # [ 184.989656] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.799Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7cbd23ff1b2d58bc69cf5ab0","created_at":"2026-07-25T07:16:46.669Z","trace_propagation_headers":{"sentry-trace":"92102a43f3b44aba98d0489a84d577c8-e4900f266c0e4a52","baggage":"sentry-trace_id=92102a43f3b44aba98d0489a84d577c8,sentry-release=Unknown"},"correlation_id":"01KYC24C9S12JME0968SNA4M8J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:46.671Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7cbd23ff1b2d58bc69cf5ab0: start","job_status":"start","queue_duration_s":0.128413,"scheduling_latency_s":0.128428}2009vm-test-run-nixbot-gitlab> gitlab # [ 185.034658] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:46.816Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7cbd23ff1b2d58bc69cf5ab0","created_at":"2026-07-25T07:16:46.669Z","trace_propagation_headers":{"sentry-trace":"92102a43f3b44aba98d0489a84d577c8-e4900f266c0e4a52","baggage":"sentry-trace_id=92102a43f3b44aba98d0489a84d577c8,sentry-release=Unknown"},"correlation_id":"01KYC24C9S12JME0968SNA4M8J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:46.671Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7cbd23ff1b2d58bc69cf5ab0: done: 0.017551 sec","job_status":"done","queue_duration_s":0.128413,"scheduling_latency_s":0.128428,"redis_calls":7,"redis_duration_s":0.000872,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000229,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017551,"completed_at":"2026-07-25T07:16:46.816Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2010vm-test-run-nixbot-gitlab> gitlab # [ 185.037263] gitaly[1347]: time="2026-07-25T07:16:46.679Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T07:17:16.678" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:46.678" grpc.time_ms=0.866 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011vm-test-run-nixbot-gitlab> gitlab # [ 185.072648] gitaly[1347]: time="2026-07-25T07:16:46.704Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:16.703" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:46.703" grpc.time_ms=0.501 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012vm-test-run-nixbot-gitlab> gitlab # [ 185.073440] gitaly[1347]: time="2026-07-25T07:16:46.725Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24C9S12JME0968SNA4M8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:16.724" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:46.724" grpc.time_ms=0.598 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013vm-test-run-nixbot-gitlab> gitlab # [ 185.073984] gitaly[1347]: time="2026-07-25T07:16:46.762Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T07:17:16.761" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:46.761" grpc.time_ms=0.743 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014vm-test-run-nixbot-gitlab> gitlab # [ 185.076478] gitaly[1347]: time="2026-07-25T07:16:46.790Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24CA8YSP5QM1SP6RE7Y4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:16.788" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:46.789" grpc.time_ms=0.618 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses2016vm-test-run-nixbot-gitlab> gitlab # [ 185.485505] gitaly[1347]: time="2026-07-25T07:16:47.556Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24E86A4E16S2ENV193SWM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:17.054" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:47.555" grpc.time_ms=0.824 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2017vm-test-run-nixbot-gitlab> gitlab # [ 185.508613] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 842018vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses, in 0.15 seconds)2019vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses2020vm-test-run-nixbot-gitlab> gitlab # [ 186.610455] gitaly[1347]: time="2026-07-25T07:16:48.680Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24FBG7PF7QM773TJX28YM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:18.178" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:48.679" grpc.time_ms=0.821 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021vm-test-run-nixbot-gitlab> gitlab # [ 186.666100] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1112022vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses, in 0.16 seconds)2023vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses2024vm-test-run-nixbot-gitlab> gitlab # [ 187.806781] gitaly[1347]: time="2026-07-25T07:16:49.876Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24GFMT95BBCMH6EVA47ZX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:19.375" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:49.875" grpc.time_ms=0.932 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025vm-test-run-nixbot-gitlab> gitlab # [ 187.837977] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1262026vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses, in 0.17 seconds)2027vm-test-run-nixbot-gitlab> gitlab # [ 188.700740] nix-daemon[3250]: accepted connection from pid 3413, user nixbot2028vm-test-run-nixbot-gitlab> gitlab # [ 188.734189] gitaly[1347]: time="2026-07-25T07:16:50.804Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:20.603" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:50.804" grpc.time_ms=0.559 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029vm-test-run-nixbot-gitlab> gitlab # [ 188.789870] gitaly[1347]: time="2026-07-25T07:16:50.860Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:17:00.103" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:50.854" grpc.time_ms=6.147 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2030vm-test-run-nixbot-gitlab> gitlab # [ 188.833293] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:50.903Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4854b3ea3c83a91d5841f63a","created_at":"2026-07-25T07:16:50.899Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-0acf854974ee4b8a","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:50.901Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4854b3ea3c83a91d5841f63a: start","job_status":"start","queue_duration_s":0.001409,"scheduling_latency_s":0.001439}2031vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses2032vm-test-run-nixbot-gitlab> gitlab # [ 188.846800] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/547c2ff06a1e0719efc2952e979f436c7a881ba9 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 1442033vm-test-run-nixbot-gitlab> gitlab # [ 188.849305] nixbot[2969]: {"ts": "2026-07-25T07:16:50.912Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/547c2ff06a1e0719efc2952e979f436c7a881ba9 \"HTTP/1.1 201 Created\""}2034vm-test-run-nixbot-gitlab> gitlab # [ 188.875848] gitaly[1347]: time="2026-07-25T07:16:50.946Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24HK2CH4YEPRRA1T0A0WQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:20.745" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:50.945" grpc.time_ms=0.444 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035vm-test-run-nixbot-gitlab> gitlab # [ 188.903693] gitaly[1347]: time="2026-07-25T07:16:50.974Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24HK2CH4YEPRRA1T0A0WQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-07-25T07:17:00.216" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:50.966" grpc.time_ms=7.416 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2036vm-test-run-nixbot-gitlab> gitlab # [ 188.914744] gitaly[1347]: time="2026-07-25T07:16:50.982Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24HKQABYYCY71PZ02ND2H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:20.081" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:50.982" grpc.time_ms=0.325 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037vm-test-run-nixbot-gitlab> gitlab # [ 188.926752] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses HTTP/1.1" 200 671 "" "curl/8.20.0" 612038vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses, in 0.09 seconds)2039vm-test-run-nixbot-gitlab> gitlab # [ 188.944670] gitlab-workhorse[1281]: gitlab 2001:db8:1::1 - - [2026/07/25:07:16:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/547c2ff06a1e0719efc2952e979f436c7a881ba9 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1002040vm-test-run-nixbot-gitlab> gitlab # [ 188.949103] nixbot[2969]: {"ts": "2026-07-25T07:16:51.018Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/547c2ff06a1e0719efc2952e979f436c7a881ba9 \"HTTP/1.1 201 Created\""}2041vm-test-run-nixbot-gitlab> gitlab # [ 188.973661] gitaly[1347]: time="2026-07-25T07:16:51.044Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:51.043" grpc.time_ms=0.289 pid=1347 span.kind=server system=grpc2042vm-test-run-nixbot-gitlab> gitlab # [ 189.007268] gitaly[1347]: time="2026-07-25T07:16:51.077Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3900 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:51.077" grpc.time_ms=0.276 pid=1347 span.kind=server system=grpc2043vm-test-run-nixbot-gitlab> gitlab # [ 189.033954] gitaly[1347]: time="2026-07-25T07:16:51.104Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3902 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-07-25T07:16:51.104" grpc.time_ms=0.353 pid=1347 span.kind=server system=grpc2044vm-test-run-nixbot-gitlab> gitlab # [ 189.049556] gitaly[1347]: time="2026-07-25T07:16:51.120Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P diskcache=bf97e99b-2df2-4631-bf4e-38f089512f22 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T07:17:21.017" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:51.017" pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045vm-test-run-nixbot-gitlab> gitlab # [ 189.057631] gitaly[1347]: time="2026-07-25T07:16:51.128Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=94 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7583 command.oublock=0 command.real_time_ms=95 command.spawn_token_fork_ms=1 command.system_time_ms=60 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-07-25T07:17:21.017" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-07-25T07:16:51.017" grpc.time_ms=102.749 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046vm-test-run-nixbot-gitlab> gitlab # [ 189.086293] gitaly[1347]: time="2026-07-25T07:16:51.156Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T07:17:21.156" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:51.156" grpc.time_ms=0.627 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047vm-test-run-nixbot-gitlab> gitlab # [ 189.102494] gitaly[1347]: time="2026-07-25T07:16:51.173Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:21.172" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:51.172" grpc.time_ms=0.477 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048vm-test-run-nixbot-gitlab> gitlab # [ 189.140135] gitaly[1347]: time="2026-07-25T07:16:51.210Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:21.209" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:51.210" grpc.time_ms=0.41 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049vm-test-run-nixbot-gitlab> gitlab # [ 189.157175] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.227Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a56d670d10900d4c6a428fe1","created_at":"2026-07-25T07:16:51.226Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"4854b3ea3c83a91d5841f63a","job_size_bytes":3,"pid":2039,"job_status":"deduplicated","message":"PipelineProcessWorker JID-a56d670d10900d4c6a428fe1: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2050vm-test-run-nixbot-gitlab> gitlab # [ 189.170604] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.241Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4854b3ea3c83a91d5841f63a","created_at":"2026-07-25T07:16:50.899Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-0acf854974ee4b8a","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:50.901Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2039,"job_status":"rescheduled","message":"PipelineProcessWorker JID-4854b3ea3c83a91d5841f63a: rescheduled"}2051vm-test-run-nixbot-gitlab> gitlab # [ 189.189715] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.259Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"4854b3ea3c83a91d5841f63a","created_at":"2026-07-25T07:16:50.899Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-0acf854974ee4b8a","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:50.901Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4854b3ea3c83a91d5841f63a: done: 0.356327 sec","job_status":"done","queue_duration_s":0.001409,"scheduling_latency_s":0.001439,"gitaly_calls":4,"gitaly_duration_s":0.128451,"redis_calls":93,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.050102999999999995,"redis_read_bytes":262,"redis_write_bytes":23387,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.003561,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002734,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000728,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":712,"redis_queues_calls":25,"redis_queues_duration_s":0.002592,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14468,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.030839,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.004356,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000499,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":38,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":38,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":23,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.036,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106591,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.288906551,"duration_s":0.356327,"completed_at":"2026-07-25T07:16:51.259Z","load_balancing_strategy":"primary","db_duration_s":0.086046,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2052vm-test-run-nixbot-gitlab> gitlab # [ 189.236080] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.306Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d7c626df22acbda7cd756612","created_at":"2026-07-25T07:16:51.008Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.011Z","job_size_bytes":23,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d7c626df22acbda7cd756612: start","job_status":"start","queue_duration_s":0.294355,"scheduling_latency_s":0.294393}2053vm-test-run-nixbot-gitlab> gitlab # [ 189.298216] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.368Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d7c626df22acbda7cd756612","created_at":"2026-07-25T07:16:51.008Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.011Z","job_size_bytes":23,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d7c626df22acbda7cd756612: done: 0.062089 sec","job_status":"done","queue_duration_s":0.294355,"scheduling_latency_s":0.294393,"redis_calls":7,"redis_duration_s":0.001667,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062089,"completed_at":"2026-07-25T07:16:51.368Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008659,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2054vm-test-run-nixbot-gitlab> gitlab # [ 189.339385] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.409Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3861f3a023f7bafa21015ac5","created_at":"2026-07-25T07:16:51.132Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.134Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3861f3a023f7bafa21015ac5: start","job_status":"start","queue_duration_s":0.275174,"scheduling_latency_s":0.275217}2055vm-test-run-nixbot-gitlab> gitlab # [ 189.380525] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.450Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3861f3a023f7bafa21015ac5","created_at":"2026-07-25T07:16:51.132Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.134Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3861f3a023f7bafa21015ac5: done: 0.040997 sec","job_status":"done","queue_duration_s":0.275174,"scheduling_latency_s":0.275217,"redis_calls":7,"redis_duration_s":0.001912,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001367,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000545,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040997,"completed_at":"2026-07-25T07:16:51.450Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2056vm-test-run-nixbot-gitlab> gitlab # [ 189.382522] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.452Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"32f73c031d452f6faee86318","created_at":"2026-07-25T07:16:51.139Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.140Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-32f73c031d452f6faee86318: start","job_status":"start","queue_duration_s":0.31229,"scheduling_latency_s":0.312323}2057vm-test-run-nixbot-gitlab> gitlab # [ 189.443973] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.514Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"32f73c031d452f6faee86318","created_at":"2026-07-25T07:16:51.139Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.140Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-32f73c031d452f6faee86318: done: 0.061247 sec","job_status":"done","queue_duration_s":0.31229,"scheduling_latency_s":0.312323,"redis_calls":7,"redis_duration_s":0.002699,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061247,"completed_at":"2026-07-25T07:16:51.513Z","load_balancing_strategy":"primary","db_duration_s":0.030385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2058vm-test-run-nixbot-gitlab> gitlab # [ 189.445994] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.516Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"2a93bebdd252a60d63a7d2ba","created_at":"2026-07-25T07:16:51.145Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.146Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2a93bebdd252a60d63a7d2ba: start","job_status":"start","queue_duration_s":0.370155,"scheduling_latency_s":0.37019}2059vm-test-run-nixbot-gitlab> gitlab # [ 189.477550] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.547Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"2a93bebdd252a60d63a7d2ba","created_at":"2026-07-25T07:16:51.145Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.146Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2a93bebdd252a60d63a7d2ba: done: 0.031613 sec","job_status":"done","queue_duration_s":0.370155,"scheduling_latency_s":0.37019,"redis_calls":10,"redis_duration_s":0.002787,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000777,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031613,"completed_at":"2026-07-25T07:16:51.547Z","load_balancing_strategy":"primary","db_duration_s":0.004521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2060vm-test-run-nixbot-gitlab> gitlab # [ 189.491753] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"11615968d8d14b6414a5b1cb","created_at":"2026-07-25T07:16:51.146Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.147Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-11615968d8d14b6414a5b1cb: start","job_status":"start","queue_duration_s":0.401501,"scheduling_latency_s":0.401515}2061vm-test-run-nixbot-gitlab> gitlab # [ 189.548181] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"11615968d8d14b6414a5b1cb","created_at":"2026-07-25T07:16:51.146Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.147Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-11615968d8d14b6414a5b1cb: done: 0.069243 sec","job_status":"done","queue_duration_s":0.401501,"scheduling_latency_s":0.401515,"redis_calls":7,"redis_duration_s":0.001578,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069243,"completed_at":"2026-07-25T07:16:51.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056651,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2062vm-test-run-nixbot-gitlab> gitlab # [ 189.549894] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.619Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f432ac38bf5aa6d1f688801b","created_at":"2026-07-25T07:16:51.147Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.149Z","job_size_bytes":19,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f432ac38bf5aa6d1f688801b: start","job_status":"start","queue_duration_s":0.470415,"scheduling_latency_s":0.470434}2063vm-test-run-nixbot-gitlab> gitlab # [ 189.577781] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f432ac38bf5aa6d1f688801b","created_at":"2026-07-25T07:16:51.147Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.149Z","job_size_bytes":19,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f432ac38bf5aa6d1f688801b: done: 0.028118 sec","job_status":"done","queue_duration_s":0.470415,"scheduling_latency_s":0.470434,"redis_calls":8,"redis_duration_s":0.002636,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001828,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000808,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028118,"completed_at":"2026-07-25T07:16:51.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004836,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2064vm-test-run-nixbot-gitlab> gitlab # [ 189.596741] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.649Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"feb06d05028b19033e005168","created_at":"2026-07-25T07:16:51.149Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.150Z","job_size_bytes":66,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-feb06d05028b19033e005168: start","job_status":"start","queue_duration_s":0.498917,"scheduling_latency_s":0.498956}2065vm-test-run-nixbot-gitlab> gitlab # [ 189.611109] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.671Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"feb06d05028b19033e005168","created_at":"2026-07-25T07:16:51.149Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.150Z","job_size_bytes":66,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-feb06d05028b19033e005168: done: 0.022015 sec","job_status":"done","queue_duration_s":0.498917,"scheduling_latency_s":0.498956,"redis_calls":7,"redis_duration_s":0.001604,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022015,"completed_at":"2026-07-25T07:16:51.671Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2066vm-test-run-nixbot-gitlab> gitlab # [ 189.646812] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.673Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"5e74857365d6101c810ae21b","created_at":"2026-07-25T07:16:51.151Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.152Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5e74857365d6101c810ae21b: start","job_status":"start","queue_duration_s":0.521105,"scheduling_latency_s":0.521137}2067vm-test-run-nixbot-gitlab> gitlab # [ 189.682235] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.701Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"5e74857365d6101c810ae21b","created_at":"2026-07-25T07:16:51.151Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.152Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-5e74857365d6101c810ae21b: done: 0.02855 sec","job_status":"done","queue_duration_s":0.521105,"scheduling_latency_s":0.521137,"redis_calls":7,"redis_duration_s":0.001226,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000326,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02855,"completed_at":"2026-07-25T07:16:51.701Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2068vm-test-run-nixbot-gitlab> gitlab # [ 189.725957] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.702Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"aee94922267988dd07865b93","created_at":"2026-07-25T07:16:51.185Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.186Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-aee94922267988dd07865b93: start","job_status":"start","queue_duration_s":0.51582,"scheduling_latency_s":0.515834}2069vm-test-run-nixbot-gitlab> gitlab # [ 189.726549] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.715Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"aee94922267988dd07865b93","created_at":"2026-07-25T07:16:51.185Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.186Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-aee94922267988dd07865b93: done: 0.012875 sec","job_status":"done","queue_duration_s":0.51582,"scheduling_latency_s":0.515834,"redis_calls":7,"redis_duration_s":0.000928,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012875,"completed_at":"2026-07-25T07:16:51.715Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2070vm-test-run-nixbot-gitlab> gitlab # [ 189.770722] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.716Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9eb3a9e19d511db24d6de769","created_at":"2026-07-25T07:16:51.187Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.188Z","job_size_bytes":6,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9eb3a9e19d511db24d6de769: start","job_status":"start","queue_duration_s":0.528249,"scheduling_latency_s":0.528261}2071vm-test-run-nixbot-gitlab> gitlab # [ 189.771436] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.724Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"9eb3a9e19d511db24d6de769","created_at":"2026-07-25T07:16:51.187Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.188Z","job_size_bytes":6,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-9eb3a9e19d511db24d6de769: done: 0.007835 sec","job_status":"done","queue_duration_s":0.528249,"scheduling_latency_s":0.528261,"redis_calls":7,"redis_duration_s":0.000841,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000226,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.007835,"completed_at":"2026-07-25T07:16:51.724Z","load_balancing_strategy":"primary","db_duration_s":0.000225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2072vm-test-run-nixbot-gitlab> gitlab # [ 189.806821] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.725Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"5390a7ff309a154f215a3dfe","created_at":"2026-07-25T07:16:51.188Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.190Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5390a7ff309a154f215a3dfe: start","job_status":"start","queue_duration_s":0.534122,"scheduling_latency_s":0.534134}2073vm-test-run-nixbot-gitlab> gitlab # [ 189.807469] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.745Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"5390a7ff309a154f215a3dfe","created_at":"2026-07-25T07:16:51.188Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.190Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5390a7ff309a154f215a3dfe: done: 0.020205 sec","job_status":"done","queue_duration_s":0.534122,"scheduling_latency_s":0.534134,"redis_calls":10,"redis_duration_s":0.001297,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000206171,"duration_s":0.020205,"completed_at":"2026-07-25T07:16:51.745Z","load_balancing_strategy":"primary","db_duration_s":0.005509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2074vm-test-run-nixbot-gitlab> gitlab # [ 189.844262] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.746Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"c956f27d3bbe6b6431693182","created_at":"2026-07-25T07:16:51.241Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.254Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c956f27d3bbe6b6431693182: start","job_status":"start","queue_duration_s":0.491666,"scheduling_latency_s":0.491679}2075vm-test-run-nixbot-gitlab> gitlab # [ 189.844993] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.861Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"c956f27d3bbe6b6431693182","created_at":"2026-07-25T07:16:51.241Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-a5ab34ecbfe647a6","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.254Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c956f27d3bbe6b6431693182: done: 0.115036 sec","job_status":"done","queue_duration_s":0.491666,"scheduling_latency_s":0.491679,"gitaly_calls":3,"gitaly_duration_s":0.009201,"redis_calls":44,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006092,"redis_read_bytes":98,"redis_write_bytes":6013,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000581,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.002283,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_queues_calls":2,"redis_queues_duration_s":0.000172,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000135,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000389,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000741,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":20,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085011,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.098780153,"duration_s":0.115036,"completed_at":"2026-07-25T07:16:51.861Z","load_balancing_strategy":"primary","db_duration_s":0.022794,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2076vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/547c2ff06a1e0719efc2952e979f436c7a881ba9/statuses2077vm-test-run-nixbot-gitlab> gitlab # [ 189.884860] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.862Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7b9ddc2179eae6fbd2f29140","created_at":"2026-07-25T07:16:51.778Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-5c9a54dc1d934836","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.779Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7b9ddc2179eae6fbd2f29140: start","job_status":"start","queue_duration_s":0.082624,"scheduling_latency_s":0.082638}2078vm-test-run-nixbot-gitlab> gitlab # [ 189.929673] sidekiq-cluster[2039]: {"severity":"INFO","time":"2026-07-25T07:16:51.888Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"7b9ddc2179eae6fbd2f29140","created_at":"2026-07-25T07:16:51.778Z","trace_propagation_headers":{"sentry-trace":"c7e6b799accc4685a2dcecd9d9e49619-5c9a54dc1d934836","baggage":"sentry-trace_id=c7e6b799accc4685a2dcecd9d9e49619,sentry-release=Unknown"},"correlation_id":"01KYC24HEEB4S8166ZCBD7V31P","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-07-25T07:16:51.779Z","job_size_bytes":3,"pid":2039,"sidekiq_tid":"m82j","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-7b9ddc2179eae6fbd2f29140: done: 0.025691 sec","job_status":"done","queue_duration_s":0.082624,"scheduling_latency_s":0.082638,"redis_calls":7,"redis_duration_s":0.001811,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001328,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025691,"completed_at":"2026-07-25T07:16:51.887Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2079vm-test-run-nixbot-gitlab> gitlab # [ 189.931405] gitaly[1347]: time="2026-07-25T07:16:51.786Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-07-25T07:17:21.785" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:51.785" grpc.time_ms=0.826 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2080vm-test-run-nixbot-gitlab> gitlab # [ 189.941141] gitaly[1347]: time="2026-07-25T07:16:51.821Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:21.820" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:51.820" grpc.time_ms=0.659 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081vm-test-run-nixbot-gitlab> gitlab # [ 189.976532] gitaly[1347]: time="2026-07-25T07:16:51.850Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KYC24HEEB4S8166ZCBD7V31P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-07-25T07:17:21.848" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-07-25T07:16:51.849" grpc.time_ms=0.717 pid=1347 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root