tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.UYrJDQaV23', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 5468f848-d6f9-4b30-b8b0-f1a59cd06b24 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-28T16:05:15Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-28T16:05:15Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-28T16:05:15Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-28T16:05:15Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-28T16:05:15Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-28T16:05:15Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-28T16:05:15Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-28T16:05:15Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-28T16:05:15Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-28T16:05:15Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-28T16:05:15Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-28T16:05:15Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6qrdm3x86a7a5p8xmsl70g9p0ma2d05i-nixos-system-machine-test/init regInfo=/nix/store/3b43mc338yalrdg4m76f7ml9dcm1zd2i-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 494974888 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000810] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000878] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002728] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002739] Using GB pages for direct mapping machine # [ 0.002855] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002862] ACPI: Early table checksum verification disabled machine # [ 0.002865] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002869] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002873] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002880] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002882] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002883] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002885] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002886] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002888] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002889] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002890] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002891] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002891] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002892] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002892] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002893] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003115] No NUMA configuration found machine # [ 0.003116] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003119] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005331] Zone ranges: machine # [ 0.005332] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005333] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005334] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005335] Device empty machine # [ 0.005336] Movable zone start for each node machine # [ 0.005337] Early memory node ranges machine # [ 0.005337] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005338] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005339] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005340] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005359] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005610] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.073036] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.073522] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.073537] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.073572] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.073575] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.073576] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.073578] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.073579] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.073580] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.073582] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.073583] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.073588] TSC deadline timer available machine # [ 0.073592] CPU topo: Max. logical packages: 1 machine # [ 0.073593] CPU topo: Max. logical dies: 1 machine # [ 0.073593] CPU topo: Max. dies per package: 1 machine # [ 0.073597] CPU topo: Max. threads per core: 1 machine # [ 0.073597] CPU topo: Num. cores per package: 4 machine # [ 0.073598] CPU topo: Num. threads per package: 4 machine # [ 0.073598] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.073622] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.073644] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.073647] kvm-guest: setup PV sched yield machine # [ 0.073657] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.073658] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.073659] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.073661] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.073663] Booting paravirtualized kernel on KVM machine # [ 0.073666] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.078142] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.080216] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.080268] kvm-guest: PV spinlocks enabled machine # [ 0.080269] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.080272] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6qrdm3x86a7a5p8xmsl70g9p0ma2d05i-nixos-system-machine-test/init regInfo=/nix/store/3b43mc338yalrdg4m76f7ml9dcm1zd2i-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.080369] Unknown kernel command line parameters "regInfo=/nix/store/3b43mc338yalrdg4m76f7ml9dcm1zd2i-closure-info/registration", will be passed to user space. machine # [ 0.080382] random: crng init done machine # [ 0.080382] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.084564] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.086580] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.086659] software IO TLB: area num 4. machine # [ 0.155899] Fallback order for Node 0: 0 machine # [ 0.155906] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.155908] Policy zone: Normal machine # [ 0.158430] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.165127] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.173662] allocated 8388608 bytes of page_ext machine # [ 0.183248] ftrace: allocating 48787 entries in 192 pages machine # [ 0.183250] ftrace: allocated 192 pages with 2 groups machine # [ 0.184115] Dynamic Preempt: lazy machine # [ 0.184285] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.184286] rcu: RCU event tracing is enabled. machine # [ 0.184286] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.184288] Trampoline variant of Tasks RCU enabled. machine # [ 0.184288] Rude variant of Tasks RCU enabled. machine # [ 0.184288] Tracing variant of Tasks RCU enabled. machine # [ 0.184289] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.184290] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.184309] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.184310] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.184311] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.188702] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.189020] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.189030] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.189142] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.192762] Console: colour VGA+ 80x25 machine # [ 0.192765] printk: legacy console [tty0] enabled machine # [ 0.224406] printk: legacy console [ttyS0] enabled machine # [ 0.337000] ACPI: Core revision 20250807 machine # [ 0.337927] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.339597] APIC: Switch to symmetric I/O mode setup machine # [ 0.340695] x2apic enabled machine # [ 0.341444] APIC: Switched APIC routing to: physical x2apic machine # [ 0.342397] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.343743] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.345268] kvm-guest: setup PV IPIs machine # [ 0.346908] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.347986] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.352380] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.354465] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.355510] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.356377] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.357381] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.359377] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.360378] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.361376] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.362376] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.363377] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.364384] Spectre V2 : Enabling IBPB for BPF machine # [ 0.365966] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.367377] active return thunk: srso_alias_return_thunk machine # [ 0.368397] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.369377] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.370377] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.371377] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.372377] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.374196] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.375377] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.376377] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.377377] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.378377] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.379377] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.380376] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.381377] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.411548] Freeing SMP alternatives memory: 44K machine # [ 0.412380] pid_max: default: 32768 minimum: 301 machine # [ 0.413270] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.414474] landlock: Up and running. machine # [ 0.415130] Yama: becoming mindful. machine # [ 0.416054] LSM support for eBPF active machine # [ 0.416504] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.418416] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.420958] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.421884] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.422382] ... version: 2 machine # [ 0.423164] ... bit width: 48 machine # [ 0.423379] ... generic counters: 6 machine # [ 0.424180] ... generic bitmap: 000000000000003f machine # [ 0.425196] ... fixed-purpose counters: 0 machine # [ 0.425993] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.426379] ... value mask: 0000ffffffffffff machine # [ 0.427305] ... max period: 00007fffffffffff machine # [ 0.428103] ... global_ctrl mask: 000000000000003f machine # [ 0.428505] signal: max sigframe size: 3376 machine # [ 0.429305] rcu: Hierarchical SRCU implementation. machine # [ 0.430005] rcu: Max phase no-delay instances is 400. machine # [ 0.430597] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.435924] smp: Bringing up secondary CPUs ... machine # [ 0.436796] smpboot: x86: Booting SMP configuration: machine # [ 0.437388] .... node #0, CPUs: #1 #2 #3 machine # [ 0.441457] smp: Brought up 1 node, 4 CPUs machine # [ 0.442902] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.443745] Memory: 3957816K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved) machine # [ 0.445379] devtmpfs: initialized machine # [ 0.446529] x86/mm: Memory block size: 128MB machine # [ 0.449455] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.450459] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.451477] pinctrl core: initialized pinctrl subsystem machine # [ 0.452655] PM: RTC time: 16:05:15, date: 2026-09-28 machine # [ 0.456436] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.458184] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.459363] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.460907] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.461390] audit: initializing netlink subsys (disabled) machine # [ 0.462405] audit: type=2000 audit(1790611515.974:1): state=initialized audit_enabled=0 res=1 machine # [ 0.462637] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.464380] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.465380] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.466379] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.467379] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.468393] cpuidle: using governor menu machine # [ 0.470631] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.471607] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.472383] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.473393] PCI: Using configuration type 1 for base access machine # [ 0.474535] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.478437] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.479380] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.480380] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.481380] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.486529] ACPI: Added _OSI(Module Device) machine # [ 0.488388] ACPI: Added _OSI(Processor Device) machine # [ 0.490389] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.499176] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.506690] ACPI: Interpreter enabled machine # [ 0.507444] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.508222] ACPI: Using IOAPIC for interrupt routing machine # [ 0.509128] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.510390] PCI: Using E820 reservations for host bridge windows machine # [ 0.513249] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.526769] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.529453] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.533643] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.536711] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.540732] PCI host bridge to bus 0000:00 machine # [ 0.542398] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.545387] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.547384] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.550385] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.552384] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.555384] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.557385] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.559855] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.563330] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.577613] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.580418] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.583442] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.585944] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.591682] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.602427] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.605404] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.607491] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.611400] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.614747] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.623426] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.625404] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.627427] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.631835] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.639423] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.642404] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.643426] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.647473] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.652650] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.654389] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.655405] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.657409] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.660981] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.670438] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.673444] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.679108] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.685439] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.688446] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.690190] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.694429] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.706218] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.708074] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.711428] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.713402] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.714967] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.720458] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.721387] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.722403] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.724981] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.728366] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.729233] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.730163] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.732003] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.734156] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.735676] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.738119] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.739639] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.741710] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.742603] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.745151] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.746612] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.748670] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.749681] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.752947] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.753386] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.754880] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.759066] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.767474] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.769620] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.771491] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.773489] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.774541] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.775507] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.776482] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.777486] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.779419] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.780398] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.781404] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.782402] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.783397] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.784395] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.785399] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.786395] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.789903] iommu: Default domain type: Translated machine # [ 0.790380] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.792671] ACPI: bus type USB registered machine # [ 0.793454] usbcore: registered new interface driver usbfs machine # [ 0.794455] usbcore: registered new interface driver hub machine # [ 0.795395] usbcore: registered new device driver usb machine # [ 0.797932] NetLabel: Initializing machine # [ 0.798380] NetLabel: domain hash size = 128 machine # [ 0.799218] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.800248] NetLabel: unlabeled traffic allowed by default machine # [ 0.801186] PCI: Using ACPI for IRQ routing machine # [ 0.845644] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.846376] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.846376] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.851403] vgaarb: loaded machine # [ 0.852995] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.855385] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.862955] clocksource: Switched to clocksource kvm-clock machine # [ 0.867115] VFS: Disk quotas dquot_6.6.0 machine # [ 0.868985] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.872551] pnp: PnP ACPI init machine # [ 0.874625] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.877105] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.881104] pnp: PnP ACPI: found 5 devices machine # [ 0.893825] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.897692] clocksource: Switched to clocksource acpi_pm machine # [ 0.900412] NET: Registered PF_INET protocol family machine # [ 0.904091] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.941115] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.942713] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.944231] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.945804] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.947187] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.948599] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.950317] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.951668] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.953068] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.954106] NET: Registered PF_XDP protocol family machine # [ 0.955038] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.956140] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.957221] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.958415] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.959598] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.960823] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.962888] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.965114] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.967260] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.969386] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.971164] PCI: CLS 0 bytes, default 64 machine # [ 0.972074] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.972505] Trying to unpack rootfs image as initramfs... machine # [ 0.973237] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.976134] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.997314] Initialise system trusted keyrings machine # [ 0.998598] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.010382] Key type asymmetric registered machine # [ 1.011159] Asymmetric key parser 'x509' registered machine # [ 1.012154] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.013979] io scheduler mq-deadline registered machine # [ 1.014833] io scheduler kyber registered machine # [ 1.019153] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.020588] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.023071] Linux agpgart interface v0.103 machine # [ 1.023903] ACPI: bus type drm_connector registered machine # [ 1.027238] usbcore: registered new interface driver usbserial_generic machine # [ 1.028420] usbserial: USB Serial support registered for generic machine # [ 1.029496] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.029496] Please enable it if your BIOS has the CPPC option. machine # [ 1.031880] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.033403] drop_monitor: Initializing network drop monitor service machine # [ 1.034669] NET: Registered PF_INET6 protocol family machine # [ 1.036606] Segment Routing with IPv6 machine # [ 1.037324] In-situ OAM (IOAM) with IPv6 machine # [ 1.040239] IPI shorthand broadcast: enabled machine # [ 1.051668] sched_clock: Marking stable (897033027, 154346613)->(1074341888, -22962248) machine # [ 1.056457] registered taskstats version 1 machine # [ 1.059130] Loading compiled-in X.509 certificates machine # [ 1.082662] Demotion targets for Node 0: null machine # [ 1.084640] Key type .fscrypt registered machine # [ 1.086048] Key type fscrypt-provisioning registered machine # [ 1.087991] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.089883] ima: Allocated hash algorithm: sha1 machine # [ 1.091452] ima: No architecture policies found machine # [ 1.093525] PM: Magic number: 10:334:86 machine # [ 1.096653] RAS: Correctable Errors collector initialized. machine # [ 1.105033] clk: Disabling unused clocks machine # [ 1.105808] PM: genpd: Disabling unused power domains machine # [ 1.252101] Freeing initrd memory: 29052K machine # [ 1.259525] Freeing unused decrypted memory: 2028K machine # [ 1.265852] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.268599] Write protecting the kernel read-only data: 32768k machine # [ 1.273461] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.277199] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.345520] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.346767] Run /init as init process machine # [ 1.360847] systemd[1]: Inserted module 'autofs4' machine # [ 1.387289] fuse: init (API version 7.45) machine # [ 1.396791] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.399310] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.402590] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.404835] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.410205] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.411875] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.418843] virtiofs virtio6: discovered new tag: shared machine # [ 1.432017] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.435690] virtiofs virtio7: discovered new tag: xchg machine # [ 1.437149] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.472512] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.808415] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.816473] systemd[1]: Detected virtualization kvm. machine # [ 1.818632] systemd[1]: Detected architecture x86-64. machine # [ 1.820832] systemd[1]: Running in initrd. machine # [ 1.823335] systemd[1]: Initializing machine ID from random generator. machine # [ 1.826477] systemd[1]: Hostname set to . machine # [ 1.950864] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.015567] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.025277] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.027715] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.030511] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.032654] systemd[1]: Reached target Path Units. machine # [ 2.034391] systemd[1]: Reached target Slice Units. machine # [ 2.036123] systemd[1]: Reached target Swaps. machine # [ 2.037794] systemd[1]: Reached target Timer Units. machine # [ 2.039714] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.042109] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.044106] systemd[1]: Listening on Journal Sockets. machine # [ 2.045162] systemd[1]: Listening on udev Control Socket. machine # [ 2.046246] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.047275] systemd[1]: Reached target Socket Units. machine # [ 2.049579] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.051876] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.055019] systemd[1]: Starting Journal Service... machine # [ 2.058132] systemd[1]: Starting Load Kernel Modules... machine # [ 2.060959] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.073559] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.088076] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.094495] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.099255] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.102591] systemd-journald[92]: Collecting audit messages is disabled. machine # [ 2.103080] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.110183] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.112588] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.114198] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.117145] systemd[1]: Finished Load Kernel Modules. machine # [ 2.125441] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.132079] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.135441] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.139251] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.147724] systemd[1]: Started Journal Service. machine # [ 1.993495] systemd-modules-load[93]: Using 4 probe threads machine # [ 1.995966] systemd-modules-load[93]: Inserted module 'virtio_balloon' machine # [ 1.997147] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 1.999167] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 2.001322] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.004131] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.005277] systemd[1]: Reached target Local File Systems. machine # [ 2.006773] systemd[1]: Starting Create System Files and Directories... machine # [ 2.008940] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.027748] systemd[1]: Finished Create System Files and Directories. machine # [ 2.036088] systemd-udevd[111]: Using default interface naming scheme 'v261'. machine # [ 2.046753] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.053683] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.054602] systemd[1]: Reached target System Initialization. machine # [ 2.055434] systemd[1]: Reached target Basic System. machine # [ 2.304261] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.307245] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.308818] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.311107] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.314966] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.342332] SCSI subsystem initialized machine # [ 2.354890] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.355798] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.357227] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.208361] (udev-worker)[140]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.365092] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.366241] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.367896] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.215265] systemd[1]: Starting Virtual Console Setup... machine # [ 2.371375] usb usb1: Product: EHCI Host Controller machine # [ 2.372199] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.373318] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.220179] (udev-worker)[137]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.[ 2.377719] hub 1-0:1.0: USB hub found machine # machine # [ 2.380390] hub 1-0:1.0: 6 ports detected machine # [ 2.226241] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.382576] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.385721] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.386954] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.389578] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.235687] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.237353] s[ 2.391381] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # ystemd[1]: Reached target Initrd Root Device. machine # [ 2.392872] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.394645] usb usb2: Product: UHCI Host Controller machine # [ 2.394648] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.394650] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 2.394836] hub 2-0:1.0: USB hub found machine # [ 2.394846] hub 2-0:1.0: 2 ports detected machine # [ 2.395027] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.239591] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.397939] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.397953] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.397972] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.400551] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.408583] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.410391] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.411920] usb usb3: Product: UHCI Host Controller machine # [ 2.412998] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.414330] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.260338] systemd-vconsole-setup[145]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.415640] hub 3-0:1.0: USB hub found machine # [ 2.417847] hub 3-0:1.0: 2 ports detected machine # [ 2.417911] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.419986] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.265878] systemd[1]: Finished Virtual Console Setup. machine # [ 2.421004] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.421529] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.424188] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.271511] systemd-fsck[151]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.426089] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.429024] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.429271] scsi host0: ahci machine # [ 2.276677] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.430773] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.431703] scsi host1: ahci machine # [ 2.432255] scsi host2: ahci machine # [ 2.432535] scsi host3: ahci machine # [ 2.433457] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.434138] scsi host4: ahci machine # [ 2.434315] usb usb4: Product: UHCI Host Controller machine # [ 2.435872] scsi host5: ahci machine # [ 2.435993] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.436386] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.436471] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.436682] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.437295] hub 4-0:1.0: USB hub found machine # [ 2.438203] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.439003] hub 4-0:1.0: 2 ports detected machine # [ 2.439304] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.447234] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.448573] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.623574] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.754955] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.758035] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.760823] usb 1-1: Product: QEMU USB Tablet machine # [ 2.762487] usb 1-1: Manufacturer: QEMU machine # [ 2.764017] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.766857] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.769410] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.772055] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.774830] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.777143] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.779326] ata3.00: applying bridge limits machine # [ 2.781270] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.783827] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.786162] ata3.00: configured for UDMA/100 machine # [ 2.788789] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.804103] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.827489] usbcore: registered new interface driver usbhid machine # [ 2.829237] usbhid: USB HID core driver machine # [ 2.838992] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.842551] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.859048] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.889777] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.928939] systemd[1]: Mounting /sysroot... machine # [ 3.228770] EXT4-fs (vda): mounted filesystem 5468f848-d6f9-4b30-b8b0-f1a59cd06b24 r/w with ordered data mode. Quota mode: none. machine # [ 3.080909] systemd[1]: Mounted /sysroot. machine # [ 3.082821] systemd[1]: Reached target Initrd Root File System. machine # [ 3.085185] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.087320] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.089364] systemd[1]: Mounting /sysroot/run... machine # [ 3.091169] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.099379] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.104388] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.109513] systemd-sysroot-fstab-check[196]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.111964] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.113532] systemd[1]: Mounted /sysroot/run. machine # [ 3.114883] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.117100] systemd[1]: Reload requested from client PID 196 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.120126] systemd[1]: Reloading... machine # [ 3.173078] systemd[1]: Reloading finished in 55 ms. machine # [ 3.205540] systemd-sysroot-fstab-check[196]: Requesting initrd-fs.target/start/replace... machine # [ 3.208497] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.210400] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.212244] systemd-sysroot-fstab-check[196]: Requesting swap.target/start/replace... machine # [ 3.214757] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.216811] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.219261] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.221572] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.225368] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.227809] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.929793] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.982260] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.984488] systemd[1]: Reached target Initrd File Systems. machine # [ 3.986724] systemd[1]: Starting Find NixOS closure... machine # [ 3.988881] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 4.017428] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 4.021462] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 4.029502] systemd[1]: Finished Find NixOS closure. machine # [ 4.031302] systemd[1]: Reached target Initrd Default Target. machine # [ 4.033282] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.063811] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.065876] systemd[1]: Stopped target Basic System. machine # [ 4.067670] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.069513] systemd[1]: Stopped target Path Units. machine # [ 4.071215] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.073688] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.076646] systemd[1]: Stopped target Slice Units. machine # [ 4.078815] systemd[1]: Stopped target Socket Units. machine # [ 4.081787] systemd[1]: Stopped target System Initialization. machine # [ 4.086090] systemd[1]: Stopped target Swaps. machine # [ 4.089710] systemd[1]: Stopped target Timer Units. machine # [ 4.091420] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.093478] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.095438] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.097899] systemd[1]: Stopped Find NixOS closure. machine # [ 4.099599] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.101569] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.103698] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.105323] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.107263] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.108730] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.110790] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.112831] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.114747] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.116387] systemd[1]: Stopped target Local File Systems. machine # [ 4.117858] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.119620] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.121419] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.122616] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.124240] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.125869] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.126727] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.127700] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.128644] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.129658] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.130520] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.131582] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.132571] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.133585] systemd[1]: Closed udev Control Socket. machine # [ 4.134336] systemd[1]: Starting Cleanup udev Database... machine # [ 4.135086] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.136116] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.136957] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.138065] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.139090] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.140048] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.147771] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.148877] systemd[1]: Finished Cleanup udev Database. machine # [ 4.150152] systemd[1]: Reached target Switch Root. machine # [ 4.152176] systemd[1]: Starting NixOS Activation... machine # [ 4.306226] initrd-nixos-activation-start[241]: booting system configuration /nix/store/6qrdm3x86a7a5p8xmsl70g9p0ma2d05i-nixos-system-machine-test machine # [ 4.370746] initrd-nixos-activation-start[241]: running activation script... machine # [ 4.689171] initrd-nixos-activation-start[264]: setting up /etc... machine # [ 4.864330] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.866566] systemd[1]: Finished NixOS Activation. machine # [ 4.867824] systemd[1]: Starting Switch Root... machine # [ 4.887950] systemd[1]: Switching root. machine # [ 5.105679] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). machine # [ 5.236494] NET: Registered PF_VSOCK protocol family machine # [ 5.621488] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.660404] systemd[1]: Detected virtualization kvm. machine # [ 5.662264] systemd[1]: Detected architecture x86-64. machine # [ 5.664282] systemd[1]: Detected first boot. machine # [ 5.668938] systemd[1]: Initializing machine ID from random generator. machine # [ 5.810207] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.894446] systemd[1]: Applying preset policy. machine # [ 6.117507] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.396860] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.400719] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.405799] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.411580] systemd[1]: Created slice Slice /system/getty. machine # [ 6.415429] systemd[1]: Created slice User and Session Slice. machine # [ 6.417766] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.420943] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.423951] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.425954] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.428228] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.430572] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.432579] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.434766] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.437104] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.439557] systemd[1]: Reached target Path Units. machine # [ 6.441485] systemd[1]: Reached target Remote File Systems. machine # [ 6.443584] systemd[1]: Reached target Slice Units. machine # [ 6.445528] systemd[1]: Reached target Swaps. machine # [ 6.450448] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.456490] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.460908] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.465733] systemd[1]: Listening on Factory Reset Management. machine # [ 6.468149] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.475122] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.478318] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.483066] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.485426] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.487765] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.490535] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.498740] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.499907] systemd[1]: Listening on udev Control Socket. machine # [ 6.500899] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.503761] systemd[1]: Mounting Huge Pages File System... machine # [ 6.506279] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.509170] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.511462] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.519408] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.524770] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.525858] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.527447] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.529133] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.532794] systemd[1]: Mounting FUSE Control File System... machine # [ 6.535410] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.548113] systemd[1]: Starting Journal Service... machine # [ 6.555502] systemd[1]: Starting Load Kernel Modules... machine # [ 6.564050] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.568853] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.569934] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.573858] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.577397] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.578411] systemd[1]: Mounted Huge Pages File System. machine # [ 6.579497] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.580665] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.581789] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.583565] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.585223] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.586953] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.588792] systemd[1]: Mounted FUSE Control File System. machine # [ 6.591982] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.594981] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.600752] systemd-journald[334]: Collecting audit messages is enabled. machine # [ 6.616492] loop: module loaded machine # [ 6.619776] systemd[1]: Finished Load Kernel Modules. machine # [ 6.465696] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.620762] systemd[1]: Started Journal Service. machine # [ 6.467698] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.469318] systemd-modules-load[335]: Using 2 probe threads machine # [ 6.470275] systemd-modules-load[335]: Insert[ 6.624427] EXT4-fs (vda): re-mounted 5468f848-d6f9-4b30-b8b0-f1a59cd06b24. machine # ed module 'loop' machine # [ 6.472339] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.473397] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.475163] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.481926] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.484823] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.486190] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.488125] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.489889] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.493667] systemd-oomd[337]: No swap; memory pressure usage will be degraded machine # [ 6.498681] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.663698] systemd-journald[334]: Received client request to flush runtime journal. machine # [ 6.569163] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.570797] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.571970] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.572918] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.573796] systemd[1]: Reached target First Boot Complete. machine # [ 6.574662] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.575606] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.576642] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.577733] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.589399] systemd-udevd[363]: Using default interface naming scheme 'v261'. machine # [ 6.608635] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.624987] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.699782] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.726636] (udev-worker)[380]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.728782] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.736860] (udev-worker)[389]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.739318] (udev-worker)[389]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.746955] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.761502] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.763427] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.765246] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.767656] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.769611] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.770979] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.950599] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.956896] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.961520] ACPI: button: Power Button [PWRF] machine # [ 6.970315] Console: switching to colour dummy device 80x25 machine # [ 6.971701] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.971704] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.977371] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.978042] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.979289] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.996711] Console: switching to colour frame buffer device 160x50 machine # [ 6.998274] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 7.005070] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 7.008250] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 7.010968] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 7.011770] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 7.018145] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 7.018933] rtc_cmos PNP0B00:00: setting system clock to 2026-09-28T16:05:22 UTC (1790611522) machine # [ 7.019880] systemd-journald[334]: Time jumped backwards, rotating. machine # [ 7.020778] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 7.054778] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.055787] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.055808] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 7.057384] mousedev: PS/2 mouse device common for all mice machine # [ 7.059223] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.971195] systemd[1]: Starting Virtual Console Setup... machine # [ 7.147961] ppdev: user-space parallel port driver machine # [ 7.013101] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 7.014879] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.017829] systemd[1]: Starting Virtual Console Setup... machine # [ 7.173654] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.175850] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 7.188290] kvm_amd: TSC scaling supported machine # [ 7.188941] kvm_amd: Nested Virtualization enabled machine # [ 7.189519] kvm_amd: Nested Paging enabled machine # [ 7.190005] kvm_amd: LBR virtualization supported machine # [ 7.190576] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.191187] kvm_amd: Virtual GIF supported machine # [ 7.191746] kvm_amd: Virtual NMI enabled machine # [ 7.288686] EDAC MC: Ver: 3.0.0 machine # [ 7.196921] systemd-vconsole-setup[409]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.200341] systemd[1]: Finished Virtual Console Setup. machine # [ 7.246262] systemd[1]: Mounting /run/wrappers... machine # [ 7.280929] systemd[1]: Mounted /run/wrappers. machine # [ 7.282591] systemd[1]: Reached target Local File Systems. machine # [ 7.286129] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.289098] systemd[1]: Starting register-nix-paths.service... machine # [ 7.292254] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.294162] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.297323] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.310486] systemd[1]: Starting Create System Files and Directories... machine # [ 7.354085] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.357905] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.381866] systemd[1]: Finished Create System Files and Directories. machine # [ 7.384312] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.386621] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.415966] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.427114] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.428851] systemd[1]: Starting Update is Completed... machine # [ 7.457389] systemd[1]: Finished Update is Completed. machine # [ 7.579187] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.580415] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.808743] systemd[1]: Finished register-nix-paths.service. machine # [ 7.811210] systemd[1]: Reached target System Initialization. machine # [ 7.813438] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.816067] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.818367] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.820744] systemd[1]: Reached target Timer Units. machine # [ 7.822726] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.825218] systemd[1]: Listening on niks3 server socket. machine # [ 7.827315] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.829368] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.832412] systemd[1]: Reached target Socket Units. machine # [ 7.834378] systemd[1]: Reached target Basic System. machine # [ 7.836375] systemd[1]: Started backdoor.service. machine # [ 7.838271] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.840804] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.843872] systemd[1]: Starting Post-Boot Actions... machine # [ 7.848797] systemd[1]: Started Reset console on configuration changes. machine # [ 7.851167] systemd[1]: Starting resolvconf update... machine # [ 7.856953] systemd[1]: Started rustfs.service. machine # [ 7.865801] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.869418] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.879205] systemd[1]: Finished Post-Boot Actions. machine # [ 7.887542] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.893203] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.894811] nsncd[492]: Sep 28 16:05:23.522 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.896946] systemd[1]: Reached target User and Group Name Lookups. machine # connecting to host... machine # [ 7.898172] systemd[1]: Starting User Login Management... machine # [ 7.908399] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.58 seconds) machine: (finished: waiting for the VM to finish booting, in 8.82 seconds) machine # [ 7.957629] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.965368] systemd-logind[516]: New seat seat0. machine # [ 7.967633] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync' machine # [ 7.971641] dbus-broker-launch[499]: Invalid user-name in /nix/store/p2xx54aham1m5mjbij0xy0q881n6jvrj-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.977260] systemd-logind[516]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.978841] systemd-logind[516]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.980075] systemd-logind[516]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.981519] systemd[1]: Started User Login Management. machine # [ 7.985905] systemd[1]: Starting linger-users.service... machine # [ 7.987576] systemd[1]: Started D-Bus System Message Bus. machine # [ 8.000904] dbus-broker-launch[499]: Ready machine # [ 8.005644] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.006632] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.007233] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.008073] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.008383] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.013811] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.014774] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.019557] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.030384] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.032529] systemd[1]: Finished linger-users.service. machine # [ 8.058047] nsncd[594]: Sep 28 16:05:23.692 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.058668] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.059652] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.060199] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.083788] systemd[1]: Finished resolvconf update. machine # [ 8.084494] systemd[1]: Reached target Preparation for Network. machine # [ 8.088231] systemd[1]: Starting DHCP Client... machine # [ 8.089620] systemd[1]: Starting Address configuration of eth1... machine # [ 8.092037] systemd[1]: Starting Extra networking commands.... machine # [ 8.151274] network-addresses-eth1-start[628]: adding address 192.168.1.1/24... done machine # [ 8.157143] network-addresses-eth1-start[628]: adding address 2001:db8:1::1/64... done machine # [ 8.173594] systemd[1]: Finished Address configuration of eth1. machine # [ 8.177608] dhcpcd[636]: dhcpcd-10.3.2 starting machine # [ 8.182826] dhcpcd[688]: dev: loaded udev machine # [ 8.350901] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.352192] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.207380] systemd[1]: Finished Extra networking commands.. machine # [ 8.208340] systemd[1]: Reached target Network. machine # [ 8.210531] systemd[1]: Starting PostgreSQL Server... machine # [ 8.212113] systemd[1]: Starting Permit User Sessions... machine # [ 8.222870] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.234739] systemd[1]: Finished Permit User Sessions. machine # [ 8.237408] systemd[1]: Started Getty on tty1. machine # [ 8.238141] systemd[1]: Reached target Login Prompts. machine # [ 8.456743] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.471511] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.473184] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.475461] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.477036] cfg80211: failed to load regulatory.db machine # [ 8.339157] postgresql-pre-start[711]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.339984] postgresql-pre-start[711]: This user must also own the server process. machine # [ 8.345105] postgresql-pre-start[711]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.345860] postgresql-pre-start[711]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.346514] postgresql-pre-start[711]: The default text search configuration will be set to "english". machine # [ 8.346947] postgresql-pre-start[711]: Data page checksums are enabled. machine # [ 8.347694] postgresql-pre-start[711]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.352055] postgresql-pre-start[711]: creating subdirectories ... ok machine # [ 8.353093] postgresql-pre-start[711]: selecting dynamic shared memory implementation ... posix machine # [ 8.519563] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.367092] dhcpcd[688]: eth0: waiting for carrier machine # [ 8.367886] dhcpcd[688]: eth0: carrier acquired machine # [ 8.373867] dhcpcd[688]: DUID 00:01:00:01:32:4d:4c:c4:52:54:00:12:34:56 machine # [ 8.374407] dhcpcd[688]: eth0: IAID 00:12:34:56 machine # [ 8.374927] dhcpcd[688]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.397181] dhcpcd[688]: eth0: soliciting a DHCP lease machine # [ 8.561395] NET: Registered PF_PACKET protocol family machine # [ 8.412745] postgresql-pre-start[711]: selecting default "max_connections" ... 100 machine # [ 8.414625] dhcpcd[688]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 8.417213] dhcpcd[688]: eth0: probing address 10.0.2.15/24 machine # [ 8.466498] postgresql-pre-start[711]: selecting default "shared_buffers" ... 128MB machine # [ 9.187153] postgresql-pre-start[711]: selecting default time zone ... UTC machine # [ 9.189370] postgresql-pre-start[711]: creating configuration files ... ok machine # [ 9.367312] postgresql-pre-start[711]: running bootstrap script ... ok machine # [ 9.848767] postgresql-pre-start[711]: performing post-bootstrap initialization ... ok machine # [ 10.032109] postgresql-pre-start[711]: syncing data to disk ... ok machine # [ 10.033501] postgresql-pre-start[711]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.034608] postgresql-pre-start[711]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.035308] postgresql-pre-start[711]: Success. You can now start the database server using: machine # [ 10.036047] postgresql-pre-start[711]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.178479] postgres[746]: [746] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.181756] postgres[746]: [746] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.182831] postgres[746]: [746] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.186979] postgres[746]: [746] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.204191] postgres[764]: [764] LOG: database system was shut down at 2026-09-28 16:05:25 GMT machine # [ 10.214302] postgres[746]: [746] LOG: database system is ready to accept connections machine # [ 10.221078] systemd[1]: Started PostgreSQL Server. machine # [ 10.224673] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.494802] postgresql-setup-start[775]: CREATE DATABASE machine # [ 10.540529] postgresql-setup-start[780]: CREATE ROLE machine # [ 10.565375] postgresql-setup-start[782]: ALTER DATABASE machine # [ 10.574225] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.576254] systemd[1]: Reached target PostgreSQL. machine # [ 11.388615] dhcpcd[688]: eth0: soliciting an IPv6 router machine # [ 11.390763] dhcpcd[688]: eth0: Router Advertisement from fe80::2 machine # [ 11.392279] dhcpcd[688]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 11.393450] dhcpcd[688]: eth0: adding route to fec0::/64 machine # [ 11.395150] dhcpcd[688]: eth0: adding default route via fe80::2 machine # [ 13.870708] dhcpcd[688]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 13.873229] dhcpcd[688]: eth0: adding route to 10.0.2.0/24 machine # [ 13.875127] dhcpcd[688]: eth0: adding default route via 10.0.2.2 machine # [ 14.032415] systemd[1]: Started DHCP Client. machine # [ 14.034240] systemd[1]: Reached target Network is Online. machine # [ 14.036770] systemd[1]: Starting k3s service... machine # [ 14.140272] k3s[873]: time="2026-09-28T16:05:29Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.143911] k3s[873]: time="2026-09-28T16:05:29Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 16.284512] rustfs-bucket-start[888]: mb s3://farm machine # [ 16.290126] systemd[1]: Finished rustfs-bucket.service. machine # [ 16.714147] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 16.726509] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 16.727885] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 16.729467] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 16.745791] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Database tables and indexes are up to date" machine # [ 16.747406] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 16.752642] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Startup VACUUM completed successfully" machine # [ 16.756425] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Kine available at unix://kine.sock" machine # [ 16.757740] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 16.766574] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 16.770750] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:32.405408647 +0000 UTC notAfter=2036-09-25 15:05:32.405408647 +0000 UTC" machine # [ 16.771971] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.773401] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.774716] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.776138] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.777473] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.779222] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.780408] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790611532: notBefore=2026-09-28 15:05:32.415112394 +0000 UTC notAfter=2036-09-25 15:05:32.415112394 +0000 UTC" machine # [ 16.781916] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.782955] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.783813] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.784774] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790611532: notBefore=2026-09-28 15:05:32.419339188 +0000 UTC notAfter=2036-09-25 15:05:32.419339188 +0000 UTC" machine # [ 16.785809] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.786468] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790611532: notBefore=2026-09-28 15:05:32.421051417 +0000 UTC notAfter=2036-09-25 15:05:32.421051417 +0000 UTC" machine # [ 16.787196] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.788089] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790611532: notBefore=2026-09-28 15:05:32.422510262 +0000 UTC notAfter=2036-09-25 15:05:32.422510262 +0000 UTC" machine # [ 16.788900] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.789787] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.915509] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790611532: notBefore=2026-09-28 15:05:32 +0000 UTC notAfter=2027-09-28 15:05:32 +0000 UTC" machine # [ 16.916941] k3s[873]: time="2026-09-28T16:05:32Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 16.922781] k3s[873]: time="2026-09-28T16:05:32Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__1894_5b8a_b4b7_43b-ae1108:fec0::1894:5b8a:b4b7:43b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=F3A9E562113F9E8CB07E1CBD210423C5DB9EDF59]" machine # [ 17.900688] k3s[873]: time="2026-09-28T16:05:33Z" level=info msg="Password verified locally for node machine" machine # [ 17.904261] k3s[873]: time="2026-09-28T16:05:33Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790611532: notBefore=2026-09-28 15:05:33 +0000 UTC notAfter=2027-09-28 15:05:33 +0000 UTC" machine # [ 18.157941] k3s[873]: time="2026-09-28T16:05:33Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:33 +0000 UTC notAfter=2027-09-28 15:05:33 +0000 UTC" machine # [ 18.238552] k3s[873]: time="2026-09-28T16:05:33Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:33 +0000 UTC notAfter=2027-09-28 15:05:33 +0000 UTC" machine # [ 18.343640] k3s[873]: time="2026-09-28T16:05:33Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790611532: notBefore=2026-09-28 15:05:33 +0000 UTC notAfter=2027-09-28 15:05:33 +0000 UTC" machine # [ 18.454219] k3s[873]: time="2026-09-28T16:05:34Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:49440: runtime core not ready" machine # [ 18.567294] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Module overlay was already loaded" machine # [ 18.807411] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 18.812444] Bridge firewalling registered machine # [ 18.668251] k3s[873]: time="2026-09-28T16:05:34Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 18.681555] k3s[873]: time="2026-09-28T16:05:34Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 18.694789] k3s[873]: time="2026-09-28T16:05:34Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 18.782149] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 18.784263] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 18.785523] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 18.786757] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 18.788201] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 18.788484] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 18.790104] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.791367] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 18.793080] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 18.794260] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Connection to etcd is ready" machine # [ 18.795874] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="ETCD server is now running" machine # [ 18.797173] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Handling backend connection request [machine]" machine # [ 18.798483] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.799428] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 18.801186] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 18.803399] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 18.804770] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 18.817072] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 18.824470] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 18.825790] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 18.827656] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 18.828969] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 18.830678] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 18.831828] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Run: k3s kubectl" machine # [ 18.832815] k3s[873]: I0928 16:05:34.430873 873 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 18.834091] k3s[873]: I0928 16:05:34.432463 873 server.go:158] Version: v1.35.8+k3s1 machine # [ 18.834959] k3s[873]: I0928 16:05:34.432490 873 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 18.836490] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 18.837793] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 18.888332] k3s[873]: time="2026-09-28T16:05:34Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:49496: runtime core not ready" machine # [ 18.946489] k3s[873]: I0928 16:05:34.579998 873 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 18.948694] k3s[873]: I0928 16:05:34.584029 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 18.950518] k3s[873]: I0928 16:05:34.585855 873 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 18.954857] k3s[873]: I0928 16:05:34.585880 873 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 18.960212] k3s[873]: I0928 16:05:34.586163 873 instance.go:240] Using reconciler: lease machine # [ 18.962699] k3s[873]: I0928 16:05:34.598029 873 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 18.964274] k3s[873]: W0928 16:05:34.598063 873 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 18.966165] k3s[873]: I0928 16:05:34.600396 873 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 18.997667] k3s[873]: I0928 16:05:34.632975 873 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 18.999126] k3s[873]: I0928 16:05:34.633160 873 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.032116] k3s[873]: I0928 16:05:34.666810 873 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.046124] k3s[873]: time="2026-09-28T16:05:34Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.073526] k3s[873]: I0928 16:05:34.708820 873 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.075148] k3s[873]: W0928 16:05:34.708854 873 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.076870] k3s[873]: W0928 16:05:34.708866 873 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.078920] k3s[873]: I0928 16:05:34.709154 873 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.079653] k3s[873]: W0928 16:05:34.709169 873 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.080119] k3s[873]: I0928 16:05:34.709838 873 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.080684] k3s[873]: I0928 16:05:34.710437 873 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.081138] k3s[873]: W0928 16:05:34.710452 873 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 19.081435] k3s[873]: W0928 16:05:34.710463 873 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 19.082123] k3s[873]: I0928 16:05:34.711629 873 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.082718] k3s[873]: W0928 16:05:34.711647 873 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.083474] k3s[873]: I0928 16:05:34.712240 873 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.084091] k3s[873]: W0928 16:05:34.712257 873 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.084630] k3s[873]: W0928 16:05:34.712268 873 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.085130] k3s[873]: I0928 16:05:34.712685 873 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.085650] k3s[873]: W0928 16:05:34.712699 873 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.086238] k3s[873]: W0928 16:05:34.712709 873 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.087063] k3s[873]: I0928 16:05:34.713151 873 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.087704] k3s[873]: W0928 16:05:34.713168 873 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.088665] k3s[873]: I0928 16:05:34.714612 873 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.089756] k3s[873]: W0928 16:05:34.714628 873 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.090740] k3s[873]: I0928 16:05:34.714926 873 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.091806] k3s[873]: W0928 16:05:34.714942 873 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.092725] k3s[873]: W0928 16:05:34.714952 873 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.093295] k3s[873]: I0928 16:05:34.715458 873 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.094174] k3s[873]: W0928 16:05:34.715472 873 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.094984] k3s[873]: I0928 16:05:34.716481 873 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.095808] k3s[873]: W0928 16:05:34.716497 873 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.096640] k3s[873]: W0928 16:05:34.716508 873 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.097633] k3s[873]: I0928 16:05:34.716779 873 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.098639] k3s[873]: W0928 16:05:34.716792 873 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.099603] k3s[873]: W0928 16:05:34.716803 873 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 19.100597] k3s[873]: I0928 16:05:34.718220 873 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.101704] k3s[873]: W0928 16:05:34.718238 873 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.102670] k3s[873]: W0928 16:05:34.718248 873 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.103268] k3s[873]: I0928 16:05:34.718993 873 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.104295] k3s[873]: W0928 16:05:34.719012 873 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.105056] k3s[873]: W0928 16:05:34.719023 873 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.105546] k3s[873]: W0928 16:05:34.719032 873 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.106057] k3s[873]: I0928 16:05:34.721734 873 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.106563] k3s[873]: W0928 16:05:34.721763 873 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.107203] k3s[873]: W0928 16:05:34.721775 873 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.107737] k3s[873]: I0928 16:05:34.724143 873 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.108201] k3s[873]: W0928 16:05:34.724168 873 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.108702] k3s[873]: W0928 16:05:34.724180 873 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.109202] k3s[873]: I0928 16:05:34.724940 873 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.109691] k3s[873]: W0928 16:05:34.724958 873 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.110199] k3s[873]: I0928 16:05:34.727331 873 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.110712] k3s[873]: W0928 16:05:34.727350 873 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.111200] k3s[873]: W0928 16:05:34.727360 873 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.111694] k3s[873]: W0928 16:05:34.727369 873 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.112198] k3s[873]: I0928 16:05:34.730495 873 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.112687] k3s[873]: W0928 16:05:34.730522 873 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.476587] k3s[873]: I0928 16:05:35.111742 873 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.478826] k3s[873]: I0928 16:05:35.111771 873 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.480864] k3s[873]: I0928 16:05:35.112104 873 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.483552] k3s[873]: I0928 16:05:35.112168 873 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 19.484857] k3s[873]: I0928 16:05:35.112306 873 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 19.486215] k3s[873]: I0928 16:05:35.112438 873 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 19.491090] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 19.492543] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.493763] k3s[873]: I0928 16:05:35.112571 873 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 19.496402] k3s[873]: I0928 16:05:35.112692 873 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 19.497831] k3s[873]: I0928 16:05:35.112706 873 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 19.499268] k3s[873]: I0928 16:05:35.112751 873 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 19.500718] k3s[873]: I0928 16:05:35.112766 873 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 19.502127] k3s[873]: I0928 16:05:35.112808 873 controller.go:78] Starting OpenAPI AggregationController machine # [ 19.503412] k3s[873]: I0928 16:05:35.112924 873 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 19.504871] k3s[873]: I0928 16:05:35.113150 873 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 19.506722] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.507979] k3s[873]: I0928 16:05:35.113264 873 aggregator.go:185] waiting for initial CRD sync... machine # [ 19.509221] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 19.510643] k3s[873]: I0928 16:05:35.113474 873 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 19.512060] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.513269] k3s[873]: I0928 16:05:35.113536 873 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 19.514613] k3s[873]: I0928 16:05:35.113557 873 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 19.516166] k3s[873]: I0928 16:05:35.113579 873 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 19.518022] k3s[873]: I0928 16:05:35.113648 873 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.523113] k3s[873]: I0928 16:05:35.113661 873 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 19.524609] k3s[873]: I0928 16:05:35.113757 873 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.526605] k3s[873]: I0928 16:05:35.113995 873 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 19.527985] k3s[873]: I0928 16:05:35.114012 873 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 19.529576] k3s[873]: I0928 16:05:35.114149 873 repairip.go:210] Starting ipallocator-repair-controller machine # [ 19.530825] k3s[873]: I0928 16:05:35.114163 873 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 19.532471] k3s[873]: I0928 16:05:35.114502 873 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 19.533857] k3s[873]: I0928 16:05:35.114516 873 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 19.535360] k3s[873]: I0928 16:05:35.114586 873 controller.go:142] Starting OpenAPI controller machine # [ 19.536491] k3s[873]: I0928 16:05:35.114643 873 controller.go:90] Starting OpenAPI V3 controller machine # [ 19.537646] k3s[873]: I0928 16:05:35.114677 873 naming_controller.go:305] Starting NamingConditionController machine # [ 19.538928] k3s[873]: I0928 16:05:35.114765 873 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 19.540496] k3s[873]: I0928 16:05:35.114794 873 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 19.542363] k3s[873]: I0928 16:05:35.114825 873 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 19.545029] k3s[873]: I0928 16:05:35.180307 873 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 19.549337] k3s[873]: I0928 16:05:35.184669 873 shared_informer.go:377] "Caches are synced" machine # [ 19.550786] k3s[873]: I0928 16:05:35.184709 873 policy_source.go:248] refreshing policies machine # [ 19.578298] k3s[873]: I0928 16:05:35.213545 873 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 19.578907] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.579684] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.580233] k3s[873]: I0928 16:05:35.213719 873 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 19.580414] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="Caches are synced" logger=k3s machine # [ 19.581592] k3s[873]: I0928 16:05:35.216934 873 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 19.582199] k3s[873]: I0928 16:05:35.216986 873 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 19.582688] k3s[873]: I0928 16:05:35.213731 873 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 19.583193] k3s[873]: I0928 16:05:35.213881 873 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 19.583668] k3s[873]: I0928 16:05:35.217460 873 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 19.584160] k3s[873]: I0928 16:05:35.216360 873 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 19.584641] k3s[873]: I0928 16:05:35.217182 873 aggregator.go:187] initial CRD sync complete... machine # [ 19.585152] k3s[873]: I0928 16:05:35.217708 873 autoregister_controller.go:144] Starting autoregister controller machine # [ 19.585813] k3s[873]: I0928 16:05:35.217723 873 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 19.586471] k3s[873]: I0928 16:05:35.217734 873 cache.go:39] Caches are synced for autoregister controller machine # [ 19.600127] k3s[873]: I0928 16:05:35.232346 873 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 19.601133] k3s[873]: I0928 16:05:35.232701 873 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 19.604841] k3s[873]: I0928 16:05:35.240097 873 controller.go:667] quota admission added evaluator for: namespaces machine # [ 19.609159] k3s[873]: I0928 16:05:35.244516 873 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.610985] k3s[873]: E0928 16:05:35.246341 873 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 19.612534] k3s[873]: I0928 16:05:35.247873 873 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 19.621582] k3s[873]: I0928 16:05:35.256938 873 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 19.653395] k3s[873]: I0928 16:05:35.288687 873 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 19.660813] k3s[873]: W0928 16:05:35.296152 873 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 19.663766] k3s[873]: I0928 16:05:35.299090 873 controller.go:667] quota admission added evaluator for: endpoints machine # [ 19.671066] k3s[873]: I0928 16:05:35.305984 873 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 19.677924] k3s[873]: E0928 16:05:35.313117 873 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 19.821077] k3s[873]: I0928 16:05:35.456106 873 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 19.885890] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="containerd is now running" machine # [ 19.892457] k3s[873]: time="2026-09-28T16:05:35Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 20.487383] k3s[873]: I0928 16:05:36.122035 873 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 20.493697] k3s[873]: I0928 16:05:36.128992 873 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 20.494682] k3s[873]: I0928 16:05:36.129014 873 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 20.787832] k3s[873]: time="2026-09-28T16:05:36Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.378200] k3s[873]: I0928 16:05:37.013500 873 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 21.422247] k3s[873]: I0928 16:05:37.057536 873 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 22.790415] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="Waiting for untainted node" machine # [ 22.790791] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="Kube API server is now running" machine # [ 22.791364] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="k3s is up and running" machine # [ 22.791902] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 22.794351] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 22.798167] systemd[1]: Started k3s service. machine # [ 22.803929] systemd[1]: Starting niks3 server... machine # [ 22.812161] k3s[873]: I0928 16:05:38.447379 873 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 22.813612] k3s[873]: I0928 16:05:38.447493 873 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 22.818035] k3s[873]: I0928 16:05:38.453183 873 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 22.818794] k3s[873]: I0928 16:05:38.453218 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.819209] k3s[873]: I0928 16:05:38.453270 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 22.819713] k3s[873]: I0928 16:05:38.453287 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.820204] k3s[873]: I0928 16:05:38.453318 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 22.820725] k3s[873]: I0928 16:05:38.453335 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.824063] k3s[873]: I0928 16:05:38.453270 873 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 22.830344] k3s[873]: I0928 16:05:38.465589 873 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 22.831228] k3s[873]: I0928 16:05:38.466574 873 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 22.852575] k3s[873]: I0928 16:05:38.487779 873 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 22.892076] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 22.897904] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 22.907227] k3s[873]: I0928 16:05:38.542526 873 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 22.911071] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 22.913143] k3s[873]: I0928 16:05:38.548489 873 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 22.918662] k3s[873]: I0928 16:05:38.553798 873 shared_informer.go:377] "Caches are synced" machine # [ 22.919509] k3s[873]: I0928 16:05:38.553917 873 shared_informer.go:377] "Caches are synced" machine # [ 22.920103] k3s[873]: I0928 16:05:38.554014 873 shared_informer.go:377] "Caches are synced" machine # [ 22.923496] k3s[873]: I0928 16:05:38.558816 873 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 22.925604] k3s[873]: I0928 16:05:38.560949 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.928487] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 22.952069] k3s[873]: time="2026-09-28T16:05:38Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 22.954473] k3s[873]: I0928 16:05:38.589824 873 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 22.965074] k3s[873]: I0928 16:05:38.600062 873 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 22.987073] k3s[873]: I0928 16:05:38.622256 873 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 22.997302] k3s[873]: I0928 16:05:38.632640 873 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 23.226473] k3s[873]: I0928 16:05:38.861699 873 shared_informer.go:377] "Caches are synced" machine # [ 23.393712] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 23.398069] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 23.400224] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 23.406293] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 23.408640] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 23.410341] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 23.412934] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 23.420917] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 23.421693] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 23.428760] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 23.429639] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 23.433117] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 23.433757] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 23.441855] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 23.442377] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 23.444611] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 23.456780] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.457528] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.463361] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.464103] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 23.464594] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 23.465092] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 23.465579] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 23.466615] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 23.467511] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 23.468221] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 23.468599] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 23.499383] k3s[873]: I0928 16:05:39.134644 873 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 23.499907] k3s[873]: I0928 16:05:39.134673 873 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 23.663412] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 23.663849] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::1894:5b8a:b4b7:43b 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 23.664516] k3s[873]: I0928 16:05:39.298554 873 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 23.664978] k3s[873]: I0928 16:05:39.298613 873 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 23.665686] k3s[873]: I0928 16:05:39.298633 873 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 23.666209] k3s[873]: I0928 16:05:39.298643 873 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 23.753814] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.861834954s" machine # [ 23.754647] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine: (finished: waiting for unit k3s.service, in 24.70 seconds) machine # [ 23.799389] k3s[873]: I0928 16:05:39.434022 873 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine: waiting for success: kubectl get ns farm machine # [ 23.915953] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__1894_5b8a_b4b7_43b-ae1108:fec0::1894:5b8a:b4b7:43b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=F3A9E562113F9E8CB07E1CBD210423C5DB9EDF59]" machine # [ 23.925840] k3s[873]: time="2026-09-28T16:05:39Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=236) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__1894_5b8a_b4b7_43b-ae1108:fec0::1894:5b8a:b4b7:43b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=F3A9E562113F9E8CB07E1CBD210423C5DB9EDF59]" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.348544] k3s[873]: I0928 16:05:39.983812 873 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 24.351679] k3s[873]: I0928 16:05:39.983850 873 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 24.874774] k3s[873]: time="2026-09-28T16:05:40Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 24.875993] k3s[873]: time="2026-09-28T16:05:40Z" level=info msg="Creating deploy event broadcaster" machine # [ 24.880257] k3s[873]: I0928 16:05:40.515512 873 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 24.886101] k3s[873]: time="2026-09-28T16:05:40Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 24.887067] k3s[873]: time="2026-09-28T16:05:40Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 24.896775] k3s[873]: time="2026-09-28T16:05:40Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 24.902204] k3s[873]: time="2026-09-28T16:05:40Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 24.909597] k3s[873]: time="2026-09-28T16:05:40Z" level=info msg="Cluster dns configmap has been set successfully" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.405225] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 25.415400] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 25.703687] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 25.713377] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 25.860461] k3s[873]: I0928 16:05:41.495606 873 serving.go:392] Generated self-signed cert in-memory machine # [ 25.889899] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.098484] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.100390] k3s[873]: I0928 16:05:41.735705 873 serving.go:392] Generated self-signed cert in-memory machine # [ 26.107606] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.108927] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.110205] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.111505] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.120730] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.122514] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.150089] k3s[873]: W0928 16:05:41.784611 873 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 26.204701] k3s[873]: I0928 16:05:41.839992 873 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 26.208157] k3s[873]: I0928 16:05:41.843402 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.208995] k3s[873]: I0928 16:05:41.843474 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.209714] k3s[873]: I0928 16:05:41.843465 873 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.210489] k3s[873]: I0928 16:05:41.843536 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.210968] k3s[873]: I0928 16:05:41.843648 873 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 26.211869] k3s[873]: I0928 16:05:41.844158 873 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.212750] k3s[873]: I0928 16:05:41.846169 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.213660] k3s[873]: I0928 16:05:41.846224 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.222521] k3s[873]: time="2026-09-28T16:05:41Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 26.308212] k3s[873]: I0928 16:05:41.943538 873 shared_informer.go:377] "Caches are synced" machine # [ 26.311278] k3s[873]: I0928 16:05:41.946577 873 shared_informer.go:377] "Caches are synced" machine # [ 26.311948] k3s[873]: I0928 16:05:41.946696 873 shared_informer.go:377] "Caches are synced" machine: (finished: waiting for success: kubectl get ns farm, in 2.61 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 26.453863] k3s[873]: I0928 16:05:42.089092 873 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 26.510529] k3s[873]: time="2026-09-28T16:05:42Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 26.514560] k3s[873]: time="2026-09-28T16:05:42Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 26.519873] k3s[873]: time="2026-09-28T16:05:42Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 26.523811] k3s[873]: I0928 16:05:42.159165 873 controllermanager.go:329] Started "cloud-node-controller" machine # [ 26.525601] k3s[873]: time="2026-09-28T16:05:42Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 26.526507] k3s[873]: I0928 16:05:42.159692 873 node_controller.go:176] Sending events to api server. machine # [ 26.527187] k3s[873]: I0928 16:05:42.159916 873 node_controller.go:185] Waiting for informer caches to sync machine # [ 26.527848] k3s[873]: I0928 16:05:42.159943 873 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 26.529074] k3s[873]: I0928 16:05:42.159983 873 node_lifecycle_controller.go:112] Sending events to api server machine # [ 26.529687] k3s[873]: I0928 16:05:42.160293 873 controllermanager.go:329] Started "service-lb-controller" machine # [ 26.530310] k3s[873]: W0928 16:05:42.160306 873 controllermanager.go:306] "node-route-controller" is disabled machine # [ 26.531363] k3s[873]: I0928 16:05:42.160881 873 controller.go:235] Starting service controller machine # [ 26.531979] k3s[873]: I0928 16:05:42.160908 873 shared_informer.go:370] "Waiting for caches to sync" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.18 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.604118] k3s[873]: I0928 16:05:42.239208 873 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 26.607123] k3s[873]: time="2026-09-28T16:05:42Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 26.626287] k3s[873]: I0928 16:05:42.261596 873 shared_informer.go:377] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.15 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.889596] k3s[873]: time="2026-09-28T16:05:42Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.905685] k3s[873]: I0928 16:05:42.541020 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.15 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 26.906581] k3s[873]: I0928 16:05:42.541064 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 26.907248] k3s[873]: I0928 16:05:42.541115 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 26.907739] k3s[873]: I0928 16:05:42.541149 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 26.908236] k3s[873]: I0928 16:05:42.541183 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 26.909123] k3s[873]: I0928 16:05:42.541218 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 26.909755] k3s[873]: I0928 16:05:42.541242 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 26.911200] k3s[873]: I0928 16:05:42.541271 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 26.912252] k3s[873]: I0928 16:05:42.541297 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 26.913917] k3s[873]: I0928 16:05:42.541317 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 26.915077] k3s[873]: I0928 16:05:42.541342 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 26.917159] k3s[873]: I0928 16:05:42.541363 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 26.917785] k3s[873]: I0928 16:05:42.541396 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 26.918590] k3s[873]: I0928 16:05:42.541445 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 26.919641] k3s[873]: I0928 16:05:42.541472 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 26.920843] k3s[873]: I0928 16:05:42.541505 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 26.921952] k3s[873]: I0928 16:05:42.541530 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 26.923135] k3s[873]: I0928 16:05:42.541565 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 26.924735] k3s[873]: I0928 16:05:42.541588 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 26.925628] k3s[873]: I0928 16:05:42.541610 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 26.927960] k3s[873]: I0928 16:05:42.541660 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 26.928551] k3s[873]: I0928 16:05:42.541684 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 26.929046] k3s[873]: I0928 16:05:42.541719 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 26.929543] k3s[873]: I0928 16:05:42.541749 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.766112] k3s[873]: I0928 16:05:43.401311 873 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 27.768097] k3s[873]: I0928 16:05:43.401383 873 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 27.776176] k3s[873]: I0928 16:05:43.411387 873 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 27.776988] k3s[873]: I0928 16:05:43.411451 873 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 27.793074] k3s[873]: I0928 16:05:43.426463 873 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 27.793786] k3s[873]: I0928 16:05:43.426534 873 taint_eviction.go:288] "Sending events to API server" machine # [ 27.794490] k3s[873]: I0928 16:05:43.426549 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.796201] k3s[873]: I0928 16:05:43.431552 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.796931] k3s[873]: I0928 16:05:43.431853 873 job_controller.go:254] "Starting job controller" machine # [ 27.797613] k3s[873]: I0928 16:05:43.431869 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.798104] k3s[873]: I0928 16:05:43.431948 873 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 27.798610] k3s[873]: I0928 16:05:43.431961 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.799098] k3s[873]: I0928 16:05:43.431999 873 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 27.799613] k3s[873]: I0928 16:05:43.432049 873 ttl_controller.go:127] "Starting TTL controller" machine # [ 27.800115] k3s[873]: I0928 16:05:43.432061 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.800850] k3s[873]: I0928 16:05:43.432094 873 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 27.801492] k3s[873]: I0928 16:05:43.432108 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.801940] k3s[873]: I0928 16:05:43.432140 873 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 27.803168] k3s[873]: I0928 16:05:43.432153 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.803627] k3s[873]: I0928 16:05:43.432186 873 disruption.go:458] "Sending events to api server." machine # [ 27.804101] k3s[873]: I0928 16:05:43.432217 873 disruption.go:465] "Starting disruption controller" machine # [ 27.804580] k3s[873]: I0928 16:05:43.432227 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.806194] k3s[873]: I0928 16:05:43.432288 873 stateful_set.go:180] "Starting stateful set controller" machine # [ 27.806454] k3s[873]: I0928 16:05:43.432300 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.807363] k3s[873]: I0928 16:05:43.432365 873 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 27.807983] k3s[873]: I0928 16:05:43.432407 873 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 27.808672] k3s[873]: I0928 16:05:43.432437 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.809928] k3s[873]: I0928 16:05:43.432522 873 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 27.810644] k3s[873]: I0928 16:05:43.432536 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.811123] k3s[873]: I0928 16:05:43.432566 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.811633] k3s[873]: I0928 16:05:43.432637 873 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 27.813271] k3s[873]: I0928 16:05:43.432651 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.813968] k3s[873]: I0928 16:05:43.432681 873 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 27.814664] k3s[873]: I0928 16:05:43.432695 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.815203] k3s[873]: I0928 16:05:43.432768 873 controller.go:423] "Starting resource claim controller" machine # [ 27.815698] k3s[873]: I0928 16:05:43.432781 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.817780] k3s[873]: I0928 16:05:43.432851 873 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 27.818549] k3s[873]: I0928 16:05:43.432863 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.819032] k3s[873]: I0928 16:05:43.432932 873 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 27.819545] k3s[873]: I0928 16:05:43.432945 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.820773] k3s[873]: I0928 16:05:43.433016 873 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 27.821535] k3s[873]: I0928 16:05:43.433030 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.821979] k3s[873]: I0928 16:05:43.433088 873 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 27.822649] k3s[873]: I0928 16:05:43.433100 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.824529] k3s[873]: I0928 16:05:43.433129 873 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 27.825417] k3s[873]: I0928 16:05:43.433140 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.825882] k3s[873]: I0928 16:05:43.433169 873 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 27.826560] k3s[873]: I0928 16:05:43.433181 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.827439] k3s[873]: I0928 16:05:43.433213 873 gc_controller.go:98] "Starting GC controller" machine # [ 27.828053] k3s[873]: I0928 16:05:43.433226 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.828569] k3s[873]: I0928 16:05:43.433255 873 namespace_controller.go:202] "Starting namespace controller" machine # [ 27.829088] k3s[873]: I0928 16:05:43.433267 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.829595] k3s[873]: I0928 16:05:43.433322 873 horizontal.go:204] "Starting HPA controller" machine # [ 27.830383] k3s[873]: I0928 16:05:43.433333 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.830888] k3s[873]: I0928 16:05:43.433363 873 expand_controller.go:328] "Starting expand controller" machine # [ 27.831583] k3s[873]: I0928 16:05:43.433375 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.832082] k3s[873]: I0928 16:05:43.433436 873 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 27.832613] k3s[873]: I0928 16:05:43.433449 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.833115] k3s[873]: I0928 16:05:43.433528 873 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 27.833595] k3s[873]: I0928 16:05:43.433541 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.834112] k3s[873]: I0928 16:05:43.433612 873 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 27.834637] k3s[873]: I0928 16:05:43.433624 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.835282] k3s[873]: I0928 16:05:43.433726 873 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 27.835841] k3s[873]: I0928 16:05:43.433744 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.836380] k3s[873]: I0928 16:05:43.433814 873 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 27.836878] k3s[873]: I0928 16:05:43.433828 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.837419] k3s[873]: I0928 16:05:43.433859 873 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 27.837903] k3s[873]: I0928 16:05:43.433871 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.838569] k3s[873]: I0928 16:05:43.433905 873 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 27.839044] k3s[873]: I0928 16:05:43.433918 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.839586] k3s[873]: I0928 16:05:43.433958 873 controller.go:174] "Starting ephemeral volume controller" machine # [ 27.840085] k3s[873]: I0928 16:05:43.433975 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.840628] k3s[873]: I0928 16:05:43.434167 873 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 27.841122] k3s[873]: I0928 16:05:43.434180 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.841665] k3s[873]: I0928 16:05:43.434208 873 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 27.842161] k3s[873]: I0928 16:05:43.434220 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.842673] k3s[873]: I0928 16:05:43.434252 873 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 27.843151] k3s[873]: I0928 16:05:43.434264 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.843668] k3s[873]: I0928 16:05:43.434881 873 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 27.844226] k3s[873]: I0928 16:05:43.434909 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.844738] k3s[873]: I0928 16:05:43.435037 873 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 27.845473] k3s[873]: I0928 16:05:43.435050 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.845912] k3s[873]: I0928 16:05:43.435083 873 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 27.846757] k3s[873]: I0928 16:05:43.435095 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.847967] k3s[873]: I0928 16:05:43.435126 873 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 27.849672] k3s[873]: I0928 16:05:43.435139 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.850652] k3s[873]: I0928 16:05:43.435187 873 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.853431] k3s[873]: I0928 16:05:43.435341 873 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 27.854804] k3s[873]: I0928 16:05:43.435355 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.856109] k3s[873]: I0928 16:05:43.435433 873 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 27.857530] k3s[873]: I0928 16:05:43.435445 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.858680] k3s[873]: I0928 16:05:43.435800 873 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 27.859680] k3s[873]: I0928 16:05:43.435824 873 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 27.862074] k3s[873]: I0928 16:05:43.435886 873 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.864676] k3s[873]: I0928 16:05:43.435947 873 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 27.867074] k3s[873]: I0928 16:05:43.438469 873 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 27.868064] k3s[873]: I0928 16:05:43.450561 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.869209] k3s[873]: I0928 16:05:43.478368 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.888942] k3s[873]: time="2026-09-28T16:05:43Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.982594] k3s[873]: time="2026-09-28T16:05:43Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 27.999073] k3s[873]: I0928 16:05:43.634347 873 shared_informer.go:377] "Caches are synced" machine # [ 27.999601] k3s[873]: I0928 16:05:43.634397 873 shared_informer.go:377] "Caches are synced" machine # [ 28.000520] k3s[873]: I0928 16:05:43.635579 873 shared_informer.go:377] "Caches are synced" machine # [ 28.016070] k3s[873]: I0928 16:05:43.651249 873 shared_informer.go:377] "Caches are synced" machine # [ 28.091601] k3s[873]: I0928 16:05:43.726837 873 shared_informer.go:377] "Caches are synced" machine # [ 28.096400] k3s[873]: I0928 16:05:43.731740 873 shared_informer.go:377] "Caches are synced" machine # [ 28.097599] k3s[873]: I0928 16:05:43.732892 873 shared_informer.go:377] "Caches are synced" machine # [ 28.098437] k3s[873]: I0928 16:05:43.732960 873 shared_informer.go:377] "Caches are synced" machine # [ 28.099026] k3s[873]: I0928 16:05:43.733029 873 shared_informer.go:377] "Caches are synced" machine # [ 28.099510] k3s[873]: I0928 16:05:43.733093 873 shared_informer.go:377] "Caches are synced" machine # [ 28.099985] k3s[873]: I0928 16:05:43.733381 873 shared_informer.go:377] "Caches are synced" machine # [ 28.100680] k3s[873]: I0928 16:05:43.733477 873 shared_informer.go:377] "Caches are synced" machine # [ 28.101182] k3s[873]: I0928 16:05:43.733522 873 shared_informer.go:377] "Caches are synced" machine # [ 28.101704] k3s[873]: I0928 16:05:43.733848 873 shared_informer.go:377] "Caches are synced" machine # [ 28.102215] k3s[873]: I0928 16:05:43.733947 873 shared_informer.go:377] "Caches are synced" machine # [ 28.102734] k3s[873]: I0928 16:05:43.733995 873 shared_informer.go:377] "Caches are synced" machine # [ 28.103278] k3s[873]: I0928 16:05:43.734027 873 shared_informer.go:377] "Caches are synced" machine # [ 28.103721] k3s[873]: I0928 16:05:43.734031 873 shared_informer.go:377] "Caches are synced" machine # [ 28.104204] k3s[873]: I0928 16:05:43.734062 873 shared_informer.go:377] "Caches are synced" machine # [ 28.104688] k3s[873]: I0928 16:05:43.734141 873 shared_informer.go:377] "Caches are synced" machine # [ 28.105196] k3s[873]: I0928 16:05:43.734221 873 shared_informer.go:377] "Caches are synced" machine # [ 28.105727] k3s[873]: I0928 16:05:43.734257 873 range_allocator.go:177] "Sending events to api server" machine # [ 28.106401] k3s[873]: I0928 16:05:43.734297 873 shared_informer.go:377] "Caches are synced" machine # [ 28.106896] k3s[873]: I0928 16:05:43.734468 873 shared_informer.go:377] "Caches are synced" machine # [ 28.107527] k3s[873]: I0928 16:05:43.734512 873 shared_informer.go:377] "Caches are synced" machine # [ 28.108033] k3s[873]: I0928 16:05:43.734788 873 shared_informer.go:377] "Caches are synced" machine # [ 28.108517] k3s[873]: I0928 16:05:43.734826 873 shared_informer.go:377] "Caches are synced" machine # [ 28.108996] k3s[873]: I0928 16:05:43.734844 873 shared_informer.go:377] "Caches are synced" machine # [ 28.109587] k3s[873]: I0928 16:05:43.734865 873 shared_informer.go:377] "Caches are synced" machine # [ 28.110087] k3s[873]: I0928 16:05:43.734883 873 shared_informer.go:377] "Caches are synced" machine # [ 28.122715] k3s[873]: I0928 16:05:43.734893 873 shared_informer.go:377] "Caches are synced" machine # [ 28.123503] k3s[873]: I0928 16:05:43.734943 873 shared_informer.go:377] "Caches are synced" machine # [ 28.123969] k3s[873]: I0928 16:05:43.734999 873 shared_informer.go:377] "Caches are synced" machine # [ 28.124652] k3s[873]: I0928 16:05:43.735044 873 shared_informer.go:377] "Caches are synced" machine # [ 28.125165] k3s[873]: I0928 16:05:43.734800 873 shared_informer.go:377] "Caches are synced" machine # [ 28.125678] k3s[873]: I0928 16:05:43.735621 873 shared_informer.go:377] "Caches are synced" machine # [ 28.126168] k3s[873]: I0928 16:05:43.736630 873 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.126361] k3s[873]: I0928 16:05:43.736644 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.126834] k3s[873]: I0928 16:05:43.736655 873 shared_informer.go:377] "Caches are synced" machine # [ 28.127527] k3s[873]: I0928 16:05:43.736778 873 shared_informer.go:377] "Caches are synced" machine # [ 28.128067] k3s[873]: I0928 16:05:43.736819 873 shared_informer.go:377] "Caches are synced" machine # [ 28.128585] k3s[873]: I0928 16:05:43.736857 873 shared_informer.go:377] "Caches are synced" machine # [ 28.129077] k3s[873]: I0928 16:05:43.736899 873 shared_informer.go:377] "Caches are synced" machine # [ 28.129582] k3s[873]: I0928 16:05:43.736997 873 shared_informer.go:377] "Caches are synced" machine # [ 28.130050] k3s[873]: I0928 16:05:43.737229 873 shared_informer.go:377] "Caches are synced" machine # [ 28.130568] k3s[873]: time="2026-09-28T16:05:43Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 28.141883] k3s[873]: I0928 16:05:43.758139 873 shared_informer.go:377] "Caches are synced" machine # [ 28.143453] k3s[873]: I0928 16:05:43.761670 873 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.145143] k3s[873]: I0928 16:05:43.780475 873 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.152883] k3s[873]: time="2026-09-28T16:05:43Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 28.258117] k3s[873]: I0928 16:05:43.893431 873 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 28.264033] k3s[873]: time="2026-09-28T16:05:43Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 28.277342] k3s[873]: time="2026-09-28T16:05:43Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 28.300447] k3s[873]: I0928 16:05:43.935790 873 controller.go:667] quota admission added evaluator for: replicasets.apps machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.769578] k3s[873]: time="2026-09-28T16:05:44Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 28.795521] k3s[873]: I0928 16:05:44.430844 873 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 28.889621] k3s[873]: time="2026-09-28T16:05:44Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.456430] postgres[1187]: [1187] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 29.456838] postgres[1187]: [1187] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 29.480310] niks3-server[1163]: 2026/09/28 16:05:45 OK 20241026095416_initial_model.sql (11.45ms) machine # [ 29.482882] niks3-server[1163]: 2026/09/28 16:05:45 OK 20251210153512_drop_unused_gin_index.sql (3.1ms) machine # [ 29.488360] niks3-server[1163]: 2026/09/28 16:05:45 OK 20251218171726_add_pins.sql (5.02ms) machine # [ 29.493843] niks3-server[1163]: 2026/09/28 16:05:45 OK 20260628120000_add_object_size_and_stats.sql (5.72ms) machine # [ 29.497764] niks3-server[1163]: 2026/09/28 16:05:45 OK 20260905000000_add_claims.sql (3.87ms) machine # [ 29.501487] niks3-server[1163]: 2026/09/28 16:05:45 OK 20260920000000_drop_claims.sql (3.66ms) machine # [ 29.503312] niks3-server[1163]: 2026/09/28 16:05:45 OK 20260923120000_add_pushes.sql (1.78ms) machine # [ 29.504787] niks3-server[1163]: 2026/09/28 16:05:45 goose: successfully migrated database to version: 20260923120000 machine # [ 29.506302] niks3-server[1163]: 2026/09/28 16:05:45 OK 1_commit_pending_closure.sql (2.82ms) machine # [ 29.508357] niks3-server[1163]: 2026/09/28 16:05:45 OK 2_object_stats_trigger.sql (2.01ms) machine # [ 29.510165] niks3-server[1163]: 2026/09/28 16:05:45 OK 3_commit_push.sql (1.73ms) machine # [ 29.510962] niks3-server[1163]: 2026/09/28 16:05:45 goose: up to current file version: 3 machine # [ 29.514298] niks3-server[1163]: 2026/09/28 16:05:45 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 29.515060] niks3-server[1163]: 2026/09/28 16:05:45 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 29.515879] niks3-server[1163]: 2026/09/28 16:05:45 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 29.541617] niks3-server[1163]: 2026/09/28 16:05:45 INFO Read proxy enabled — serving cache objects from S3 machine # [ 29.542511] niks3-server[1163]: 2026/09/28 16:05:45 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 29.544299] niks3-server[1163]: 2026/09/28 16:05:45 INFO systemd watchdog enabled interval=15s machine # [ 29.545277] niks3-server[1163]: 2026/09/28 16:05:45 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 29.546282] systemd[1]: Started niks3 server. machine # [ 29.546575] systemd[1]: Reached target Multi-User System. machine # [ 29.547082] systemd[1]: Startup finished in 1.196s (kernel) + 3.838s (initrd) + 24.509s (userspace) = 29.545s. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.780501] k3s[873]: time="2026-09-28T16:05:45Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 29.783896] k3s[873]: time="2026-09-28T16:05:45Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.799649] k3s[873]: I0928 16:05:45.435005 873 shared_informer.go:377] "Caches are synced" machine # [ 29.800317] k3s[873]: I0928 16:05:45.435691 873 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.801042] k3s[873]: I0928 16:05:45.436397 873 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.801631] k3s[873]: time="2026-09-28T16:05:45Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 29.843758] k3s[873]: I0928 16:05:45.479100 873 shared_informer.go:377] "Caches are synced" machine # [ 29.889838] k3s[873]: time="2026-09-28T16:05:45Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.003092] k3s[873]: time="2026-09-28T16:05:45Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 30.685409] k3s[873]: time="2026-09-28T16:05:46Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 30.692270] k3s[873]: time="2026-09-28T16:05:46Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:c6e30f472a038f5b1579277157587c12899d8f64ee34ef020d772640fd8f605e" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.766425] k3s[873]: time="2026-09-28T16:05:46Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 30.890105] k3s[873]: time="2026-09-28T16:05:46Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.149572] k3s[873]: time="2026-09-28T16:05:46Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.395346894s" machine # [ 31.151407] k3s[873]: time="2026-09-28T16:05:46Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # [ 31.889293] k3s[873]: time="2026-09-28T16:05:47Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.696166] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 32.701889] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 32.760688] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.610867302s" machine # [ 32.762617] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 32.892359] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.908916] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::1894:5b8a:b4b7:43b --node-labels= --read-only-port=0" machine # [ 32.923264] k3s[873]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 32.943059] k3s[873]: I0928 16:05:48.578271 873 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 32.944431] k3s[873]: I0928 16:05:48.578321 873 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 32.944780] k3s[873]: I0928 16:05:48.578458 873 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 32.946399] k3s[873]: I0928 16:05:48.578481 873 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 32.949079] k3s[873]: I0928 16:05:48.580706 873 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 32.951951] k3s[873]: I0928 16:05:48.587263 873 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 32.957499] k3s[873]: I0928 16:05:48.592814 873 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 32.958803] k3s[873]: I0928 16:05:48.592852 873 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 32.959812] k3s[873]: I0928 16:05:48.593069 873 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 32.960822] k3s[873]: I0928 16:05:48.593107 873 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 32.961843] k3s[873]: I0928 16:05:48.593300 873 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 32.962679] k3s[873]: I0928 16:05:48.593316 873 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 32.963509] k3s[873]: I0928 16:05:48.593392 873 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 32.964243] k3s[873]: I0928 16:05:48.597731 873 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 32.965110] k3s[873]: I0928 16:05:48.597952 873 kubelet.go:482] "Attempting to sync node with API server" machine # [ 32.965410] k3s[873]: I0928 16:05:48.597971 873 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 32.966216] k3s[873]: I0928 16:05:48.597999 873 kubelet.go:394] "Adding apiserver pod source" machine # [ 32.966988] k3s[873]: I0928 16:05:48.598018 873 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 32.967764] k3s[873]: I0928 16:05:48.600701 873 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 32.968470] k3s[873]: I0928 16:05:48.601301 873 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 32.969233] k3s[873]: I0928 16:05:48.601326 873 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 32.970141] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 32.970843] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 32.971539] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.972031] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 32.972674] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 32.973150] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Handling backend connection request [machine]" machine # [ 32.973712] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.974507] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.974951] k3s[873]: I0928 16:05:48.607980 873 server.go:1252] "Started kubelet" machine # [ 32.975981] k3s[873]: I0928 16:05:48.611333 873 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 32.980661] k3s[873]: I0928 16:05:48.615972 873 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 32.981662] k3s[873]: I0928 16:05:48.617018 873 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 32.982786] k3s[873]: I0928 16:05:48.617037 873 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 32.983886] k3s[873]: I0928 16:05:48.617117 873 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 32.984433] k3s[873]: I0928 16:05:48.617232 873 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 32.984949] k3s[873]: E0928 16:05:48.617464 873 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 32.985743] k3s[873]: E0928 16:05:48.618113 873 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 32.986584] k3s[873]: I0928 16:05:48.619488 873 server.go:317] "Adding debug handlers to kubelet server" machine # [ 32.987103] k3s[873]: I0928 16:05:48.620817 873 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 32.990639] k3s[873]: I0928 16:05:48.625987 873 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 32.994815] k3s[873]: I0928 16:05:48.630159 873 factory.go:223] Registration of the containerd container factory successfully machine # [ 32.995678] k3s[873]: I0928 16:05:48.630181 873 factory.go:223] Registration of the systemd container factory successfully machine # [ 32.996542] k3s[873]: I0928 16:05:48.630273 873 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 32.998153] k3s[873]: E0928 16:05:48.633498 873 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 32.998928] k3s[873]: I0928 16:05:48.633730 873 reconciler.go:29] "Reconciler: start to sync state" machine # [ 33.042911] k3s[873]: I0928 16:05:48.678214 873 cpu_manager.go:225] "Starting" policy="none" machine # [ 33.044155] k3s[873]: I0928 16:05:48.678234 873 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 33.044992] k3s[873]: I0928 16:05:48.678258 873 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 33.048937] k3s[873]: I0928 16:05:48.683954 873 policy_none.go:50] "Start" machine # [ 33.049892] k3s[873]: I0928 16:05:48.683986 873 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 33.050643] k3s[873]: I0928 16:05:48.684006 873 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 33.056082] k3s[873]: I0928 16:05:48.690833 873 policy_none.go:44] "Start" machine # [ 33.062252] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 33.075523] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 33.081841] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 33.083552] k3s[873]: E0928 16:05:48.718435 873 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 33.091502] k3s[873]: E0928 16:05:48.726686 873 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 33.092155] k3s[873]: I0928 16:05:48.726827 873 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 33.092840] k3s[873]: I0928 16:05:48.726858 873 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 33.097691] k3s[873]: I0928 16:05:48.729068 873 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 33.099914] k3s[873]: E0928 16:05:48.734666 873 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 33.100615] k3s[873]: E0928 16:05:48.734703 873 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 33.109769] k3s[873]: I0928 16:05:48.745060 873 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 33.117922] k3s[873]: I0928 16:05:48.753136 873 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 33.119848] k3s[873]: I0928 16:05:48.753177 873 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 33.120521] k3s[873]: I0928 16:05:48.753217 873 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 33.121091] k3s[873]: E0928 16:05:48.754289 873 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 33.195241] k3s[873]: I0928 16:05:48.830544 873 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 33.205130] k3s[873]: I0928 16:05:48.838028 873 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 33.205797] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 33.206545] k3s[873]: I0928 16:05:48.839705 873 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.207030] k3s[873]: I0928 16:05:48.839767 873 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.207549] k3s[873]: E0928 16:05:48.839794 873 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.208108] k3s[873]: I0928 16:05:48.840052 873 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 33.208569] k3s[873]: E0928 16:05:48.840078 873 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 33.213217] k3s[873]: I0928 16:05:48.848457 873 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.214087] k3s[873]: I0928 16:05:48.848516 873 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.214587] k3s[873]: E0928 16:05:48.848536 873 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.215061] k3s[873]: I0928 16:05:48.848605 873 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.215583] k3s[873]: I0928 16:05:48.848643 873 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.216029] k3s[873]: E0928 16:05:48.848658 873 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.216532] k3s[873]: I0928 16:05:48.849585 873 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 33.224067] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 33.224698] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Starting flannel with backend vxlan" machine # [ 33.226478] k3s[873]: I0928 16:05:48.861799 873 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::1894:5b8a:b4b7:43b"] machine # [ 33.227772] k3s[873]: E0928 16:05:48.863107 873 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 33.228844] k3s[873]: I0928 16:05:48.863906 873 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.239065] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 33.241242] k3s[873]: I0928 16:05:48.876604 873 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 33.244810] k3s[873]: I0928 16:05:48.880163 873 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 33.251351] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 33.251866] k3s[873]: time="2026-09-28T16:05:48Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 33.252551] k3s[873]: I0928 16:05:48.887699 873 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 33.253430] k3s[873]: I0928 16:05:48.887774 873 kube.go:537] Starting kube subnet manager machine # [ 33.272902] k3s[873]: I0928 16:05:48.908214 873 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 33.273688] k3s[873]: I0928 16:05:48.908256 873 server_linux.go:136] "Using iptables Proxier" machine # [ 33.287513] k3s[873]: I0928 16:05:48.922843 873 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 33.304950] k3s[873]: I0928 16:05:48.940209 873 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 33.305616] k3s[873]: I0928 16:05:48.940268 873 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.306150] k3s[873]: I0928 16:05:48.941483 873 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 33.306655] k3s[873]: I0928 16:05:48.941748 873 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 33.312983] k3s[873]: I0928 16:05:48.948217 873 config.go:200] "Starting service config controller" machine # [ 33.313681] k3s[873]: I0928 16:05:48.948249 873 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 33.314141] k3s[873]: I0928 16:05:48.948280 873 config.go:106] "Starting endpoint slice config controller" machine # [ 33.314621] k3s[873]: I0928 16:05:48.948294 873 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 33.315096] k3s[873]: I0928 16:05:48.948321 873 config.go:403] "Starting serviceCIDR config controller" machine # [ 33.315593] k3s[873]: I0928 16:05:48.948338 873 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 33.316402] k3s[873]: I0928 16:05:48.948862 873 config.go:309] "Starting node config controller" machine # [ 33.320098] k3s[873]: I0928 16:05:48.948877 873 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 33.320714] k3s[873]: I0928 16:05:48.948889 873 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 33.323159] k3s[873]: I0928 16:05:48.958504 873 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 33.323809] k3s[873]: I0928 16:05:48.958530 873 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.326824] k3s[873]: I0928 16:05:48.962165 873 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 33.327542] k3s[873]: I0928 16:05:48.962274 873 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 33.328164] k3s[873]: I0928 16:05:48.962289 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.328681] k3s[873]: I0928 16:05:48.962326 873 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 33.329183] k3s[873]: I0928 16:05:48.962440 873 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 33.330093] k3s[873]: I0928 16:05:48.964233 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 33.330372] k3s[873]: I0928 16:05:48.964252 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.331219] k3s[873]: I0928 16:05:48.964278 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 33.332062] k3s[873]: I0928 16:05:48.964293 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 33.351540] k3s[873]: I0928 16:05:48.986593 873 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 33.363063] k3s[873]: I0928 16:05:48.996863 873 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 33.413978] k3s[873]: I0928 16:05:49.049024 873 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 33.414781] k3s[873]: I0928 16:05:49.049059 873 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 33.427079] k3s[873]: I0928 16:05:49.062377 873 shared_informer.go:377] "Caches are synced" machine # [ 33.429530] k3s[873]: I0928 16:05:49.064364 873 shared_informer.go:377] "Caches are synced" machine # [ 33.430129] k3s[873]: I0928 16:05:49.064493 873 shared_informer.go:377] "Caches are synced" machine # [ 33.800974] k3s[873]: time="2026-09-28T16:05:49Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 33.813704] k3s[873]: I0928 16:05:49.448928 873 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 33.892393] k3s[873]: time="2026-09-28T16:05:49Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 33.963960] k3s[873]: I0928 16:05:49.599256 873 apiserver.go:52] "Watching apiserver" machine # [ 34.253075] k3s[873]: I0928 16:05:49.888283 873 kube.go:163] Node controller sync successful machine # [ 34.253516] k3s[873]: I0928 16:05:49.888378 873 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 34.259467] k3s[873]: I0928 16:05:49.894707 873 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::1894:5b8a:b4b7:43b", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::1894:5b8a:b4b7:43b", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 34.286213] (udev-worker)[1314]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.295288] k3s[873]: I0928 16:05:49.929506 873 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 34.298267] k3s[873]: I0928 16:05:49.933603 873 iptables.go:50] Starting flannel in iptables mode... machine # [ 34.298950] k3s[873]: time="2026-09-28T16:05:49Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.299960] k3s[873]: time="2026-09-28T16:05:49Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.301249] k3s[873]: time="2026-09-28T16:05:49Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 34.302360] k3s[873]: time="2026-09-28T16:05:49Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 34.303292] k3s[873]: I0928 16:05:49.933896 873 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 34.328261] systemd[1]: Created slice libcontainer container kubepods-burstable-pod9c727196_cd09_4afc_b19d_c2de208e4eb1.slice. machine # [ 34.335699] dhcpcd[688]: flannel.1: IAID da:43:06:e9 machine # [ 34.336799] dhcpcd[688]: flannel.1: adding address fe80::47f:daff:fe43:6e9 machine # [ 34.341107] systemd[1]: Created slice libcontainer container kubepods-burstable-pod6177a412_78e5_4302_bfae_8dbef1de5811.slice. machine # [ 34.389423] k3s[873]: I0928 16:05:50.024682 873 iptables.go:111] Setting up masking rules machine # [ 34.391331] k3s[873]: I0928 16:05:50.026674 873 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 34.405062] k3s[873]: I0928 16:05:50.040371 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c727196-cd09-4afc-b19d-c2de208e4eb1-config-volume\") pod \"coredns-c5fdd76cf-xjxb5\" (UID: \"9c727196-cd09-4afc-b19d-c2de208e4eb1\") " pod="kube-system/coredns-c5fdd76cf-xjxb5" machine # [ 34.406255] k3s[873]: I0928 16:05:50.041208 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c727196-cd09-4afc-b19d-c2de208e4eb1-custom-config-volume\") pod \"coredns-c5fdd76cf-xjxb5\" (UID: \"9c727196-cd09-4afc-b19d-c2de208e4eb1\") " pod="kube-system/coredns-c5fdd76cf-xjxb5" machine # [ 34.406889] k3s[873]: I0928 16:05:50.041314 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvznp\" (UniqueName: \"kubernetes.io/projected/9c727196-cd09-4afc-b19d-c2de208e4eb1-kube-api-access-vvznp\") pod \"coredns-c5fdd76cf-xjxb5\" (UID: \"9c727196-cd09-4afc-b19d-c2de208e4eb1\") " pod="kube-system/coredns-c5fdd76cf-xjxb5" machine # [ 34.407578] k3s[873]: I0928 16:05:50.041379 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-helm\") pod \"helm-install-nix-grpc-farm-rsh8v\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " pod="kube-system/helm-install-nix-grpc-farm-rsh8v" machine # [ 34.408934] k3s[873]: I0928 16:05:50.041447 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-tmp\") pod \"helm-install-nix-grpc-farm-rsh8v\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " pod="kube-system/helm-install-nix-grpc-farm-rsh8v" machine # [ 34.409897] k3s[873]: I0928 16:05:50.041475 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-values\") pod \"helm-install-nix-grpc-farm-rsh8v\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " pod="kube-system/helm-install-nix-grpc-farm-rsh8v" machine # [ 34.410717] k3s[873]: I0928 16:05:50.041499 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-cache\") pod \"helm-install-nix-grpc-farm-rsh8v\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " pod="kube-system/helm-install-nix-grpc-farm-rsh8v" machine # [ 34.411632] k3s[873]: I0928 16:05:50.041524 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-config\") pod \"helm-install-nix-grpc-farm-rsh8v\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " pod="kube-system/helm-install-nix-grpc-farm-rsh8v" machine # [ 34.412522] k3s[873]: I0928 16:05:50.043648 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/6177a412-78e5-4302-bfae-8dbef1de5811-content\") pod \"helm-install-nix-grpc-farm-rsh8v\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " pod="kube-system/helm-install-nix-grpc-farm-rsh8v" machine # [ 34.413515] k3s[873]: I0928 16:05:50.043728 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tfp9\" (UniqueName: \"kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-kube-api-access-4tfp9\") pod \"helm-install-nix-grpc-farm-rsh8v\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " pod="kube-system/helm-install-nix-grpc-farm-rsh8v" machine # [ 34.416107] k3s[873]: I0928 16:05:50.051396 873 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 34.460130] k3s[873]: time="2026-09-28T16:05:50Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 34.461782] k3s[873]: time="2026-09-28T16:05:50Z" level=info msg="Running flannel backend" machine # [ 34.462920] k3s[873]: I0928 16:05:50.095095 873 vxlan_network.go:68] watching for new subnet leases machine # [ 34.464205] k3s[873]: I0928 16:05:50.095134 873 vxlan_network.go:115] starting vxlan device watcher machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.512186] k3s[873]: I0928 16:05:50.147440 873 iptables.go:358] bootstrap done machine # [ 34.557885] k3s[873]: I0928 16:05:50.193197 873 iptables.go:358] bootstrap done machine # [ 34.862668] cni0: port 1(veth928303a8) entered blocking state machine # [ 34.863417] cni0: port 1(veth928303a8) entered disabled state machine # [ 34.864136] veth928303a8: entered allmulticast mode machine # [ 34.865013] veth928303a8: entered promiscuous mode machine # [ 34.712735] (udev-worker)[1401]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.713764] (udev-worker)[1505]: Network interface NamePolicy= disabled on kernel command line. machine # [ 34.871437] cni0: port 2(veth04f61b69) entered blocking state machine # [ 34.872189] cni0: port 2(veth04f61b69) entered disabled state machine # [ 34.875644] veth04f61b69: entered allmulticast mode machine # [ 34.876460] veth04f61b69: entered promiscuous mode machine # [ 34.877507] cni0: port 1(veth928303a8) entered blocking state machine # [ 34.878203] cni0: port 1(veth928303a8) entered forwarding state machine # [ 34.892568] cni0: port 2(veth04f61b69) entered blocking state machine # [ 34.893250] cni0: port 2(veth04f61b69) entered forwarding state machine # [ 34.772436] dhcpcd[688]: veth04f61b69: waiting for carrier machine # [ 34.790182] dhcpcd[688]: veth928303a8: IAID cc:4d:8b:6f machine # [ 34.791119] dhcpcd[688]: veth928303a8: adding address fe80::ecd1:ccff:fe4d:8b6f machine # [ 34.791677] dhcpcd[688]: veth04f61b69: carrier acquired machine # [ 34.799088] dhcpcd[688]: veth04f61b69: IAID f1:d6:23:e8 machine # [ 34.799863] dhcpcd[688]: veth04f61b69: adding address fe80::2ceb:f1ff:fed6:23e8 machine # [ 34.928538] systemd[1]: Started libcontainer container ef6498b951e2d9f05b2aeae93198c7a854644fe6e665c5097bc31cbcded728d9. machine # [ 34.938448] systemd[1]: Started libcontainer container e5a7a5a6e9da8a64fb794b990cfab9423d0ce93c0a950cefb9ba3ff0c369f84d. machine # [ 35.462710] dhcpcd[688]: veth928303a8: soliciting a DHCP lease machine # [ 35.579131] dhcpcd[688]: flannel.1: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.786951] k3s[873]: time="2026-09-28T16:05:51Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 35.787726] k3s[873]: I0928 16:05:51.421747 873 network_policy_controller.go:164] Starting network policy controller machine # [ 35.930702] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount723986711.mount: Deactivated successfully. machine # [ 35.974409] systemd[1]: Started libcontainer container 7c079816f1f7ca137ea57bef59100916cee7947708bcefb43010ff600971821a. machine # [ 36.077212] k3s[873]: I0928 16:05:51.712171 873 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 36.150829] k3s[873]: I0928 16:05:51.786085 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-xjxb5" podStartSLOduration=7.786061493 podStartE2EDuration="7.786061493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:05:51.785134839 +0000 UTC m=+19.632470606" watchObservedRunningTime="2026-09-28 16:05:51.786061493 +0000 UTC m=+19.633396981" machine # [ 36.163266] dhcpcd[688]: veth04f61b69: soliciting a DHCP lease machine # [ 36.210360] systemd[1]: Started libcontainer container 2beec72e5fe7481218b2bbc8fbeb9c8214e441ae7e3125d7f0d50d7417b6280a. machine # [ 36.456521] dhcpcd[688]: flannel.1: soliciting an IPv6 router machine # [ 36.764441] dhcpcd[688]: veth928303a8: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.856102] dhcpcd[688]: veth04f61b69: soliciting an IPv6 router machine # [ 37.123415] k3s[873]: I0928 16:05:52.758357 873 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.31.80"} machine # [ 37.175722] systemd[1]: cri-containerd-2beec72e5fe7481218b2bbc8fbeb9c8214e441ae7e3125d7f0d50d7417b6280a.scope: Deactivated successfully. machine # [ 37.176593] systemd[1]: cri-containerd-2beec72e5fe7481218b2bbc8fbeb9c8214e441ae7e3125d7f0d50d7417b6280a.scope: Consumed 590ms CPU time over 964ms wall clock time, 31.5M memory peak, 2.4M incoming IP traffic, 150.2K outgoing IP traffic. machine # [ 37.227092] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2beec72e5fe7481218b2bbc8fbeb9c8214e441ae7e3125d7f0d50d7417b6280a-rootfs.mount: Deactivated successfully. machine # [ 37.233182] k3s[873]: I0928 16:05:52.867225 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-rsh8v" podStartSLOduration=7.867197782 podStartE2EDuration="7.867197782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:05:52.826843212 +0000 UTC m=+20.674178980" watchObservedRunningTime="2026-09-28 16:05:52.867197782 +0000 UTC m=+20.714533270" machine # [ 37.281098] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod7c20d8f6_b819_486f_a095_27a351f397de.slice. machine # [ 37.305080] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9addec3b_2cb8_4ef6_a902_4a7ca3e428d3.slice. machine # [ 37.321137] systemd[1]: Created slice libcontainer container kubepods-besteffort-poddcf47da1_dfa5_49bb_8c14_f1df0d67a6a9.slice. machine # [ 37.324858] k3s[873]: I0928 16:05:52.960187 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2\" (UID: \"dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" machine # [ 37.325376] k3s[873]: I0928 16:05:52.960237 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2\" (UID: \"dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" machine # [ 37.326084] k3s[873]: I0928 16:05:52.960267 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfqrp\" (UniqueName: \"kubernetes.io/projected/7c20d8f6-b819-486f-a095-27a351f397de-kube-api-access-qfqrp\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk\" (UID: \"7c20d8f6-b819-486f-a095-27a351f397de\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" machine # [ 37.326535] k3s[873]: I0928 16:05:52.960297 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28rl7\" (UniqueName: \"kubernetes.io/projected/9addec3b-2cb8-4ef6-a902-4a7ca3e428d3-kube-api-access-28rl7\") pod \"nix-grpc-farm-scheduler-c5d75967-94fln\" (UID: \"9addec3b-2cb8-4ef6-a902-4a7ca3e428d3\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-94fln" machine # [ 37.327405] k3s[873]: I0928 16:05:52.960362 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-config\") pod \"nix-grpc-farm-lb-75b44f88dd-z8tz9\" (UID: \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-z8tz9" machine # [ 37.327995] k3s[873]: I0928 16:05:52.960387 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7c20d8f6-b819-486f-a095-27a351f397de-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk\" (UID: \"7c20d8f6-b819-486f-a095-27a351f397de\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" machine # [ 37.328343] k3s[873]: I0928 16:05:52.960436 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2\" (UID: \"dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" machine # [ 37.328840] k3s[873]: I0928 16:05:52.960466 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2\" (UID: \"dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" machine # [ 37.329338] k3s[873]: I0928 16:05:52.960491 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2\" (UID: \"dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" machine # [ 37.329838] k3s[873]: I0928 16:05:52.960561 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-z8tz9\" (UID: \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-z8tz9" machine # [ 37.330556] k3s[873]: I0928 16:05:52.960586 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-z8tz9\" (UID: \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-z8tz9" machine # [ 37.331031] k3s[873]: I0928 16:05:52.960628 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7c20d8f6-b819-486f-a095-27a351f397de-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk\" (UID: \"7c20d8f6-b819-486f-a095-27a351f397de\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" machine # [ 37.334231] k3s[873]: I0928 16:05:52.960655 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/9addec3b-2cb8-4ef6-a902-4a7ca3e428d3-niks3-token\") pod \"nix-grpc-farm-scheduler-c5d75967-94fln\" (UID: \"9addec3b-2cb8-4ef6-a902-4a7ca3e428d3\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-94fln" machine # [ 37.338429] k3s[873]: I0928 16:05:52.960682 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/7c20d8f6-b819-486f-a095-27a351f397de-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk\" (UID: \"7c20d8f6-b819-486f-a095-27a351f397de\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" machine # [ 37.379798] k3s[873]: I0928 16:05:52.960705 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/7c20d8f6-b819-486f-a095-27a351f397de-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk\" (UID: \"7c20d8f6-b819-486f-a095-27a351f397de\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" machine # [ 37.380350] k3s[873]: I0928 16:05:52.960730 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2\" (UID: \"dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" machine # [ 37.380959] k3s[873]: I0928 16:05:52.960763 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/9addec3b-2cb8-4ef6-a902-4a7ca3e428d3-tls\") pod \"nix-grpc-farm-scheduler-c5d75967-94fln\" (UID: \"9addec3b-2cb8-4ef6-a902-4a7ca3e428d3\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-94fln" machine # [ 37.381641] k3s[873]: I0928 16:05:52.960790 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2\" (UID: \"dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" machine # [ 37.382215] k3s[873]: I0928 16:05:52.960817 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn7mv\" (UniqueName: \"kubernetes.io/projected/dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9-kube-api-access-tn7mv\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2\" (UID: \"dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" machine # [ 37.382762] k3s[873]: I0928 16:05:52.960841 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/7c20d8f6-b819-486f-a095-27a351f397de-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk\" (UID: \"7c20d8f6-b819-486f-a095-27a351f397de\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" machine # [ 37.383420] k3s[873]: I0928 16:05:52.960868 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9addec3b-2cb8-4ef6-a902-4a7ca3e428d3-ca\") pod \"nix-grpc-farm-scheduler-c5d75967-94fln\" (UID: \"9addec3b-2cb8-4ef6-a902-4a7ca3e428d3\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-94fln" machine # [ 37.383886] k3s[873]: I0928 16:05:52.960894 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/9addec3b-2cb8-4ef6-a902-4a7ca3e428d3-oidc\") pod \"nix-grpc-farm-scheduler-c5d75967-94fln\" (UID: \"9addec3b-2cb8-4ef6-a902-4a7ca3e428d3\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-94fln" machine # [ 37.384544] k3s[873]: I0928 16:05:52.960922 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2\" (UID: \"dcf47da1-dfa5-49bb-8c14-f1df0d67a6a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" machine # [ 37.385026] k3s[873]: I0928 16:05:52.960944 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/7c20d8f6-b819-486f-a095-27a351f397de-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk\" (UID: \"7c20d8f6-b819-486f-a095-27a351f397de\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" machine # [ 37.385523] k3s[873]: I0928 16:05:52.960968 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/7c20d8f6-b819-486f-a095-27a351f397de-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk\" (UID: \"7c20d8f6-b819-486f-a095-27a351f397de\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" machine # [ 37.387128] k3s[873]: I0928 16:05:52.960993 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-z8tz9\" (UID: \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-z8tz9" machine # [ 37.390985] k3s[873]: I0928 16:05:52.961015 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/7c20d8f6-b819-486f-a095-27a351f397de-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk\" (UID: \"7c20d8f6-b819-486f-a095-27a351f397de\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" machine # [ 37.455968] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6d8ee43f_94b2_4e20_b40e_9ebc2375a277.slice. machine # [ 38.111488] cni0: port 3(veth3d2a686d) entered blocking state machine # [ 37.957314] ([ 38.112145] cni0: port 3(veth3d2a686d) entered disabled state machine # udev-worker)[1903]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.114308] veth3d2a686d: entered allmulticast mode machine # [ 38.114997] veth3d2a686d: entered promiscuous mode machine # [ 37.969983] (udev-worker)[2061]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.128404] cni0: port 4(veth784643ab) entered blocking state machine # [ 38.129069] cni0: port 4(veth784643ab) entered disabled state machine # [ 38.131258] veth784643ab: entered allmulticast mode machine # [ 38.131955] veth784643ab: entered promiscuous mode machine # [ 38.133649] cni0: port 3(veth3d2a686d) entered blocking state machine # [ 38.134358] cni0: port 3(veth3d2a686d) entered forwarding state machine # [ 38.147936] cni0: port 5(veth73b72a08) entered blocking state machine # [ 38.148769] cni0: port 5(veth73b72a08) entered disabled state machine # [ 38.149541] veth73b72a08: entered allmulticast mode machine # [ 38.151798] veth73b72a08: entered promiscuous mode machine # [ 38.159017] cni0: port 4(veth784643ab) entered blocking state machine # [ 38.159715] cni0: port 4(veth784643ab) entered forwarding state machine # [ 38.008140] (udev-worker)[2091]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.010193] dhcpcd[688]: veth3d2a686d: IAID bb:71:59:55 machine # [ 38.010895] dhcpcd[688]: veth3d2a686d: adding address fe80::a46d:bbff:fe71:5955 machine # [ 38.025483] dhcpcd[688]: veth784643ab: IAID 0d:75:17:47 machine # [ 38.025975] dhcpcd[688]: veth784643ab: adding address fe80::6c12:dff:fe75:1747 machine # [ 38.026815] dhcpcd[688]: veth784643ab: carrier lost machine # [ 38.191577] cni0: port 5(veth73b72a08) entered blocking state machine # [ 38.192234] cni0: port 5(veth73b72a08) entered forwarding state machine # [ 38.060661] dhcpcd[688]: veth784643ab: deleting address fe80::6c12:dff:fe75:1747 machine # [ 38.072786] dhcpcd[688]: veth73b72a08: IAID e7:8c:d2:6f machine # [ 38.073768] dhcpcd[688]: veth73b72a08: adding address fe80::bce1:e7ff:fe8c:d26f machine # [ 38.074538] dhcpcd[688]: veth73b72a08: old hardware address: be:e1:e7:8c:d2:6f machine # [ 38.075135] dhcpcd[688]: veth73b72a08: new hardware address: a6:17:56:a7:43:e4 machine # [ 38.076152] dhcpcd[688]: veth73b72a08: carrier lost machine # [ 38.099773] k3s[873]: I0928 16:05:53.735023 873 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.102155] k3s[873]: I0928 16:05:53.735134 873 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.103348] k3s[873]: I0928 16:05:53.737641 873 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.108589] dhcpcd[688]: veth73b72a08: deleting address fe80::bce1:e7ff:fe8c:d26f machine # [ 38.109111] dhcpcd[688]: veth3d2a686d: soliciting a DHCP lease machine # [ 38.113652] dhcpcd[688]: veth784643ab: carrier acquired machine # [ 38.274739] cni0: port 6(vethe1b8325c) entered blocking state machine # [ 38.275630] cni0: port 6(vethe1b8325c) entered disabled state machine # [ 38.276358] vethe1b8325c: entered allmulticast mode machine # [ 38.277093] vethe1b8325c: entered promiscuous mode machine # [ 38.125022] dhcpcd[688]: veth784643ab: IAID 0d:75:17:47 machine # [ 38.125692] dhcpcd[688]: veth784643ab: adding address fe80::6c12:dff:fe75:1747 machine # [ 38.126511] dhcpcd[688]: veth73b72a08: carrier acquired machine # [ 38.290513] cni0: port 6(vethe1b8325c) entered blocking state machine # [ 38.291606] cni0: port 6(vethe1b8325c) entered forwarding state machine # [ 38.139207] dhcpcd[688]: veth73b72a08: IAID 56:a7:43:e4 machine # [ 38.139986] dhcpcd[688]: veth73b72a08: adding address fe80::a417:56ff:fea7:43e4 machine # [ 38.155051] dhcpcd[688]: vethe1b8325c: IAID 24:a3:e1:fe machine # [ 38.155824] dhcpcd[688]: vethe1b8325c: adding address fe80::ce6:24ff:fea3:e1fe machine # [ 38.156456] dhcpcd[688]: vethe1b8325c: old hardware address: 0e:e6:24:a3:e1:fe machine # [ 38.156993] dhcpcd[688]: vethe1b8325c: new hardware address: d6:08:f6:67:32:e7 machine # [ 38.158703] dhcpcd[688]: vethe1b8325c: carrier lost machine # [ 38.175434] systemd[1]: Started libcontainer container 9dda59577a555a66c6f4f0d45a0fd928564c2426b0de74631f6756444a20af0c. machine # [ 38.184353] dhcpcd[688]: vethe1b8325c: deleting address fe80::ce6:24ff:fea3:e1fe machine # [ 38.185093] dhcpcd[688]: vethe1b8325c: old hardware address: d6:08:f6:67:32:e7 machine # [ 38.185627] dhcpcd[688]: vethe1b8325c: new hardware address: 0e:e6:24:a3:e1:fe machine # [ 38.186160] dhcpcd[688]: vethe1b8325c: carrier acquired machine # [ 38.195459] dhcpcd[688]: vethe1b8325c: IAID 24:a3:e1:fe machine # [ 38.197710] dhcpcd[688]: vethe1b8325c: adding address fe80::ce6:24ff:fea3:e1fe machine # [ 38.239531] systemd[1]: Started libcontainer container 4304b626a52f93d9efb410e924cf3608ccb38e4a445d175b70a374c9d1f020c3. machine # [ 38.271419] systemd[1]: Started libcontainer container 383283afe4391a78697a222ca42c590c998fa6ed10ecd98b4546de3873b8196d. machine # [ 38.299237] systemd[1]: Started libcontainer container ac720d2b2f9e41d274bc154def58da8551e22c5c9b165f5a2a0f691e84b53c42. machine # [ 38.312472] k3s[873]: E0928 16:05:53.947545 873 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.313157] k3s[873]: E0928 16:05:53.948508 873 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.314831] k3s[873]: E0928 16:05:53.949998 873 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-c5d75967-94fln_farm(9addec3b-2cb8-4ef6-a902-4a7ca3e428d3): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 38.315655] k3s[873]: E0928 16:05:53.950960 873 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-c5d75967-94fln" podUID="9addec3b-2cb8-4ef6-a902-4a7ca3e428d3" machine # [ 38.364662] k3s[873]: E0928 16:05:53.999933 873 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.365125] k3s[873]: E0928 16:05:53.999988 873 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.365391] k3s[873]: E0928 16:05:54.000220 873 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk_farm(7c20d8f6-b819-486f-a095-27a351f397de): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 38.368065] k3s[873]: E0928 16:05:54.000299 873 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" podUID="7c20d8f6-b819-486f-a095-27a351f397de" machine # [ 38.391571] k3s[873]: time="2026-09-28T16:05:54Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 38.401091] k3s[873]: time="2026-09-28T16:05:54Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:5e63485551eff26b3ab5b591ca46cbd60d199c4b33350f3354964222db6b4465" machine # [ 39.164553] systemd[1]: Started libcontainer container 8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0. machine # [ 39.227527] systemd[1]: cri-containerd-e5a7a5a6e9da8a64fb794b990cfab9423d0ce93c0a950cefb9ba3ff0c369f84d.scope: Deactivated successfully. machine # [ 39.260625] dhcpcd[688]: vethe1b8325c: soliciting a DHCP lease machine # [ 39.438630] dhcpcd[688]: veth784643ab: soliciting a DHCP lease machine # [ 39.469367] dhcpcd[688]: veth73b72a08: soliciting a DHCP lease machine # [ 39.480173] k3s[873]: time="2026-09-28T16:05:55Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 6.718893881s" machine # [ 39.644976] cni0: port 1(veth928303a8) entered disabled state machine # [ 39.490909] dhcpcd[688]: veth928303a8: carrier lost machine # [ 39.647156] veth928303a8 (unregistering): left allmulticast mode machine # [ 39.648581] veth928303a8 (unregistering): left promiscuous mode machine # [ 39.649709] cni0: port 1(veth928303a8) entered disabled state machine # [ 39.518360] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4032098463.mount: Deactivated successfully. machine # [ 39.518931] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e5a7a5a6e9da8a64fb794b990cfab9423d0ce93c0a950cefb9ba3ff0c369f84d-rootfs.mount: Deactivated successfully. machine # [ 39.519399] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-e5a7a5a6e9da8a64fb794b990cfab9423d0ce93c0a950cefb9ba3ff0c369f84d-shm.mount: Deactivated successfully. machine # [ 39.525919] systemd[1]: run-netns-cni\x2d82ef4e76\x2d3806\x2d58d4\x2d9bb3\x2dbce723407920.mount: Deactivated successfully. machine # [ 39.529415] dhcpcd[688]: veth928303a8: deleting address fe80::ecd1:ccff:fe4d:8b6f machine # [ 39.569362] dhcpcd[688]: veth928303a8: removing interface machine # [ 39.650264] k3s[873]: I0928 16:05:55.285555 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-values\" (UniqueName: \"kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-values\") pod \"6177a412-78e5-4302-bfae-8dbef1de5811\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " machine # [ 39.650681] k3s[873]: I0928 16:05:55.285608 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-kube-api-access-4tfp9\" (UniqueName: \"kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-kube-api-access-4tfp9\") pod \"6177a412-78e5-4302-bfae-8dbef1de5811\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " machine # [ 39.651613] k3s[873]: I0928 16:05:55.285646 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-config\") pod \"6177a412-78e5-4302-bfae-8dbef1de5811\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " machine # [ 39.652658] k3s[873]: I0928 16:05:55.285673 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6177a412-78e5-4302-bfae-8dbef1de5811-content\" (UniqueName: \"kubernetes.io/configmap/6177a412-78e5-4302-bfae-8dbef1de5811-content\") pod \"6177a412-78e5-4302-bfae-8dbef1de5811\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " machine # [ 39.653260] k3s[873]: I0928 16:05:55.285719 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-tmp\") pod \"6177a412-78e5-4302-bfae-8dbef1de5811\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " machine # [ 39.653722] k3s[873]: I0928 16:05:55.285767 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-cache\") pod \"6177a412-78e5-4302-bfae-8dbef1de5811\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " machine # [ 39.654208] k3s[873]: I0928 16:05:55.285800 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-helm\") pod \"6177a412-78e5-4302-bfae-8dbef1de5811\" (UID: \"6177a412-78e5-4302-bfae-8dbef1de5811\") " machine # [ 39.658811] systemd[1]: var-lib-kubelet-pods-6177a412\x2d78e5\x2d4302\x2dbfae\x2d8dbef1de5811-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d4tfp9.mount: Deactivated successfully. machine # [ 39.659734] systemd[1]: var-lib-kubelet-pods-6177a412\x2d78e5\x2d4302\x2dbfae\x2d8dbef1de5811-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 39.689260] dhcpcd[688]: veth3d2a686d: soliciting an IPv6 router machine # [ 39.696073] systemd[1]: var-lib-kubelet-pods-6177a412\x2d78e5\x2d4302\x2dbfae\x2d8dbef1de5811-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 39.698601] k3s[873]: I0928 16:05:55.332365 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-config" pod "6177a412-78e5-4302-bfae-8dbef1de5811" (UID: "6177a412-78e5-4302-bfae-8dbef1de5811"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.703280] k3s[873]: I0928 16:05:55.332718 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6177a412-78e5-4302-bfae-8dbef1de5811-content" pod "6177a412-78e5-4302-bfae-8dbef1de5811" (UID: "6177a412-78e5-4302-bfae-8dbef1de5811"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 39.707955] k3s[873]: I0928 16:05:55.332804 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-tmp" pod "6177a412-78e5-4302-bfae-8dbef1de5811" (UID: "6177a412-78e5-4302-bfae-8dbef1de5811"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.712982] k3s[873]: I0928 16:05:55.335810 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-cache" pod "6177a412-78e5-4302-bfae-8dbef1de5811" (UID: "6177a412-78e5-4302-bfae-8dbef1de5811"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.717145] k3s[873]: I0928 16:05:55.335958 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-kube-api-access-4tfp9" pod "6177a412-78e5-4302-bfae-8dbef1de5811" (UID: "6177a412-78e5-4302-bfae-8dbef1de5811"). InnerVolumeSpecName "kube-api-access-4tfp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 39.722096] k3s[873]: I0928 16:05:55.343810 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-helm" pod "6177a412-78e5-4302-bfae-8dbef1de5811" (UID: "6177a412-78e5-4302-bfae-8dbef1de5811"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.726802] systemd[1]: var-lib-kubelet-pods-6177a412\x2d78e5\x2d4302\x2dbfae\x2d8dbef1de5811-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 39.740268] k3s[873]: I0928 16:05:55.375576 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-values" pod "6177a412-78e5-4302-bfae-8dbef1de5811" (UID: "6177a412-78e5-4302-bfae-8dbef1de5811"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 39.751419] k3s[873]: I0928 16:05:55.386729 873 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-values\") on node \"machine\" DevicePath \"\"" machine # [ 39.754536] k3s[873]: I0928 16:05:55.386780 873 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tfp9\" (UniqueName: \"kubernetes.io/projected/6177a412-78e5-4302-bfae-8dbef1de5811-kube-api-access-4tfp9\") on node \"machine\" DevicePath \"\"" machine # [ 39.757808] k3s[873]: I0928 16:05:55.386799 873 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 39.760870] k3s[873]: I0928 16:05:55.386812 873 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/6177a412-78e5-4302-bfae-8dbef1de5811-content\") on node \"machine\" DevicePath \"\"" machine # [ 39.764403] k3s[873]: I0928 16:05:55.386826 873 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 39.767263] k3s[873]: I0928 16:05:55.386839 873 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 39.770247] k3s[873]: I0928 16:05:55.386852 873 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/6177a412-78e5-4302-bfae-8dbef1de5811-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 40.022638] dhcpcd[688]: vethe1b8325c: soliciting an IPv6 router machine # [ 40.144643] dhcpcd[688]: veth73b72a08: soliciting an IPv6 router machine # [ 40.205186] k3s[873]: I0928 16:05:55.838562 873 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5a7a5a6e9da8a64fb794b990cfab9423d0ce93c0a950cefb9ba3ff0c369f84d" machine # [ 40.217214] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod6177a412_78e5_4302_bfae_8dbef1de5811.slice. machine # [ 40.219120] systemd[1]: kubepods-burstable-pod6177a412_78e5_4302_bfae_8dbef1de5811.slice: Consumed 624ms CPU time over 5.875s wall clock time, 31.7M memory peak, 2.4M incoming IP traffic, 150.2K outgoing IP traffic. machine # [ 40.249100] k3s[873]: I0928 16:05:55.884078 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-z8tz9" podStartSLOduration=3.883577517 podStartE2EDuration="3.883577517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:05:55.873223967 +0000 UTC m=+23.720559455" watchObservedRunningTime="2026-09-28 16:05:55.883577517 +0000 UTC m=+23.731386529" machine # [ 40.456533] dhcpcd[688]: veth784643ab: soliciting an IPv6 router machine # [ 40.518499] systemd[1]: var-lib-kubelet-pods-6177a412\x2d78e5\x2d4302\x2dbfae\x2d8dbef1de5811-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 40.519651] systemd[1]: var-lib-kubelet-pods-6177a412\x2d78e5\x2d4302\x2dbfae\x2d8dbef1de5811-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 40.579608] dhcpcd[688]: flannel.1: probing for an IPv4LL address machine # [ 41.164425] dhcpcd[688]: veth04f61b69: probing for an IPv4LL address machine # [ 43.110239] dhcpcd[688]: veth3d2a686d: probing for an IPv4LL address machine # [ 43.653242] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1078002213.mount: Deactivated successfully. machine # [ 43.654767] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3267729978.mount: Deactivated successfully. machine # [ 43.715384] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1846016068.mount: Deactivated successfully. machine # [ 43.818448] systemd[1]: Started libcontainer container c5d225c0b97306a114492ee4060623113db11152aaa195c3b27f6f2fd319a2f5. machine # [ 44.173463] systemd[1]: Started libcontainer container 8c2247b636774a84b15d0b9a880564d6d00b0c8ba4f31bade759602586728c5d. machine # [ 44.262289] k3s[873]: I0928 16:05:59.896069 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-c5d75967-94fln" podStartSLOduration=7.004311018 podStartE2EDuration="7.896046141s" totalImagesPullingTime="891.735123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:05:59.895731855 +0000 UTC m=+27.743067343" watchObservedRunningTime="2026-09-28 16:05:59.896046141 +0000 UTC m=+27.743381629" machine # [ 44.264790] dhcpcd[688]: vethe1b8325c: probing for an IPv4LL address machine # [ 44.367568] systemd[1]: Started libcontainer container 5ebb1ca471097d3d3835c6b8c5c938661baed30ee3aa714f69f306e60409e2d5. machine # [ 44.439438] dhcpcd[688]: veth784643ab: probing for an IPv4LL address machine # [ 44.465337] niks3-server[1163]: 2026/09/28 16:06:00 INFO lead: acquired remote=10.42.0.4:52846 machine # [ 44.470206] dhcpcd[688]: veth73b72a08: probing for an IPv4LL address machine # [ 44.648936] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2147067250.mount: Deactivated successfully. machine # [ 45.605711] dhcpcd[688]: flannel.1: using IPv4LL address 169.254.40.253 machine # [ 45.607096] dhcpcd[688]: flannel.1: adding route to 169.254.0.0/16 machine # [ 45.976850] systemd[1]: cri-containerd-c5d225c0b97306a114492ee4060623113db11152aaa195c3b27f6f2fd319a2f5.scope: Deactivated successfully. machine # [ 45.982103] systemd[1]: cri-containerd-c5d225c0b97306a114492ee4060623113db11152aaa195c3b27f6f2fd319a2f5.scope: Consumed 859ms CPU time over 2.157s wall clock time, 434.5M memory peak, 192M read from disk, 124.5M written to disk. machine # [ 45.989889] systemd[1]: cri-containerd-5ebb1ca471097d3d3835c6b8c5c938661baed30ee3aa714f69f306e60409e2d5.scope: Deactivated successfully. machine # [ 45.997637] systemd[1]: cri-containerd-5ebb1ca471097d3d3835c6b8c5c938661baed30ee3aa714f69f306e60409e2d5.scope: Consumed 720ms CPU time over 1.627s wall clock time, 341.9M memory peak, 46.6M read from disk, 158.6M written to disk. machine # [ 46.038580] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-5ebb1ca471097d3d3835c6b8c5c938661baed30ee3aa714f69f306e60409e2d5-rootfs.mount: Deactivated successfully. machine # [ 46.047949] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c5d225c0b97306a114492ee4060623113db11152aaa195c3b27f6f2fd319a2f5-rootfs.mount: Deactivated successfully. machine # [ 46.223684] dhcpcd[688]: veth04f61b69: using IPv4LL address 169.254.89.138 machine # [ 46.227742] dhcpcd[688]: veth04f61b69: adding route to 169.254.0.0/16 machine # [ 47.399750] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2262395929.mount: Deactivated successfully. machine # [ 47.401474] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3012485249.mount: Deactivated successfully. machine # [ 47.649471] systemd[1]: Started libcontainer container 167d55129e891f6c370be5eccca718180aec8de23eed045f2f80e1e8a4a86bf9. machine # [ 47.691343] systemd[1]: Started libcontainer container 42e77e6540a5a024cbef50adc938ddbf751011edafe12fa2b773b12d8ff4993e. machine # [ 47.841352] systemd[1]: Started libcontainer container 13187b99529f1ee3eb05dd2719cf72d1ad4c28981acc0ed14779f829a5c4006b. machine # [ 47.875299] systemd[1]: Started libcontainer container cf0094326bcd69a4b85d05d7608f01049fd31601d9a2ef301a2bdd667b516e1f. machine # error: timed out waiting for the condition machine # [ 48.055638] systemd[1]: Started libcontainer container 6658854e914d8e246bad61d3d04e28725dae905a98d2e6adacc2b82c7926275c. machine # [ 48.112313] systemd[1]: Started libcontainer container eff84e8b5844900b3d25f746942dc79ad58e67cc5edf9e9bcce332ab45463e53. machine # [ 48.305995] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount485052018.mount: Deactivated successfully. machine # [ 48.308215] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3575406058.mount: Deactivated successfully. machine # [ 48.317885] k3s[873]: I0928 16:06:03.952520 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2" podStartSLOduration=9.812650346 podStartE2EDuration="11.95247929s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.139828944s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:06:03.94928922 +0000 UTC m=+31.796630016" watchObservedRunningTime="2026-09-28 16:06:03.95247929 +0000 UTC m=+31.799818969" machine # [ 48.340311] k3s[873]: I0928 16:06:03.975545 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk" podStartSLOduration=9.560600714 podStartE2EDuration="11.975519369s" totalImagesPullingTime="834.768385ms" totalInitContainerRuntime="1.58015027s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:06:03.975007852 +0000 UTC m=+31.822343619" watchObservedRunningTime="2026-09-28 16:06:03.975519369 +0000 UTC m=+31.822854857" machine # [ 48.459795] dhcpcd[688]: flannel.1: no IPv6 Routers available machine # [ 48.841858] dhcpcd[688]: veth73b72a08: using IPv4LL address 169.254.186.25 machine # [ 48.844522] dhcpcd[688]: veth73b72a08: adding route to 169.254.0.0/16 machine # [ 48.891176] dhcpcd[688]: veth04f61b69: no IPv6 Routers available machine # [ 49.014634] dhcpcd[688]: veth3d2a686d: using IPv4LL address 169.254.136.147 machine # [ 49.016230] dhcpcd[688]: veth3d2a686d: adding route to 169.254.0.0/16 machine # [ 49.216922] dhcpcd[688]: vethe1b8325c: using IPv4LL address 169.254.154.34 machine # [ 49.217803] dhcpcd[688]: vethe1b8325c: adding route to 169.254.0.0/16 machine # [ 49.348145] dhcpcd[688]: veth784643ab: using IPv4LL address 169.254.182.238 machine # [ 49.350365] dhcpcd[688]: veth784643ab: adding route to 169.254.0.0/16 machine # [ 51.694714] dhcpcd[688]: veth3d2a686d: no IPv6 Routers available machine # [ 52.024816] dhcpcd[688]: vethe1b8325c: no IPv6 Routers available machine # [ 52.148193] dhcpcd[688]: veth73b72a08: no IPv6 Routers available machine # [ 52.460736] dhcpcd[688]: veth784643ab: no IPv6 Routers available machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 30.41 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.22 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.17 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.05 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.31 seconds) machine: waiting for success: test $(curl -sf 10.42.0.7:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.7:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.08 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.19 seconds) machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 31.47 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.15 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.16 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 120.564266] niks3-server[1163]: 2026/09/28 16:07:16 INFO Received push request method=POST path=/api/pushes machine # [ 120.592973] niks3-server[1163]: 2026/09/28 16:07:16 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 120.601961] niks3-server[1163]: 2026/09/28 16:07:16 INFO Signed narinfos id=1 count=1 machine # [ 120.607342] niks3-server[1163]: 2026/09/28 16:07:16 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 120.617522] niks3-server[1163]: 2026/09/28 16:07:16 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 120.621523] niks3-server[1163]: 2026/09/28 16:07:16 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 120.626725] niks3-server[1163]: 2026/09/28 16:07:16 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 145.345070] niks3-server[1163]: 2026/09/28 16:07:40 INFO Received push request method=POST path=/api/pushes machine # [ 145.370836] niks3-server[1163]: 2026/09/28 16:07:41 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 145.373927] niks3-server[1163]: 2026/09/28 16:07:41 INFO Signed narinfos id=2 count=1 machine # [ 145.379403] niks3-server[1163]: 2026/09/28 16:07:41 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 145.382793] niks3-server[1163]: 2026/09/28 16:07:41 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 145.383797] niks3-server[1163]: 2026/09/28 16:07:41 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 145.384794] niks3-server[1163]: 2026/09/28 16:07:41 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 145.396127] niks3-server[1163]: 2026/09/28 16:07:41 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 145.453484] niks3-server[1163]: 2026/09/28 16:07:41 INFO Received push request method=POST path=/api/pushes machine # [ 145.466838] niks3-server[1163]: 2026/09/28 16:07:41 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 145.468866] niks3-server[1163]: 2026/09/28 16:07:41 INFO Signed narinfos id=3 count=1 machine # [ 145.471497] niks3-server[1163]: 2026/09/28 16:07:41 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 145.472805] niks3-server[1163]: 2026/09/28 16:07:41 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 145.476373] niks3-server[1163]: 2026/09/28 16:07:41 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 145.478978] niks3-server[1163]: 2026/09/28 16:07:41 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 170.191668] niks3-server[1163]: 2026/09/28 16:08:05 INFO Received push request method=POST path=/api/pushes machine # [ 170.211698] niks3-server[1163]: 2026/09/28 16:08:05 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 170.216182] niks3-server[1163]: 2026/09/28 16:08:05 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 170.220493] niks3-server[1163]: 2026/09/28 16:08:05 INFO Signed narinfos id=4 count=1 machine # [ 170.223359] niks3-server[1163]: 2026/09/28 16:08:05 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 170.227568] niks3-server[1163]: 2026/09/28 16:08:05 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 170.231824] niks3-server[1163]: 2026/09/28 16:08:05 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 170.235233] niks3-server[1163]: 2026/09/28 16:08:05 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 170.305094] niks3-server[1163]: 2026/09/28 16:08:05 INFO Received push request method=POST path=/api/pushes machine # [ 170.319207] niks3-server[1163]: 2026/09/28 16:08:05 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 170.321075] niks3-server[1163]: 2026/09/28 16:08:05 INFO Signed narinfos id=5 count=1 machine # [ 170.323034] niks3-server[1163]: 2026/09/28 16:08:05 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 170.326454] niks3-server[1163]: 2026/09/28 16:08:05 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 170.328547] niks3-server[1163]: 2026/09/28 16:08:05 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 170.332818] niks3-server[1163]: 2026/09/28 16:08:05 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 194.844247] niks3-server[1163]: 2026/09/28 16:08:30 INFO Received push request method=POST path=/api/pushes machine # [ 194.861757] niks3-server[1163]: 2026/09/28 16:08:30 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 194.864206] niks3-server[1163]: 2026/09/28 16:08:30 INFO Signed narinfos id=6 count=1 machine # [ 194.869944] niks3-server[1163]: 2026/09/28 16:08:30 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 194.872144] niks3-server[1163]: 2026/09/28 16:08:30 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 194.876482] niks3-server[1163]: 2026/09/28 16:08:30 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 194.881731] niks3-server[1163]: 2026/09/28 16:08:30 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 194.886738] niks3-server[1163]: 2026/09/28 16:08:30 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 136.23 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.18 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 195.543564] niks3-server[1163]: 2026/09/28 16:08:31 INFO Received push request method=POST path=/api/pushes machine # [ 195.564362] niks3-server[1163]: 2026/09/28 16:08:31 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 195.566165] niks3-server[1163]: 2026/09/28 16:08:31 INFO Signed narinfos id=7 count=1 machine # [ 195.570099] niks3-server[1163]: 2026/09/28 16:08:31 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 195.572581] niks3-server[1163]: 2026/09/28 16:08:31 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 195.577303] niks3-server[1163]: 2026/09/28 16:08:31 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 195.580211] niks3-server[1163]: 2026/09/28 16:08:31 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 220.103305] niks3-server[1163]: 2026/09/28 16:08:55 INFO Received push request method=POST path=/api/pushes machine # [ 220.124532] niks3-server[1163]: 2026/09/28 16:08:55 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 220.126610] niks3-server[1163]: 2026/09/28 16:08:55 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 220.127882] niks3-server[1163]: 2026/09/28 16:08:55 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 220.129629] niks3-server[1163]: 2026/09/28 16:08:55 INFO Signed narinfos id=8 count=1 machine # [ 220.131219] niks3-server[1163]: 2026/09/28 16:08:55 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 220.150878] niks3-server[1163]: 2026/09/28 16:08:55 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 220.155556] niks3-server[1163]: 2026/09/28 16:08:55 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 220.217599] niks3-server[1163]: 2026/09/28 16:08:55 INFO Received push request method=POST path=/api/pushes machine # [ 220.227230] niks3-server[1163]: 2026/09/28 16:08:55 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 220.228187] niks3-server[1163]: 2026/09/28 16:08:55 INFO Signed narinfos id=9 count=1 machine # [ 220.232103] niks3-server[1163]: 2026/09/28 16:08:55 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 220.233729] niks3-server[1163]: 2026/09/28 16:08:55 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 220.236350] niks3-server[1163]: 2026/09/28 16:08:55 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 220.239181] niks3-server[1163]: 2026/09/28 16:08:55 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 244.758688] niks3-server[1163]: 2026/09/28 16:09:20 INFO Received push request method=POST path=/api/pushes machine # [ 244.775426] niks3-server[1163]: 2026/09/28 16:09:20 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 244.778984] niks3-server[1163]: 2026/09/28 16:09:20 INFO Signed narinfos id=10 count=1 machine # [ 244.781811] niks3-server[1163]: 2026/09/28 16:09:20 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 244.784550] niks3-server[1163]: 2026/09/28 16:09:20 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 244.787349] niks3-server[1163]: 2026/09/28 16:09:20 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 244.789829] niks3-server[1163]: 2026/09/28 16:09:20 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 244.795674] niks3-server[1163]: 2026/09/28 16:09:20 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 244.864236] niks3-server[1163]: 2026/09/28 16:09:20 INFO Received push request method=POST path=/api/pushes machine # [ 244.875826] niks3-server[1163]: 2026/09/28 16:09:20 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 244.876610] niks3-server[1163]: 2026/09/28 16:09:20 INFO Signed narinfos id=11 count=1 machine # [ 244.881123] niks3-server[1163]: 2026/09/28 16:09:20 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 244.883274] niks3-server[1163]: 2026/09/28 16:09:20 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 244.887192] niks3-server[1163]: 2026/09/28 16:09:20 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 244.890077] niks3-server[1163]: 2026/09/28 16:09:20 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 270.012668] niks3-server[1163]: 2026/09/28 16:09:45 INFO Received push request method=POST path=/api/pushes machine # [ 270.034681] niks3-server[1163]: 2026/09/28 16:09:45 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 270.038265] niks3-server[1163]: 2026/09/28 16:09:45 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 270.041791] niks3-server[1163]: 2026/09/28 16:09:45 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 270.046536] niks3-server[1163]: 2026/09/28 16:09:45 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 270.051703] niks3-server[1163]: 2026/09/28 16:09:45 INFO Signed narinfos id=12 count=1 machine # [ 270.063087] niks3-server[1163]: 2026/09/28 16:09:45 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 270.069989] niks3-server[1163]: 2026/09/28 16:09:45 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 75.87 seconds) (finished: subtest: build through the balancer lands in the cache, in 212.43 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.23 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.18 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.20 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 271.789401] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod53cb7a30_9810_4000_b534_29d296e57e01.slice. machine # [ 271.884285] k3s[873]: I0928 16:09:47.519250 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/53cb7a30-9810-4000-b534-29d296e57e01-job\") pod \"ci-fbqds\" (UID: \"53cb7a30-9810-4000-b534-29d296e57e01\") " pod="ci/ci-fbqds" machine # [ 271.884763] k3s[873]: I0928 16:09:47.519300 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-nix-grpc-farm\") pod \"ci-fbqds\" (UID: \"53cb7a30-9810-4000-b534-29d296e57e01\") " pod="ci/ci-fbqds" machine # [ 271.885555] k3s[873]: I0928 16:09:47.519337 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmjqw\" (UniqueName: \"kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-kube-api-access-mmjqw\") pod \"ci-fbqds\" (UID: \"53cb7a30-9810-4000-b534-29d296e57e01\") " pod="ci/ci-fbqds" machine # [ 273.179490] cni0: port 1(vethf1045427) entered blocking state machine # [ 273.180263] cni0: port 1(vethf1045427) entered disabled state machine # [ 273.185351] vethf1045427: entered allmulticast mode machine # [ 273.186576] vethf1045427: entered promiscuous mode machine # [ 273.199934] cni0: port 1(vethf1045427) entered blocking state machine # [ 273.201105] cni0: port 1(vethf1045427) entered forwarding state machine # [ 273.076090] (udev-worker)[4803]: Network interface NamePolicy= disabled on kernel command line. machine # [ 273.104311] dhcpcd[688]: vethf1045427: IAID 8b:91:5f:04 machine # [ 273.104845] dhcpcd[688]: vethf1045427: adding address fe80::18c4:8bff:fe91:5f04 machine # [ 273.143544] systemd[1]: Started libcontainer container 7741d838aaf6aad1466b04289e8bdada18fb8a85e0c97850f8ec415ea85cb496. machine # [ 274.758388] dhcpcd[688]: vethf1045427: soliciting an IPv6 router machine # [ 274.905426] dhcpcd[688]: vethf1045427: soliciting a DHCP lease machine # [ 275.137435] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount113698580.mount: Deactivated successfully. machine # [ 275.139764] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1180885111.mount: Deactivated successfully. machine # [ 275.214568] systemd[1]: Started libcontainer container 12dcc913ce5dd2b7a27e4e4ee183fb27a1ba3a4d1c2731e42da3f865800284b6. machine # [ 276.629929] niks3-server[1163]: 2026/09/28 16:09:52 INFO Received push request method=POST path=/api/pushes machine # [ 276.644840] niks3-server[1163]: 2026/09/28 16:09:52 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 276.648077] niks3-server[1163]: 2026/09/28 16:09:52 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 276.649111] niks3-server[1163]: 2026/09/28 16:09:52 INFO Signed narinfos id=13 count=1 machine # [ 276.654687] niks3-server[1163]: 2026/09/28 16:09:52 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 276.658418] niks3-server[1163]: 2026/09/28 16:09:52 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 276.663405] niks3-server[1163]: 2026/09/28 16:09:52 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 279.907800] dhcpcd[688]: vethf1045427: probing for an IPv4LL address machine # [ 284.719262] dhcpcd[688]: vethf1045427: using IPv4LL address 169.254.6.217 machine # [ 284.721782] dhcpcd[688]: vethf1045427: adding route to 169.254.0.0/16 machine # [ 286.761291] dhcpcd[688]: vethf1045427: no IPv6 Routers available machine # [ 301.783204] niks3-server[1163]: 2026/09/28 16:10:17 INFO Received push request method=POST path=/api/pushes machine # [ 301.806288] niks3-server[1163]: 2026/09/28 16:10:17 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 301.810677] niks3-server[1163]: 2026/09/28 16:10:17 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 301.812357] niks3-server[1163]: 2026/09/28 16:10:17 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 301.814106] niks3-server[1163]: 2026/09/28 16:10:17 INFO Signed narinfos id=14 count=1 machine # [ 301.817069] niks3-server[1163]: 2026/09/28 16:10:17 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 301.824272] niks3-server[1163]: 2026/09/28 16:10:17 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 301.830552] niks3-server[1163]: 2026/09/28 16:10:17 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 301.901898] niks3-server[1163]: 2026/09/28 16:10:17 INFO Received push request method=POST path=/api/pushes machine # [ 301.912508] niks3-server[1163]: 2026/09/28 16:10:17 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 301.913977] niks3-server[1163]: 2026/09/28 16:10:17 INFO Signed narinfos id=15 count=1 machine # [ 301.916968] niks3-server[1163]: 2026/09/28 16:10:17 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 301.918409] niks3-server[1163]: 2026/09/28 16:10:17 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 301.922137] niks3-server[1163]: 2026/09/28 16:10:17 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 301.927049] niks3-server[1163]: 2026/09/28 16:10:17 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 310.292672] postgres[762]: [762] LOG: checkpoint starting: time machine # [ 326.642410] niks3-server[1163]: 2026/09/28 16:10:42 INFO Received push request method=POST path=/api/pushes machine # [ 326.663930] niks3-server[1163]: 2026/09/28 16:10:42 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 326.665725] niks3-server[1163]: 2026/09/28 16:10:42 INFO Signed narinfos id=16 count=1 machine # [ 326.669211] niks3-server[1163]: 2026/09/28 16:10:42 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 326.670951] niks3-server[1163]: 2026/09/28 16:10:42 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 326.673149] niks3-server[1163]: 2026/09/28 16:10:42 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 326.681258] niks3-server[1163]: 2026/09/28 16:10:42 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 326.685767] niks3-server[1163]: 2026/09/28 16:10:42 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 326.753731] niks3-server[1163]: 2026/09/28 16:10:42 INFO Received push request method=POST path=/api/pushes machine # [ 326.764122] niks3-server[1163]: 2026/09/28 16:10:42 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 326.766376] niks3-server[1163]: 2026/09/28 16:10:42 INFO Signed narinfos id=17 count=1 machine # [ 326.768128] niks3-server[1163]: 2026/09/28 16:10:42 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 326.769489] niks3-server[1163]: 2026/09/28 16:10:42 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 326.772378] niks3-server[1163]: 2026/09/28 16:10:42 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 326.777601] niks3-server[1163]: 2026/09/28 16:10:42 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 351.497703] niks3-server[1163]: 2026/09/28 16:11:07 INFO Received push request method=POST path=/api/pushes machine # [ 351.527593] niks3-server[1163]: 2026/09/28 16:11:07 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 351.530435] niks3-server[1163]: 2026/09/28 16:11:07 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 351.534490] niks3-server[1163]: 2026/09/28 16:11:07 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 351.536193] niks3-server[1163]: 2026/09/28 16:11:07 INFO Signed narinfos id=18 count=1 machine # [ 351.537023] niks3-server[1163]: 2026/09/28 16:11:07 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 351.542348] niks3-server[1163]: 2026/09/28 16:11:07 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 351.547538] niks3-server[1163]: 2026/09/28 16:11:07 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 353.244382] niks3-server[1163]: 2026/09/28 16:11:08 INFO Received push request method=POST path=/api/pushes machine # [ 353.262843] niks3-server[1163]: 2026/09/28 16:11:08 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 353.264523] niks3-server[1163]: 2026/09/28 16:11:08 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 353.266591] niks3-server[1163]: 2026/09/28 16:11:08 INFO Signed narinfos id=19 count=1 machine # [ 353.273316] niks3-server[1163]: 2026/09/28 16:11:08 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 353.274865] niks3-server[1163]: 2026/09/28 16:11:08 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 353.279674] niks3-server[1163]: 2026/09/28 16:11:08 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 378.202876] niks3-server[1163]: 2026/09/28 16:11:33 INFO Received push request method=POST path=/api/pushes machine # [ 378.226534] niks3-server[1163]: 2026/09/28 16:11:33 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 378.228418] niks3-server[1163]: 2026/09/28 16:11:33 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 378.229733] niks3-server[1163]: 2026/09/28 16:11:33 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 378.230498] niks3-server[1163]: 2026/09/28 16:11:33 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 378.242294] niks3-server[1163]: 2026/09/28 16:11:33 INFO Signed narinfos id=20 count=1 machine # [ 378.252499] niks3-server[1163]: 2026/09/28 16:11:33 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 378.257517] niks3-server[1163]: 2026/09/28 16:11:33 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 379.439758] systemd[1]: cri-containerd-12dcc913ce5dd2b7a27e4e4ee183fb27a1ba3a4d1c2731e42da3f865800284b6.scope: Deactivated successfully. machine # [ 379.441187] systemd[1]: cri-containerd-12dcc913ce5dd2b7a27e4e4ee183fb27a1ba3a4d1c2731e42da3f865800284b6.scope: Consumed 1.089s CPU time over 1min 44.224s wall clock time, 125.2M memory peak, 55.8M read from disk, 428K written to disk, 18.3K incoming IP traffic, 44.9K outgoing IP traffic. machine # [ 379.498731] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-12dcc913ce5dd2b7a27e4e4ee183fb27a1ba3a4d1c2731e42da3f865800284b6-rootfs.mount: Deactivated successfully. machine # [ 380.797106] systemd[1]: cri-containerd-7741d838aaf6aad1466b04289e8bdada18fb8a85e0c97850f8ec415ea85cb496.scope: Deactivated successfully. machine # [ 380.862890] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7741d838aaf6aad1466b04289e8bdada18fb8a85e0c97850f8ec415ea85cb496-rootfs.mount: Deactivated successfully. machine # [ 380.906886] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-7741d838aaf6aad1466b04289e8bdada18fb8a85e0c97850f8ec415ea85cb496-shm.mount: Deactivated successfully. machine # [ 381.107714] cni0: port 1(vethf1045427) entered disabled state machine # [ 380.957149] dhcpcd[688]: vethf1045427: carrier lost machine # [ 381.111508] vethf1045427 (unregistering): left allmulticast mode machine # [ 381.113683] vethf1045427 (unregistering): left promiscuous mode machine # [ 381.115727] cni0: port 1(vethf1045427) entered disabled state machine # [ 380.984499] dhcpcd[688]: vethf1045427: deleting address fe80::18c4:8bff:fe91:5f04 machine # [ 380.985769] systemd[1]: run-netns-cni\x2d4061b462\x2da52c\x2d190e\x2d252d\x2d49f55f9f6b31.mount: Deactivated successfully. machine # [ 380.988189] dhcpcd[688]: vethf1045427: deleting route to 169.254.0.0/16 machine # [ 381.050422] dhcpcd[688]: vethf1045427: removing interface machine # [ 381.159563] k3s[873]: I0928 16:11:36.794575 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-nix-grpc-farm\") pod \"53cb7a30-9810-4000-b534-29d296e57e01\" (UID: \"53cb7a30-9810-4000-b534-29d296e57e01\") " machine # [ 381.159983] k3s[873]: I0928 16:11:36.794632 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-kube-api-access-mmjqw\" (UniqueName: \"kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-kube-api-access-mmjqw\") pod \"53cb7a30-9810-4000-b534-29d296e57e01\" (UID: \"53cb7a30-9810-4000-b534-29d296e57e01\") " machine # [ 381.160672] k3s[873]: I0928 16:11:36.794668 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53cb7a30-9810-4000-b534-29d296e57e01-job\" (UniqueName: \"kubernetes.io/configmap/53cb7a30-9810-4000-b534-29d296e57e01-job\") pod \"53cb7a30-9810-4000-b534-29d296e57e01\" (UID: \"53cb7a30-9810-4000-b534-29d296e57e01\") " machine # [ 381.161165] k3s[873]: I0928 16:11:36.795189 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53cb7a30-9810-4000-b534-29d296e57e01-job" pod "53cb7a30-9810-4000-b534-29d296e57e01" (UID: "53cb7a30-9810-4000-b534-29d296e57e01"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 381.163463] systemd[1]: var-lib-kubelet-pods-53cb7a30\x2d9810\x2d4000\x2db534\x2d29d296e57e01-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 381.179234] k3s[873]: I0928 16:11:36.814543 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-nix-grpc-farm" pod "53cb7a30-9810-4000-b534-29d296e57e01" (UID: "53cb7a30-9810-4000-b534-29d296e57e01"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 381.182193] systemd[1]: var-lib-kubelet-pods-53cb7a30\x2d9810\x2d4000\x2db534\x2d29d296e57e01-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dmmjqw.mount: Deactivated successfully. machine # [ 381.186420] k3s[873]: I0928 16:11:36.821745 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-kube-api-access-mmjqw" pod "53cb7a30-9810-4000-b534-29d296e57e01" (UID: "53cb7a30-9810-4000-b534-29d296e57e01"). InnerVolumeSpecName "kube-api-access-mmjqw". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 381.260401] k3s[873]: I0928 16:11:36.895693 873 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 381.260805] k3s[873]: I0928 16:11:36.895743 873 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmjqw\" (UniqueName: \"kubernetes.io/projected/53cb7a30-9810-4000-b534-29d296e57e01-kube-api-access-mmjqw\") on node \"machine\" DevicePath \"\"" machine # [ 381.261526] k3s[873]: I0928 16:11:36.895759 873 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/53cb7a30-9810-4000-b534-29d296e57e01-job\") on node \"machine\" DevicePath \"\"" machine # [ 381.783885] k3s[873]: I0928 16:11:37.419082 873 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7741d838aaf6aad1466b04289e8bdada18fb8a85e0c97850f8ec415ea85cb496" machine # [ 381.800503] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod53cb7a30_9810_4000_b534_29d296e57e01.slice. machine # [ 381.802262] systemd[1]: kubepods-besteffort-pod53cb7a30_9810_4000_b534_29d296e57e01.slice: Consumed 1.120s CPU time over 1min 50.008s wall clock time, 125.5M memory peak, 55.8M read from disk, 632K written to disk, 18.3K incoming IP traffic, 44.9K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 110.88 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.16 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpvc2v3pi3/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (27s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.14 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 112.13 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.30 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.23 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-z8tz9 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 384.076803] k3s[873]: E0928 16:11:39.711580 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39686: use of closed network connection machine # [ 385.389983] k3s[873]: E0928 16:11:41.024671 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39700: use of closed network connection machine # [ 386.687300] k3s[873]: E0928 16:11:42.322093 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39730: use of closed network connection machine # [ 387.974913] k3s[873]: E0928 16:11:43.609624 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39750: use of closed network connection machine # [ 389.266625] k3s[873]: E0928 16:11:44.901223 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39786: use of closed network connection machine # [ 389.267721] k3s[873]: time="2026-09-28T16:11:44Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:53000->127.0.0.1:10250: write: connection reset by peer" machine # [ 389.268819] k3s[873]: time="2026-09-28T16:11:44Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:6443->127.0.0.1:39792: write: broken pipe" machine # [ 390.571923] k3s[873]: E0928 16:11:46.206935 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39814: use of closed network connection machine # [ 391.886501] k3s[873]: E0928 16:11:47.520995 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39838: use of closed network connection machine # [ 393.223860] k3s[873]: E0928 16:11:48.858816 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35866: use of closed network connection machine # [ 394.529421] k3s[873]: E0928 16:11:50.163935 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35900: use of closed network connection machine # [ 395.847882] k3s[873]: E0928 16:11:51.481890 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35928: use of closed network connection machine # [ 397.166706] k3s[873]: E0928 16:11:52.801350 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35966: use of closed network connection machine # [ 398.470834] k3s[873]: E0928 16:11:54.105347 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35984: use of closed network connection machine # [ 399.797289] k3s[873]: E0928 16:11:55.431994 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36010: use of closed network connection machine # [ 401.093666] k3s[873]: E0928 16:11:56.728534 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36048: use of closed network connection machine # [ 402.379992] k3s[873]: E0928 16:11:58.014934 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36068: use of closed network connection machine # [ 403.669682] k3s[873]: E0928 16:11:59.303967 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59474: use of closed network connection machine # [ 404.925888] k3s[873]: E0928 16:12:00.560883 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59510: use of closed network connection machine # [ 406.232238] k3s[873]: E0928 16:12:01.867157 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59546: use of closed network connection machine # [ 407.533032] k3s[873]: E0928 16:12:03.167763 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59578: use of closed network connection machine # [ 408.868928] k3s[873]: time="2026-09-28T16:12:04Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:40854->127.0.0.1:10250: write: connection reset by peer" machine # [ 408.870622] k3s[873]: E0928 16:12:04.504165 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59596: use of closed network connection machine # [ 410.180080] k3s[873]: E0928 16:12:05.814608 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59624: use of closed network connection machine # [ 411.508869] k3s[873]: E0928 16:12:07.143828 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59658: use of closed network connection machine # [ 412.824550] k3s[873]: E0928 16:12:08.459203 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59684: use of closed network connection machine # [ 414.107522] k3s[873]: E0928 16:12:09.742012 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50082: use of closed network connection machine # [ 414.331474] postgres[762]: [762] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.930 s, sync=0.069 s, total=104.039 s; sync files=364, longest=0.005 s, average=0.001 s; distance=4987 kB, estimate=4987 kB; lsn=0/1C74790, redo lsn=0/1C45058 machine # [ 415.454590] k3s[873]: E0928 16:12:11.088709 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50102: use of closed network connection machine # [ 416.770167] k3s[873]: E0928 16:12:12.405102 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50122: use of closed network connection machine # [ 418.111792] k3s[873]: E0928 16:12:13.746608 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50152: use of closed network connection machine # [ 419.379709] k3s[873]: E0928 16:12:15.014668 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50184: use of closed network connection machine # [ 420.667377] k3s[873]: E0928 16:12:16.302208 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50222: use of closed network connection machine # [ 421.997680] k3s[873]: E0928 16:12:17.632328 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50250: use of closed network connection machine # [ 423.308785] k3s[873]: E0928 16:12:18.943487 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60044: use of closed network connection machine # [ 424.629709] k3s[873]: E0928 16:12:20.263781 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60062: use of closed network connection machine # [ 425.932370] k3s[873]: E0928 16:12:21.567090 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60096: use of closed network connection machine # [ 427.226850] k3s[873]: E0928 16:12:22.861333 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60126: use of closed network connection machine # [ 428.512560] k3s[873]: E0928 16:12:24.147407 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60158: use of closed network connection machine # [ 429.818631] k3s[873]: E0928 16:12:25.453373 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60186: use of closed network connection machine # [ 431.131847] k3s[873]: time="2026-09-28T16:12:26Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:56172->127.0.0.1:10250: write: connection reset by peer" machine # [ 431.132850] k3s[873]: E0928 16:12:26.766907 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60214: use of closed network connection machine # [ 432.453360] k3s[873]: E0928 16:12:28.087983 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60246: use of closed network connection machine # [ 433.768874] k3s[873]: E0928 16:12:29.403880 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59922: use of closed network connection machine # [ 435.033603] k3s[873]: E0928 16:12:30.668479 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59944: use of closed network connection machine # [ 436.333080] k3s[873]: E0928 16:12:31.967803 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59968: use of closed network connection machine # [ 437.650856] k3s[873]: E0928 16:12:33.285502 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60002: use of closed network connection machine # [ 438.954273] k3s[873]: E0928 16:12:34.588236 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60026: use of closed network connection machine # [ 440.272656] k3s[873]: E0928 16:12:35.907662 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60046: use of closed network connection machine # [ 441.591796] k3s[873]: E0928 16:12:37.226520 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60068: use of closed network connection machine # [ 442.910992] k3s[873]: E0928 16:12:38.545378 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60100: use of closed network connection machine # [ 442.913271] k3s[873]: E0928 16:12:38.545555 873 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:49984->127.0.0.1:10010: write tcp 127.0.0.1:49984->127.0.0.1:10010: write: broken pipe machine # [ 442.915929] k3s[873]: time="2026-09-28T16:12:38Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:40798->127.0.0.1:10250: read: connection reset by peer" machine # [ 445.492255] k3s[873]: E0928 16:12:41.127233 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58614: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-z8tz9 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 61.72 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 445.791936] niks3-server[1163]: 2026/09/28 16:12:41 INFO Received push request method=POST path=/api/pushes machine # [ 445.803739] niks3-server[1163]: 2026/09/28 16:12:41 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 445.805959] niks3-server[1163]: 2026/09/28 16:12:41 INFO Signed narinfos id=21 count=1 machine # [ 445.812828] niks3-server[1163]: 2026/09/28 16:12:41 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 445.814955] niks3-server[1163]: 2026/09/28 16:12:41 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 445.817357] niks3-server[1163]: 2026/09/28 16:12:41 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 445.823065] niks3-server[1163]: 2026/09/28 16:12:41 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 470.534855] niks3-server[1163]: 2026/09/28 16:13:06 INFO Received push request method=POST path=/api/pushes machine # [ 470.555659] niks3-server[1163]: 2026/09/28 16:13:06 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 470.560216] niks3-server[1163]: 2026/09/28 16:13:06 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 470.565309] niks3-server[1163]: 2026/09/28 16:13:06 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 470.569066] niks3-server[1163]: 2026/09/28 16:13:06 INFO Signed narinfos id=22 count=1 machine # [ 470.572290] niks3-server[1163]: 2026/09/28 16:13:06 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 470.577088] niks3-server[1163]: 2026/09/28 16:13:06 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 470.580848] niks3-server[1163]: 2026/09/28 16:13:06 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 470.638507] niks3-server[1163]: 2026/09/28 16:13:06 INFO Received push request method=POST path=/api/pushes machine # [ 470.650770] niks3-server[1163]: 2026/09/28 16:13:06 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 470.654088] niks3-server[1163]: 2026/09/28 16:13:06 INFO Signed narinfos id=23 count=1 machine # [ 470.656780] niks3-server[1163]: 2026/09/28 16:13:06 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 470.658129] niks3-server[1163]: 2026/09/28 16:13:06 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 470.659695] niks3-server[1163]: 2026/09/28 16:13:06 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 470.668779] niks3-server[1163]: 2026/09/28 16:13:06 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 495.385629] niks3-server[1163]: 2026/09/28 16:13:31 INFO Received push request method=POST path=/api/pushes machine # [ 495.403635] niks3-server[1163]: 2026/09/28 16:13:31 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 495.406160] niks3-server[1163]: 2026/09/28 16:13:31 INFO Signed narinfos id=24 count=1 machine # [ 495.412539] niks3-server[1163]: 2026/09/28 16:13:31 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 495.414837] niks3-server[1163]: 2026/09/28 16:13:31 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 495.417410] niks3-server[1163]: 2026/09/28 16:13:31 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 495.420308] niks3-server[1163]: 2026/09/28 16:13:31 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 495.428224] niks3-server[1163]: 2026/09/28 16:13:31 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 495.494370] niks3-server[1163]: 2026/09/28 16:13:31 INFO Received push request method=POST path=/api/pushes machine # [ 495.505685] niks3-server[1163]: 2026/09/28 16:13:31 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 495.506370] niks3-server[1163]: 2026/09/28 16:13:31 INFO Signed narinfos id=25 count=1 machine # [ 495.510480] niks3-server[1163]: 2026/09/28 16:13:31 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 495.512601] niks3-server[1163]: 2026/09/28 16:13:31 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 495.513034] niks3-server[1163]: 2026/09/28 16:13:31 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 495.517104] niks3-server[1163]: 2026/09/28 16:13:31 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 520.634176] niks3-server[1163]: 2026/09/28 16:13:56 INFO Received push request method=POST path=/api/pushes machine # [ 520.650088] niks3-server[1163]: 2026/09/28 16:13:56 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 520.651964] niks3-server[1163]: 2026/09/28 16:13:56 INFO Signed narinfos id=26 count=1 machine # [ 520.657778] niks3-server[1163]: 2026/09/28 16:13:56 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 520.663222] niks3-server[1163]: 2026/09/28 16:13:56 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 520.665475] niks3-server[1163]: 2026/09/28 16:13:56 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 520.667749] niks3-server[1163]: 2026/09/28 16:13:56 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 520.677153] niks3-server[1163]: 2026/09/28 16:13:56 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 76.19 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 138.48 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2"' machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2"', in 0.04 seconds) (finished: subtest: metrics carry build_info, in 0.26 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 522.228306] k3s[873]: E0928 16:13:57.860153 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55772: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.24 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 522.494062] k3s[873]: E0928 16:13:58.129179 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55806: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.27 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc -- sh -c 'fallocate -l 11438186496 /nix/fill' machine # [ 522.746497] k3s[873]: E0928 16:13:58.381723 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55838: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc -- sh -c 'fallocate -l 11438186496 /nix/fill', in 0.25 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc --since=30s | grep -q 'store paths deleted', in 6.40 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc -- sh -c 'rm /nix/fill' machine # [ 529.361110] k3s[873]: E0928 16:14:04.995684 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49660: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc -- sh -c 'rm /nix/fill', in 0.21 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.15 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 529.717599] k3s[873]: E0928 16:14:05.352823 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49698: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2 -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.21 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 7.73 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # Running as unit: vialb.service; invocation ID: 9ebb05c2863f4666a079f17595ff1b8d machine # [ 529.744350] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 529.866789] nix[10604]: don't know how to build these paths: machine # [ 529.867734] nix[10604]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 529.891024] nix[10604]: copying 1 paths to '127.0.0.1:30051'... machine # [ 529.892624] nix[10604]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 529.952240] niks3-server[1163]: 2026/09/28 16:14:05 INFO Received push request method=POST path=/api/pushes machine # [ 529.968755] niks3-server[1163]: 2026/09/28 16:14:05 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 529.970342] niks3-server[1163]: 2026/09/28 16:14:05 INFO Signed narinfos id=27 count=1 machine # [ 529.971478] niks3-server[1163]: 2026/09/28 16:14:05 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 529.973292] niks3-server[1163]: 2026/09/28 16:14:05 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 529.989523] niks3-server[1163]: 2026/09/28 16:14:05 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 529.994306] niks3-server[1163]: 2026/09/28 16:14:05 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 530.002078] nix[10604]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 530.003094] nix[10604]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.27 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 531.098272] nix[10604]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 531.099282] nix[10604]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 531.126838] systemd[1]: cri-containerd-8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0.scope: Deactivated successfully. machine # [ 531.129065] systemd[1]: cri-containerd-8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0.scope: Consumed 5.424s CPU time over 8min 11.962s wall clock time, 56.7M memory peak, 38.9M read from disk, 632.4K incoming IP traffic, 767.8K outgoing IP traffic. machine # [ 531.159298] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0-rootfs.mount: Deactivated successfully. machine # [ 531.192537] systemd[1]: cri-containerd-ac720d2b2f9e41d274bc154def58da8551e22c5c9b165f5a2a0f691e84b53c42.scope: Deactivated successfully. machine # [ 531.221418] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-ac720d2b2f9e41d274bc154def58da8551e22c5c9b165f5a2a0f691e84b53c42-rootfs.mount: Deactivated successfully. machine # [ 531.247987] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-ac720d2b2f9e41d274bc154def58da8551e22c5c9b165f5a2a0f691e84b53c42-shm.mount: Deactivated successfully. machine # [ 531.432477] cni0: port 6(vethe1b8325c) entered disabled state machine # [ 531.280568] dhcpcd[688]: vethe1b8325c: carrier lost machine # [ 531.434543] vethe1b8325c (unregistering): left allmulticast mode machine # [ 531.435641] vethe1b8325c (unregistering): left promiscuous mode machine # [ 531.436804] cni0: port 6(vethe1b8325c) entered disabled state machine # [ 531.298565] systemd[1]: run-netns-cni\x2db2b5b4c0\x2d6daf\x2d5cef\x2d9cd6\x2db1c653ce2757.mount: Deactivated successfully. machine # [ 531.308299] dhcpcd[688]: vethe1b8325c: deleting address fe80::ce6:24ff:fea3:e1fe machine # [ 531.312179] dhcpcd[688]: vethe1b8325c: deleting route to 169.254.0.0/16 machine # [ 531.350056] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6c4490b9_d2f3_49ed_8a0d_41b2a01c3055.slice. machine # [ 531.390481] dhcpcd[688]: vethe1b8325c: removing interface machine # [ 531.422859] k3s[873]: I0928 16:14:07.057845 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-lb\" (UniqueName: \"kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-lb\") pod \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\" (UID: \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\") " machine # [ 531.427667] k3s[873]: I0928 16:14:07.057907 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-ca\" (UniqueName: \"kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-ca\") pod \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\" (UID: \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\") " machine # [ 531.432183] k3s[873]: I0928 16:14:07.057944 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-config\" (UniqueName: \"kubernetes.io/configmap/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-config\") pod \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\" (UID: \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\") " machine # [ 531.437572] k3s[873]: I0928 16:14:07.057975 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tmp\") pod \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\" (UID: \"6d8ee43f-94b2-4e20-b40e-9ebc2375a277\") " machine # [ 531.441975] k3s[873]: I0928 16:14:07.058029 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/6c4490b9-d2f3-49ed-8a0d-41b2a01c3055-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-bv49h\" (UID: \"6c4490b9-d2f3-49ed-8a0d-41b2a01c3055\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-bv49h" machine # [ 531.446464] k3s[873]: I0928 16:14:07.058060 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c4490b9-d2f3-49ed-8a0d-41b2a01c3055-config\") pod \"nix-grpc-farm-lb-75b44f88dd-bv49h\" (UID: \"6c4490b9-d2f3-49ed-8a0d-41b2a01c3055\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-bv49h" machine # [ 531.451554] k3s[873]: I0928 16:14:07.058087 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c4490b9-d2f3-49ed-8a0d-41b2a01c3055-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-bv49h\" (UID: \"6c4490b9-d2f3-49ed-8a0d-41b2a01c3055\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-bv49h" machine # [ 531.455642] k3s[873]: I0928 16:14:07.058112 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/6c4490b9-d2f3-49ed-8a0d-41b2a01c3055-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-bv49h\" (UID: \"6c4490b9-d2f3-49ed-8a0d-41b2a01c3055\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-bv49h" machine # [ 531.459835] k3s[873]: I0928 16:14:07.065264 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-ca" pod "6d8ee43f-94b2-4e20-b40e-9ebc2375a277" (UID: "6d8ee43f-94b2-4e20-b40e-9ebc2375a277"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 531.464083] systemd[1]: var-lib-kubelet-pods-6d8ee43f\x2d94b2\x2d4e20\x2db40e\x2d9ebc2375a277-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 531.466194] k3s[873]: I0928 16:14:07.069095 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-lb" pod "6d8ee43f-94b2-4e20-b40e-9ebc2375a277" (UID: "6d8ee43f-94b2-4e20-b40e-9ebc2375a277"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 531.470263] k3s[873]: I0928 16:14:07.074513 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tmp" pod "6d8ee43f-94b2-4e20-b40e-9ebc2375a277" (UID: "6d8ee43f-94b2-4e20-b40e-9ebc2375a277"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 531.474717] k3s[873]: I0928 16:14:07.077703 873 scope.go:122] "RemoveContainer" containerID="8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0" machine # [ 531.477291] k3s[873]: I0928 16:14:07.079439 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-config" pod "6d8ee43f-94b2-4e20-b40e-9ebc2375a277" (UID: "6d8ee43f-94b2-4e20-b40e-9ebc2375a277"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 531.482746] k3s[873]: I0928 16:14:07.087805 873 scope.go:122] "RemoveContainer" containerID="8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0" machine # [ 531.485202] k3s[873]: E0928 16:14:07.088198 873 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0\": not found" containerID="8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0" machine # [ 531.490511] k3s[873]: I0928 16:14:07.088245 873 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0"} err="failed to get container status \"8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0\": rpc error: code = NotFound desc = an error occurred when try to find container \"8e087174dbce5bf18b2f5998f2a6f4204ff1d763dd31df2247bc29e7e4914fe0\": not found" machine # [ 531.524293] k3s[873]: I0928 16:14:07.159607 873 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 531.524985] k3s[873]: I0928 16:14:07.159636 873 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-config\") on node \"machine\" DevicePath \"\"" machine # [ 531.525886] k3s[873]: I0928 16:14:07.159853 873 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 531.526568] k3s[873]: I0928 16:14:07.159868 873 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/6d8ee43f-94b2-4e20-b40e-9ebc2375a277-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 531.839066] cni0: port 1(veth9b59cd1d) entered blocking state machine # [ 531.841458] cni0: port 1(veth9b59cd1d) entered disabled state machine # [ 531.843553] veth9b59cd1d: entered allmulticast mode machine # [ 531.845566] veth9b59cd1d: entered promiscuous mode machine # [ 531.696228] (udev-worker)[10789]: Network interface NamePolicy= disabled on kernel command line. machine # [ 531.857217] cni0: port 1(veth9b59cd1d) entered blocking state machine # [ 531.858707] cni0: port 1(veth9b59cd1d) entered forwarding state machine # [ 531.726646] dhcpcd[688]: veth9b59cd1d: IAID be:39:a8:6f machine # [ 531.727553] dhcpcd[688]: veth9b59cd1d: adding address fe80::f407:beff:fe39:a86f machine # [ 531.748847] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod6d8ee43f_94b2_4e20_b40e_9ebc2375a277.slice. machine # [ 531.749919] systemd[1]: kubepods-besteffort-pod6d8ee43f_94b2_4e20_b40e_9ebc2375a277.slice: Consumed 5.456s CPU time over 8min 14.292s wall clock time, 56.9M memory peak, 38.9M read from disk, 632.4K incoming IP traffic, 767.8K outgoing IP traffic. machine # [ 531.797337] systemd[1]: Started libcontainer container 7ba666023f02ab52fb09bf419a1b84d34a96ed5db6dee773e6bc77b14126e49e. machine # [ 531.920320] systemd[1]: Started libcontainer container b3f829604c0781139264d37e04951d521c65a51978acc3a570cf73952c30910b. machine # [ 532.178996] systemd[1]: var-lib-kubelet-pods-6d8ee43f\x2d94b2\x2d4e20\x2db40e\x2d9ebc2375a277-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 532.181286] systemd[1]: var-lib-kubelet-pods-6d8ee43f\x2d94b2\x2d4e20\x2db40e\x2d9ebc2375a277-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 532.183463] systemd[1]: var-lib-kubelet-pods-6d8ee43f\x2d94b2\x2d4e20\x2db40e\x2d9ebc2375a277-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 532.184994] systemd[1]: var-lib-kubelet-pods-6d8ee43f\x2d94b2\x2d4e20\x2db40e\x2d9ebc2375a277-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 532.186231] systemd[1]: var-lib-kubelet-pods-6d8ee43f\x2d94b2\x2d4e20\x2db40e\x2d9ebc2375a277-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 532.476989] k3s[873]: I0928 16:14:08.109495 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-bv49h" podStartSLOduration=2.109397223 podStartE2EDuration="2.109397223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:14:08.107862671 +0000 UTC m=+515.955203187" watchObservedRunningTime="2026-09-28 16:14:08.109397223 +0000 UTC m=+515.956736902" machine # [ 532.487877] dhcpcd[688]: veth9b59cd1d: soliciting a DHCP lease machine # [ 533.126371] k3s[873]: I0928 16:14:08.761584 873 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d8ee43f-94b2-4e20-b40e-9ebc2375a277" path="/var/lib/kubelet/pods/6d8ee43f-94b2-4e20-b40e-9ebc2375a277/volumes" machine # [ 533.601827] nix[10604]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 534.047746] dhcpcd[688]: veth9b59cd1d: soliciting an IPv6 router machine # [ 534.653373] nix[10604]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 534.655380] nix[10604]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-bqsm2: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 537.489111] dhcpcd[688]: veth9b59cd1d: probing for an IPv4LL address machine # [ 542.193348] dhcpcd[688]: veth9b59cd1d: using IPv4LL address 169.254.153.120 machine # [ 542.196225] dhcpcd[688]: veth9b59cd1d: adding route to 169.254.0.0/16 machine # [ 546.051630] dhcpcd[688]: veth9b59cd1d: no IPv6 Routers available machine # [ 579.803781] niks3-server[1163]: 2026/09/28 16:14:55 INFO Received push request method=POST path=/api/pushes machine # [ 579.817450] niks3-server[1163]: 2026/09/28 16:14:55 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 579.821283] niks3-server[1163]: 2026/09/28 16:14:55 INFO Signed narinfos id=28 count=1 machine # [ 579.823001] niks3-server[1163]: 2026/09/28 16:14:55 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 579.825049] niks3-server[1163]: 2026/09/28 16:14:55 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 579.830399] niks3-server[1163]: 2026/09/28 16:14:55 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 579.836982] niks3-server[1163]: 2026/09/28 16:14:55 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 579.866910] systemd[1]: vialb.service: Deactivated successfully. machine # [ 579.867693] systemd[1]: vialb.service: Consumed 206ms CPU time over 50.124s wall clock time, 40.6M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.4K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.93 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.21 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.52 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 580.261249] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 6c36d768bdfd456e891d3fcd88d0f8ac machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.03 seconds) machine # [ 580.395808] nix[11571]: don't know how to build these paths: machine # [ 580.396637] nix[11571]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 580.414590] nix[11571]: copying 1 paths to '127.0.0.1:30051'... machine # [ 580.416360] nix[11571]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 580.456747] niks3-server[1163]: 2026/09/28 16:14:56 INFO Received push request method=POST path=/api/pushes machine # [ 580.470955] niks3-server[1163]: 2026/09/28 16:14:56 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 580.473845] niks3-server[1163]: 2026/09/28 16:14:56 INFO Signed narinfos id=29 count=1 machine # command terminated with exit code 1 machine # [ 580.476156] niks3-server[1163]: 2026/09/28 16:14:56 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 580.478512] niks3-server[1163]: 2026/09/28 16:14:56 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 580.482234] niks3-server[1163]: 2026/09/28 16:14:56 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 580.487924] niks3-server[1163]: 2026/09/28 16:14:56 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 580.495146] nix[11571]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 580.496194] nix[11571]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # command terminated with exit code 1 machine # [ 580.675448] k3s[873]: E0928 16:14:56.310367 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50232: use of closed network connection machine # [ 581.922742] k3s[873]: E0928 16:14:57.557733 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50270: use of closed network connection machine # command terminated with exit code 1 machine # [ 582.120877] k3s[873]: E0928 16:14:57.756181 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50298: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 583.389470] k3s[873]: E0928 16:14:59.024209 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54764: use of closed network connection machine # [ 583.591117] k3s[873]: E0928 16:14:59.226393 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54780: use of closed network connection machine # command terminated with exit code 1 machine # [ 584.862853] k3s[873]: E0928 16:15:00.497627 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54814: use of closed network connection machine # command terminated with exit code 1 machine # [ 585.054574] k3s[873]: E0928 16:15:00.689719 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54846: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 586.368283] k3s[873]: E0928 16:15:02.002958 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54880: use of closed network connection machine # [ 586.572878] k3s[873]: E0928 16:15:02.208185 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54906: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 587.864924] k3s[873]: E0928 16:15:03.499921 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54946: use of closed network connection machine # [ 588.064376] k3s[873]: E0928 16:15:03.699661 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54980: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 589.354129] k3s[873]: E0928 16:15:04.989025 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55000: use of closed network connection machine # [ 589.560772] k3s[873]: time="2026-09-28T16:15:05Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:35370->127.0.0.1:10250: write: broken pipe" machine # [ 589.561602] k3s[873]: E0928 16:15:05.196134 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55026: use of closed network connection machine # command terminated with exit code 1 machine # [ 590.879848] k3s[873]: E0928 16:15:06.514873 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55038: use of closed network connection machine # command terminated with exit code 1 machine # [ 591.103337] k3s[873]: E0928 16:15:06.738625 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55078: use of closed network connection machine # command terminated with exit code 1 machine # [ 592.383978] k3s[873]: E0928 16:15:08.018953 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55094: use of closed network connection machine # command terminated with exit code 1 machine # [ 592.588021] k3s[873]: E0928 16:15:08.223298 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55108: use of closed network connection machine # command terminated with exit code 1 machine # [ 593.857420] k3s[873]: time="2026-09-28T16:15:09Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:38266->127.0.0.1:10250: write: connection reset by peer" machine # command terminated with exit code 1 machine # [ 593.859049] k3s[873]: E0928 16:15:09.492652 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33350: use of closed network connection machine # [ 594.080542] k3s[873]: E0928 16:15:09.715826 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33390: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 595.401179] k3s[873]: E0928 16:15:11.033821 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33424: use of closed network connection machine # [ 595.625892] k3s[873]: E0928 16:15:11.261071 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33448: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 596.916446] k3s[873]: E0928 16:15:12.551100 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33474: use of closed network connection machine # command terminated with exit code 1 machine # [ 597.124878] k3s[873]: E0928 16:15:12.759602 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33500: use of closed network connection machine # command terminated with exit code 1 machine # [ 598.421726] k3s[873]: E0928 16:15:14.056341 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33524: use of closed network connection machine # [ 598.619777] k3s[873]: E0928 16:15:14.254940 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33558: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 599.951811] k3s[873]: E0928 16:15:15.586250 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33576: use of closed network connection machine # [ 600.143849] k3s[873]: E0928 16:15:15.779143 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33594: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 601.407267] k3s[873]: E0928 16:15:17.042135 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33616: use of closed network connection machine # [ 601.600728] k3s[873]: E0928 16:15:17.236046 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33634: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 602.873638] k3s[873]: E0928 16:15:18.508620 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33662: use of closed network connection machine # [ 603.070734] k3s[873]: time="2026-09-28T16:15:18Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:42596->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 603.071582] k3s[873]: E0928 16:15:18.706196 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49642: use of closed network connection machine # [ 604.345791] k3s[873]: E0928 16:15:19.980763 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49674: use of closed network connection machine # command terminated with exit code 1 machine # [ 604.546733] k3s[873]: time="2026-09-28T16:15:20Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:42618->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 604.547584] k3s[873]: E0928 16:15:20.182201 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49698: use of closed network connection machine # [ 605.774277] k3s[873]: E0928 16:15:21.409242 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49730: use of closed network connection machine # command terminated with exit code 1 machine # [ 605.970224] k3s[873]: E0928 16:15:21.605220 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49758: use of closed network connection machine # [ 606.171089] k3s[873]: E0928 16:15:21.806274 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49776: use of closed network connection machine # command terminated with exit code 1 machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-795755579b-r5vjk --wait=false, in 0.15 seconds) machine: must succeed: sleep 5.0 machine # [ 606.566752] systemd[1]: cri-containerd-eff84e8b5844900b3d25f746942dc79ad58e67cc5edf9e9bcce332ab45463e53.scope: Deactivated successfully. machine # [ 606.568636] systemd[1]: cri-containerd-eff84e8b5844900b3d25f746942dc79ad58e67cc5edf9e9bcce332ab45463e53.scope: Consumed 560ms CPU time over 9min 18.452s wall clock time, 13.7M memory peak, 6.3M read from disk. machine # [ 606.584409] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod46ea33bc_99d0_4fc6_a886_30094ea59531.slice. machine # [ 606.608450] k3s[873]: I0928 16:15:22.243774 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/46ea33bc-99d0-4fc6-a886-30094ea59531-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp\" (UID: \"46ea33bc-99d0-4fc6-a886-30094ea59531\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" machine # [ 606.613288] k3s[873]: I0928 16:15:22.246077 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/46ea33bc-99d0-4fc6-a886-30094ea59531-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp\" (UID: \"46ea33bc-99d0-4fc6-a886-30094ea59531\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" machine # [ 606.618265] k3s[873]: I0928 16:15:22.246231 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/46ea33bc-99d0-4fc6-a886-30094ea59531-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp\" (UID: \"46ea33bc-99d0-4fc6-a886-30094ea59531\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" machine # [ 606.622968] k3s[873]: I0928 16:15:22.246313 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/46ea33bc-99d0-4fc6-a886-30094ea59531-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp\" (UID: \"46ea33bc-99d0-4fc6-a886-30094ea59531\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" machine # [ 606.627524] k3s[873]: I0928 16:15:22.246367 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/46ea33bc-99d0-4fc6-a886-30094ea59531-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp\" (UID: \"46ea33bc-99d0-4fc6-a886-30094ea59531\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" machine # [ 606.632171] k3s[873]: I0928 16:15:22.246485 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/46ea33bc-99d0-4fc6-a886-30094ea59531-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp\" (UID: \"46ea33bc-99d0-4fc6-a886-30094ea59531\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" machine # [ 606.636888] k3s[873]: I0928 16:15:22.246572 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2xs4\" (UniqueName: \"kubernetes.io/projected/46ea33bc-99d0-4fc6-a886-30094ea59531-kube-api-access-w2xs4\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp\" (UID: \"46ea33bc-99d0-4fc6-a886-30094ea59531\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" machine # [ 606.641986] k3s[873]: I0928 16:15:22.246732 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/46ea33bc-99d0-4fc6-a886-30094ea59531-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp\" (UID: \"46ea33bc-99d0-4fc6-a886-30094ea59531\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" machine # [ 606.646703] k3s[873]: I0928 16:15:22.246818 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/46ea33bc-99d0-4fc6-a886-30094ea59531-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp\" (UID: \"46ea33bc-99d0-4fc6-a886-30094ea59531\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" machine # [ 606.654992] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-eff84e8b5844900b3d25f746942dc79ad58e67cc5edf9e9bcce332ab45463e53-rootfs.mount: Deactivated successfully. machine # [ 607.105884] cni0: port 6(veth8754b548) entered blocking state machine # [ 607.110654] cni0: port 6(veth8754b548) entered disabled state machine # [ 607.112939] veth8754b548: entered allmulticast mode machine # [ 607.115002] veth8754b548: entered promiscuous mode machine # [ 607.129536] cni0: port 6(veth8754b548) entered blocking state machine # [ 607.130416] cni0: port 6(veth8754b548) entered forwarding state machine # [ 607.024133] (udev-worker)[13255]: Network interface NamePolicy= disabled on kernel command line. machine # [ 607.055494] dhcpcd[688]: veth8754b548: IAID fb:f1:05:01 machine # [ 607.056339] dhcpcd[688]: veth8754b548: adding address fe80::d03f:fbff:fef1:501 machine # [ 607.082330] systemd[1]: Started libcontainer container d5b0ae57c5e6d25a274a48dc9acbd138cc79d8f6ebc6195dadbbbb482b85f128. machine # [ 607.385629] systemd[1]: Started libcontainer container 4347346ff0eb5ee35ad5378b61c53cd5c01302013cdc04ba1402c14343420528. machine # [ 607.730987] dhcpcd[688]: veth8754b548: soliciting a DHCP lease machine # [ 608.739988] dhcpcd[688]: veth8754b548: soliciting an IPv6 router machine # [ 609.936774] systemd[1]: cri-containerd-4347346ff0eb5ee35ad5378b61c53cd5c01302013cdc04ba1402c14343420528.scope: Deactivated successfully. machine # [ 609.940376] systemd[1]: cri-containerd-4347346ff0eb5ee35ad5378b61c53cd5c01302013cdc04ba1402c14343420528.scope: Consumed 1.116s CPU time over 2.549s wall clock time, 498M memory peak, 205.7M read from disk, 159.1M written to disk. machine # [ 610.009283] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4347346ff0eb5ee35ad5378b61c53cd5c01302013cdc04ba1402c14343420528-rootfs.mount: Deactivated successfully. machine # [ 610.432082] postgres[762]: [762] LOG: checkpoint starting: time machine # [ 610.891894] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3684174589.mount: Deactivated successfully. machine # [ 610.960869] systemd[1]: Started libcontainer container c60c7b19c14ab7e8324ce0734d77fe440f867add1b25c9735993ee9d105a8945. machine # [ 611.011299] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1439216550.mount: Deactivated successfully. machine # [ 611.055679] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3484018007.mount: Deactivated successfully. machine # [ 611.162570] systemd[1]: Started libcontainer container 5f806eab38f2feec74dc1e9a3c3ce38c406a2cc7faf66f25c141000cf4a74cea. machine # [ 611.360319] systemd[1]: Started libcontainer container faafe5c97ce155eb90dd62d14f027aeea0503c48ab7ef47e4c5ab9dad3913c56. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 611.810646] k3s[873]: E0928 16:15:27.445593 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49820: use of closed network connection machine # command terminated with exit code 1 machine # [ 611.848725] k3s[873]: I0928 16:15:27.484006 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-mhvhp" podStartSLOduration=2.9855359420000003 podStartE2EDuration="5.48398337s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.498447428s" isStatefulPod=false podCreationTimestamp="2026-09-28 16:15:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-28 16:15:27.483776639 +0000 UTC m=+595.331112686" watchObservedRunningTime="2026-09-28 16:15:27.48398337 +0000 UTC m=+595.331319137" machine # [ 612.014640] systemd[1]: tmp-ovl\x2didmapped2610950195.mount: Deactivated successfully. machine # [ 612.028106] k3s[873]: E0928 16:15:27.663393 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:49848: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 612.732444] dhcpcd[688]: veth8754b548: probing for an IPv4LL address machine # [ 613.069968] postgres[762]: [762] LOG: checkpoint complete: wrote 26 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.613 s, sync=0.011 s, total=2.638 s; sync files=22, longest=0.004 s, average=0.001 s; distance=232 kB, estimate=4512 kB; lsn=0/1C7F3B0, redo lsn=0/1C7F358 machine # [ 618.626995] dhcpcd[688]: veth8754b548: using IPv4LL address 169.254.31.64 machine # [ 618.630138] dhcpcd[688]: veth8754b548: adding route to 169.254.0.0/16 machine # [ 619.521815] k3s[873]: I0928 16:15:35.156304 873 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 620.742387] dhcpcd[688]: veth8754b548: no IPv6 Routers available machine # [ 625.628105] niks3-server[1163]: 2026/09/28 16:15:41 INFO Received push request method=POST path=/api/pushes machine # [ 625.644451] niks3-server[1163]: 2026/09/28 16:15:41 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 625.646856] niks3-server[1163]: 2026/09/28 16:15:41 INFO Signed narinfos id=30 count=1 machine # [ 625.648185] niks3-server[1163]: 2026/09/28 16:15:41 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 625.650171] niks3-server[1163]: 2026/09/28 16:15:41 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 625.661069] niks3-server[1163]: 2026/09/28 16:15:41 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 625.665897] niks3-server[1163]: 2026/09/28 16:15:41 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 625.694702] systemd[1]: slow.service: Deactivated successfully. machine # [ 625.695338] systemd[1]: slow.service: Consumed 160ms CPU time over 45.433s wall clock time, 38.3M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic. machine # [ 626.574184] systemd[1]: cri-containerd-cf0094326bcd69a4b85d05d7608f01049fd31601d9a2ef301a2bdd667b516e1f.scope: Deactivated successfully. machine # [ 626.576380] systemd[1]: cri-containerd-cf0094326bcd69a4b85d05d7608f01049fd31601d9a2ef301a2bdd667b516e1f.scope: Consumed 3.605s CPU time over 9min 38.698s wall clock time, 90.5M memory peak, 55.2M read from disk, 8K written to disk, 286K incoming IP traffic, 348.4K outgoing IP traffic. machine # [ 626.630602] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-cf0094326bcd69a4b85d05d7608f01049fd31601d9a2ef301a2bdd667b516e1f-rootfs.mount: Deactivated successfully. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.60 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.03 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine # [ 626.722294] systemd[1]: cri-containerd-42e77e6540a5a024cbef50adc938ddbf751011edafe12fa2b773b12d8ff4993e.scope: Deactivated successfully. machine # [ 626.725707] systemd[1]: cri-containerd-42e77e6540a5a024cbef50adc938ddbf751011edafe12fa2b773b12d8ff4993e.scope: Consumed 22.340s CPU time over 9min 39.029s wall clock time, 36.3M memory peak, 18.6M read from disk, 1.2M written to disk, 49.9K incoming IP traffic, 34.5K outgoing IP traffic. machine # [ 626.762809] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-42e77e6540a5a024cbef50adc938ddbf751011edafe12fa2b773b12d8ff4993e-rootfs.mount: Deactivated successfully. machine # [ 626.783383] systemd[1]: cri-containerd-4304b626a52f93d9efb410e924cf3608ccb38e4a445d175b70a374c9d1f020c3.scope: Deactivated successfully. machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.12 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine # [ 626.817937] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4304b626a52f93d9efb410e924cf3608ccb38e4a445d175b70a374c9d1f020c3-rootfs.mount: Deactivated successfully. machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.60 seconds) (finished: run the VM test script, in 627.73 seconds) machine # [ 626.846156] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-4304b626a52f93d9efb410e924cf3608ccb38e4a445d175b70a374c9d1f020c3-shm.mount: Deactivated successfully. test script finished in 627.76s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-28T16:15:42Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-28T16:15:42Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-28T16:15:42Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.02 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh