tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.fVGI4YQEui', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: e44400f4-16e9-4e77-8dc3-81b723eb7f4d machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-27T14:59:45Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-27T14:59:45Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-27T14:59:45Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-27T14:59:45Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-27T14:59:45Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-27T14:59:45Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-27T14:59:45Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-27T14:59:45Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-27T14:59:45Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-27T14:59:45Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-27T14:59:45Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-27T14:59:45Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/czhjv81zyk2g31n2fjaiipmhydy7la37-nixos-system-machine-test/init regInfo=/nix/store/iqj24dk5wk5znkysvvkyyxv9q0y9w2nj-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000001] kvm-clock: using sched offset of 502747348 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000812] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000880] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002728] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002739] Using GB pages for direct mapping machine # [ 0.002864] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002872] ACPI: Early table checksum verification disabled machine # [ 0.002875] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002879] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002882] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002889] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002891] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002892] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002894] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002895] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002897] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002898] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002899] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002900] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002900] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002901] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002901] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002902] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003131] No NUMA configuration found machine # [ 0.003132] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003134] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005528] Zone ranges: machine # [ 0.005529] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005530] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005531] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005533] Device empty machine # [ 0.005533] Movable zone start for each node machine # [ 0.005534] Early memory node ranges machine # [ 0.005534] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005535] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005536] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005537] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005570] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005844] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.080422] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.080915] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.080930] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.080966] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.080969] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.080971] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.080972] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.080973] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.080974] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.080976] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.080978] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.080983] TSC deadline timer available machine # [ 0.080987] CPU topo: Max. logical packages: 1 machine # [ 0.080988] CPU topo: Max. logical dies: 1 machine # [ 0.080988] CPU topo: Max. dies per package: 1 machine # [ 0.080992] CPU topo: Max. threads per core: 1 machine # [ 0.080992] CPU topo: Num. cores per package: 4 machine # [ 0.080993] CPU topo: Num. threads per package: 4 machine # [ 0.080993] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.081019] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.081036] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.081038] kvm-guest: setup PV sched yield machine # [ 0.081049] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.081050] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.081052] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.081053] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.081055] Booting paravirtualized kernel on KVM machine # [ 0.081059] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.085586] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.087904] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.087958] kvm-guest: PV spinlocks enabled machine # [ 0.087960] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.087963] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/czhjv81zyk2g31n2fjaiipmhydy7la37-nixos-system-machine-test/init regInfo=/nix/store/iqj24dk5wk5znkysvvkyyxv9q0y9w2nj-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.088063] Unknown kernel command line parameters "regInfo=/nix/store/iqj24dk5wk5znkysvvkyyxv9q0y9w2nj-closure-info/registration", will be passed to user space. machine # [ 0.088076] random: crng init done machine # [ 0.088077] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.092845] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.095071] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.095149] software IO TLB: area num 4. machine # [ 0.173279] Fallback order for Node 0: 0 machine # [ 0.173288] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.173290] Policy zone: Normal machine # [ 0.176231] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.183617] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.193086] allocated 8388608 bytes of page_ext machine # [ 0.203310] ftrace: allocating 48787 entries in 192 pages machine # [ 0.203311] ftrace: allocated 192 pages with 2 groups machine # [ 0.204185] Dynamic Preempt: lazy machine # [ 0.204370] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.204371] rcu: RCU event tracing is enabled. machine # [ 0.204372] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.204373] Trampoline variant of Tasks RCU enabled. machine # [ 0.204373] Rude variant of Tasks RCU enabled. machine # [ 0.204373] Tracing variant of Tasks RCU enabled. machine # [ 0.204374] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.204375] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.204403] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.204405] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.204406] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.208834] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.209164] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.209174] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.209295] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.212901] Console: colour VGA+ 80x25 machine # [ 0.212904] printk: legacy console [tty0] enabled machine # [ 0.244727] printk: legacy console [ttyS0] enabled machine # [ 0.357553] ACPI: Core revision 20250807 machine # [ 0.358480] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.360177] APIC: Switch to symmetric I/O mode setup machine # [ 0.361255] x2apic enabled machine # [ 0.362020] APIC: Switched APIC routing to: physical x2apic machine # [ 0.362999] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.364258] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.365850] kvm-guest: setup PV IPIs machine # [ 0.367462] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.368509] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.372817] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.373905] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.374943] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.375814] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.376817] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.377814] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.378814] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.380602] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.381574] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.382637] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.383821] Spectre V2 : Enabling IBPB for BPF machine # [ 0.384814] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.385814] active return thunk: srso_alias_return_thunk machine # [ 0.386834] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.387813] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.389643] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.390647] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.391813] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.392813] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.393813] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.394814] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.395813] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.396813] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.397813] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.399622] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.400620] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.430759] Freeing SMP alternatives memory: 44K machine # [ 0.431446] pid_max: default: 32768 minimum: 301 machine # [ 0.432521] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.432921] landlock: Up and running. machine # [ 0.434303] Yama: becoming mindful. machine # [ 0.435026] LSM support for eBPF active machine # [ 0.436004] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.436899] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.440206] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.441415] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.441822] ... version: 2 machine # [ 0.442591] ... bit width: 48 machine # [ 0.442816] ... generic counters: 6 machine # [ 0.443564] ... generic bitmap: 000000000000003f machine # [ 0.443816] ... fixed-purpose counters: 0 machine # [ 0.444568] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.444815] ... value mask: 0000ffffffffffff machine # [ 0.445806] ... max period: 00007fffffffffff machine # [ 0.446582] ... global_ctrl mask: 000000000000003f machine # [ 0.446943] signal: max sigframe size: 3376 machine # [ 0.447789] rcu: Hierarchical SRCU implementation. machine # [ 0.448489] rcu: Max phase no-delay instances is 400. machine # [ 0.449013] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.454362] smp: Bringing up secondary CPUs ... machine # [ 0.455282] smpboot: x86: Booting SMP configuration: machine # [ 0.455820] .... node #0, CPUs: #1 #2 #3 machine # [ 0.458977] smp: Brought up 1 node, 4 CPUs machine # [ 0.460572] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.461167] Memory: 3957856K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved) machine # [ 0.462817] devtmpfs: initialized machine # [ 0.464117] x86/mm: Memory block size: 128MB machine # [ 0.466892] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.467897] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.468921] pinctrl core: initialized pinctrl subsystem machine # [ 0.470161] PM: RTC time: 14:59:45, date: 2026-09-27 machine # [ 0.474276] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.475654] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.476817] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.478401] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.478829] audit: initializing netlink subsys (disabled) machine # [ 0.479878] audit: type=2000 audit(1790521186.130:1): state=initialized audit_enabled=0 res=1 machine # [ 0.480156] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.481817] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.482816] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.483815] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.484816] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.485843] cpuidle: using governor menu machine # [ 0.488016] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.489098] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.489819] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.490829] PCI: Using configuration type 1 for base access machine # [ 0.491976] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.495114] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.497823] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.500825] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.502820] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.510017] ACPI: Added _OSI(Module Device) machine # [ 0.510818] ACPI: Added _OSI(Processor Device) machine # [ 0.511640] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.515141] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.518405] ACPI: Interpreter enabled machine # [ 0.520906] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.522824] ACPI: Using IOAPIC for interrupt routing machine # [ 0.525054] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.527823] PCI: Using E820 reservations for host bridge windows machine # [ 0.531316] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.543645] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.546831] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.550090] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.554156] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.557754] PCI host bridge to bus 0000:00 machine # [ 0.558826] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.560820] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.562820] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.565820] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.567820] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.570820] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.572820] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.575015] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.577273] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.590910] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.592829] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.593983] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.597642] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.604122] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.614861] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.617839] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.619878] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.623841] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.628388] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.635867] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.638841] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.640880] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.646298] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.654914] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.657845] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.659875] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.663646] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.667854] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.668796] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.669663] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.670822] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.672412] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.677362] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.677838] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.680406] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.682857] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.683838] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.685367] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.688865] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.701656] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.703367] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.705867] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.706838] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.709378] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.712838] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.713741] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.714604] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.716406] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.720859] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.721799] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.722652] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.724378] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.726571] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.728034] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.731905] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.734358] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.738914] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.740294] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.745863] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.748301] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.751486] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.755378] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.759903] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.762834] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.765563] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.769900] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.778937] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.779937] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.780922] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.782918] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.783925] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.784920] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.785916] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.786922] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.787856] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.788830] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.789830] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.790836] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.791837] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.793835] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.794836] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.795835] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.799844] iommu: Default domain type: Translated machine # [ 0.801824] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.805278] ACPI: bus type USB registered machine # [ 0.807112] usbcore: registered new interface driver usbfs machine # [ 0.809879] usbcore: registered new interface driver hub machine # [ 0.811845] usbcore: registered new device driver usb machine # [ 0.817228] NetLabel: Initializing machine # [ 0.818823] NetLabel: domain hash size = 128 machine # [ 0.820820] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.824130] NetLabel: unlabeled traffic allowed by default machine # [ 0.825860] PCI: Using ACPI for IRQ routing machine # [ 0.896939] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.897812] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.897812] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.897826] vgaarb: loaded machine # [ 0.898646] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.899462] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.903650] clocksource: Switched to clocksource kvm-clock machine # [ 0.910476] VFS: Disk quotas dquot_6.6.0 machine # [ 0.912489] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.916673] pnp: PnP ACPI init machine # [ 0.918831] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.921512] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.925862] pnp: PnP ACPI: found 5 devices machine # [ 0.940123] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.944200] clocksource: Switched to clocksource acpi_pm machine # [ 0.947445] NET: Registered PF_INET protocol family machine # [ 0.951465] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.991140] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.992722] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.994211] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.996966] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.998346] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.999718] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 1.001081] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 1.002284] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 1.003865] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 1.004882] NET: Registered PF_XDP protocol family machine # [ 1.005779] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 1.006904] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 1.008006] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 1.009202] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 1.010393] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 1.011664] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 1.013687] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 1.016069] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 1.018275] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 1.020437] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 1.022300] PCI: CLS 0 bytes, default 64 machine # [ 1.023237] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 1.023629] Trying to unpack rootfs image as initramfs... machine # [ 1.024381] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 1.027264] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 1.048770] Initialise system trusted keyrings machine # [ 1.050121] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.061963] Key type asymmetric registered machine # [ 1.062788] Asymmetric key parser 'x509' registered machine # [ 1.063774] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.065527] io scheduler mq-deadline registered machine # [ 1.066380] io scheduler kyber registered machine # [ 1.070283] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.071836] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.074378] Linux agpgart interface v0.103 machine # [ 1.075282] ACPI: bus type drm_connector registered machine # [ 1.078514] usbcore: registered new interface driver usbserial_generic machine # [ 1.079827] usbserial: USB Serial support registered for generic machine # [ 1.080911] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.080911] Please enable it if your BIOS has the CPPC option. machine # [ 1.083362] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.084942] drop_monitor: Initializing network drop monitor service machine # [ 1.086212] NET: Registered PF_INET6 protocol family machine # [ 1.089866] Segment Routing with IPv6 machine # [ 1.091806] In-situ OAM (IOAM) with IPv6 machine # [ 1.095502] IPI shorthand broadcast: enabled machine # [ 1.107619] sched_clock: Marking stable (952039093, 154638402)->(1132996305, -26318810) machine # [ 1.112698] registered taskstats version 1 machine # [ 1.115420] Loading compiled-in X.509 certificates machine # [ 1.140546] Demotion targets for Node 0: null machine # [ 1.145578] Key type .fscrypt registered machine # [ 1.147291] Key type fscrypt-provisioning registered machine # [ 1.149351] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.151895] ima: Allocated hash algorithm: sha1 machine # [ 1.154177] ima: No architecture policies found machine # [ 1.156263] PM: Magic number: 10:974:991 machine # [ 1.157854] memory memory34: hash matches machine # [ 1.160914] RAS: Correctable Errors collector initialized. machine # [ 1.169626] clk: Disabling unused clocks machine # [ 1.170397] PM: genpd: Disabling unused power domains machine # [ 1.314776] Freeing initrd memory: 29052K machine # [ 1.320200] Freeing unused decrypted memory: 2028K machine # [ 1.327202] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.330182] Write protecting the kernel read-only data: 32768k machine # [ 1.335485] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.339803] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.410589] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.411794] Run /init as init process machine # [ 1.426630] systemd[1]: Inserted module 'autofs4' machine # [ 1.453148] fuse: init (API version 7.45) machine # [ 1.462265] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.465294] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.469172] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.471529] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.477060] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.478672] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.497405] virtiofs virtio6: discovered new tag: shared machine # [ 1.498987] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.503065] virtiofs virtio7: discovered new tag: xchg machine # [ 1.504534] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.531066] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.867055] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.874550] systemd[1]: Detected virtualization kvm. machine # [ 1.876743] systemd[1]: Detected architecture x86-64. machine # [ 1.878936] systemd[1]: Running in initrd. machine # [ 1.881376] systemd[1]: Initializing machine ID from random generator. machine # [ 1.884375] systemd[1]: Hostname set to . machine # [ 2.007090] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.070954] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.081364] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.082708] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.084209] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.086290] systemd[1]: Reached target Path Units. machine # [ 2.088195] systemd[1]: Reached target Slice Units. machine # [ 2.090027] systemd[1]: Reached target Swaps. machine # [ 2.091743] systemd[1]: Reached target Timer Units. machine # [ 2.093070] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.094417] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.095706] systemd[1]: Listening on Journal Sockets. machine # [ 2.096769] systemd[1]: Listening on udev Control Socket. machine # [ 2.097817] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.098855] systemd[1]: Reached target Socket Units. machine # [ 2.100937] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.103194] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.106575] systemd[1]: Starting Journal Service... machine # [ 2.108494] systemd[1]: Starting Load Kernel Modules... machine # [ 2.109518] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.116729] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.127283] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.132374] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.142259] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.142455] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.142860] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.144276] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.151620] systemd-journald[92]: Collecting audit messages is disabled. machine # [ 2.158784] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.160952] systemd[1]: Finished Load Kernel Modules. machine # [ 2.163755] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.178947] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.180970] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.182957] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.195764] systemd[1]: Started Journal Service. machine # [ 2.041212] systemd-modules-load[93]: Using 4 probe threads machine # [ 2.043307] systemd-modules-load[93]: Inserted module 'virtio_balloon' machine # [ 2.044360] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 2.045399] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 2.046494] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.047619] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.048810] systemd[1]: Reached target Local File Systems. machine # [ 2.049775] systemd[1]: Starting Create System Files and Directories... machine # [ 2.050794] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.059928] systemd[1]: Finished Create System Files and Directories. machine # [ 2.070944] systemd-udevd[108]: Using default interface naming scheme 'v261'. machine # [ 2.080903] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.111250] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.112428] systemd[1]: Reached target System Initialization. machine # [ 2.113295] systemd[1]: Reached target Basic System. machine # [ 2.355961] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.372594] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.373877] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.375306] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.384704] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.388754] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.390002] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.391117] usb usb1: Product: EHCI Host Controller machine # [ 2.391905] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.392698] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.395969] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.409693] hub 1-0:1.0: USB hub found machine # [ 2.410458] hub 1-0:1.0: 6 ports detected machine # [ 2.414528] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.416273] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.417093] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.418198] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.419166] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.419915] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.421602] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.422980] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.424251] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.425703] usb usb2: Product: UHCI Host Controller machine # [ 2.426422] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.427406] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 2.434937] SCSI subsystem initialized machine # [ 2.438342] hub 2-0:1.0: USB hub found machine # [ 2.440968] hub 2-0:1.0: 2 ports detected machine # [ 2.296670] (udev-worker)[137]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.298071] systemd[1]: Starting Virtual Console Setup... machine # [ 2.300951] (udev-worker)[134]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to dev[ 2.457336] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # ice based on potentially unpredictable interface name. machine # [ 2.304952] ([ 2.459310] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # udev-worker)[134]: Network interface NamePolicy=[ 2.460794] uhci_hcd 0000:00:1d.1: detected 2 ports machine # disabled on kernel command line. machine # [ 2.462465] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.463720] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.464930] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.466038] usb usb3: Product: UHCI Host Controller machine # [ 2.466789] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.467703] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.468767] hub 3-0:1.0: USB hub found machine # [ 2.470522] hub 3-0:1.0: 2 ports detected machine # [ 2.478509] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.479420] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.480559] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.326532] systemd-vconsole-[ 2.480840] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # setup[144]: Configuration of first virtual console was skipped, ignoring remaining ones[ 2.482744] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # . machine # [ 2.484565] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.330519] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.486615] usb usb4: Product: UHCI Host Controller machine # [ 2.332588] systemd[1]: Finished Virtual Console Setup. machine # [ 2.487471] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.334738] systemd[1]: Reach[ 2.489162] usb usb4: SerialNumber: 0000:00:1d.2 machine # ed target Initrd Root Device. machine # [ 2.490383] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.336908] systemd[1]: Starting File System Check on /dev/di[ 2.491886] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # sk/by-label/nixos... machine # [ 2.493349] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.493934] hub 4-0:1.0: USB hub found machine # [ 2.495693] hub 4-0:1.0: 2 ports detected machine # [ 2.495713] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.499781] scsi host0: ahci machine # [ 2.500560] scsi host1: ahci machine # [ 2.502590] scsi host2: ahci machine # [ 2.507862] scsi host3: ahci machine # [ 2.509727] scsi host4: ahci machine # [ 2.510789] scsi host5: ahci machine # [ 2.512284] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.513910] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.515360] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.516665] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.517854] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.519389] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.365434] systemd-fsck[165]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.369493] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.651856] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.783426] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.786534] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.789296] usb 1-1: Product: QEMU USB Tablet machine # [ 2.791005] usb 1-1: Manufacturer: QEMU machine # [ 2.792503] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.827145] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.835407] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.837749] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.840063] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.842530] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.844599] ata3.00: applying bridge limits machine # [ 2.846449] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.848778] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.850949] ata3.00: configured for UDMA/100 machine # [ 2.853018] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.856168] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.890046] usbcore: registered new interface driver usbhid machine # [ 2.892202] usbhid: USB HID core driver machine # [ 2.902773] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.906928] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.922147] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.954012] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.966453] systemd[1]: Mounting /sysroot... machine # [ 3.257852] EXT4-fs (vda): mounted filesystem e44400f4-16e9-4e77-8dc3-81b723eb7f4d r/w with ordered data mode. Quota mode: none. machine # [ 3.110964] systemd[1]: Mounted /sysroot. machine # [ 3.113172] systemd[1]: Reached target Initrd Root File System. machine # [ 3.118914] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.122602] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.142590] systemd[1]: Mounting /sysroot/run... machine # [ 3.147152] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.153689] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.155612] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.159201] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.161161] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.163146] systemd[1]: Mounted /sysroot/run. machine # [ 3.164849] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.166682] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.169836] systemd-sysroot-fstab-check[195]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.172735] systemd[1]: Reload requested from client PID 195 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.175911] systemd[1]: Reloading... machine # [ 3.234582] systemd[1]: Reloading finished in 63 ms. machine # [ 3.262664] systemd-sysroot-fstab-check[195]: Requesting initrd-fs.target/start/replace... machine # [ 3.265723] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.267372] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.269970] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.272098] systemd-sysroot-fstab-check[195]: Requesting swap.target/start/replace... machine # [ 3.274753] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.278280] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.284640] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.286936] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.292608] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.295160] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.967544] systemd[1]: Mounting /sysroot/nix/store... machine # [ 4.019188] systemd[1]: Mounted /sysroot/nix/store. machine # [ 4.021065] systemd[1]: Reached target Initrd File Systems. machine # [ 4.022966] systemd[1]: Starting Find NixOS closure... machine # [ 4.025260] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 4.048372] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 4.051363] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 4.069285] systemd[1]: Finished Find NixOS closure. machine # [ 4.071172] systemd[1]: Reached target Initrd Default Target. machine # [ 4.073229] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.105057] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.107224] systemd[1]: Stopped target Basic System. machine # [ 4.109063] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.111422] systemd[1]: Stopped target Path Units. machine # [ 4.113198] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.115994] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.118780] systemd[1]: Stopped target Slice Units. machine # [ 4.120970] systemd[1]: Stopped target Socket Units. machine # [ 4.124097] systemd[1]: Stopped target System Initialization. machine # [ 4.128800] systemd[1]: Stopped target Swaps. machine # [ 4.130757] systemd[1]: Stopped target Timer Units. machine # [ 4.133212] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.135413] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.137688] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.140429] systemd[1]: Stopped Find NixOS closure. machine # [ 4.142328] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.144398] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.146876] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.148681] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.150699] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.152225] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.154432] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.156475] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.158498] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.160188] systemd[1]: Stopped target Local File Systems. machine # [ 4.161755] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.163592] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.165670] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.166702] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.167952] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.169149] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.169924] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.171026] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.171961] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.172974] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.173837] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.174771] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.175772] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.176785] systemd[1]: Closed udev Control Socket. machine # [ 4.177529] systemd[1]: Starting Cleanup udev Database... machine # [ 4.178374] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.179447] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.180390] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.181511] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.182523] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.183498] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.191177] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.192297] systemd[1]: Finished Cleanup udev Database. machine # [ 4.193063] systemd[1]: Reached target Switch Root. machine # [ 4.193810] systemd[1]: Starting NixOS Activation... machine # [ 4.335309] initrd-nixos-activation-start[240]: booting system configuration /nix/store/czhjv81zyk2g31n2fjaiipmhydy7la37-nixos-system-machine-test machine # [ 4.390382] initrd-nixos-activation-start[240]: running activation script... machine # [ 4.711840] initrd-nixos-activation-start[263]: setting up /etc... machine # [ 4.867673] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.870382] systemd[1]: Finished NixOS Activation. machine # [ 4.872515] systemd[1]: Starting Switch Root... machine # [ 4.912672] systemd[1]: Switching root. machine # [ 5.128893] systemd-journald[92]: Received SIGTERM from PID 1 (systemd). machine # [ 5.243923] NET: Registered PF_VSOCK protocol family machine # [ 5.630759] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.669750] systemd[1]: Detected virtualization kvm. machine # [ 5.671598] systemd[1]: Detected architecture x86-64. machine # [ 5.673584] systemd[1]: Detected first boot. machine # [ 5.678166] systemd[1]: Initializing machine ID from random generator. machine # [ 5.817464] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.898507] systemd[1]: Applying preset policy. machine # [ 6.124389] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.380395] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.383908] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.388860] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.394017] systemd[1]: Created slice Slice /system/getty. machine # [ 6.397601] systemd[1]: Created slice User and Session Slice. machine # [ 6.399990] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.403160] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.406086] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.408104] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.410143] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.412423] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.414410] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.416565] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.418849] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.421280] systemd[1]: Reached target Path Units. machine # [ 6.423192] systemd[1]: Reached target Remote File Systems. machine # [ 6.425327] systemd[1]: Reached target Slice Units. machine # [ 6.427289] systemd[1]: Reached target Swaps. machine # [ 6.432169] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.437415] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.441179] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.445140] systemd[1]: Listening on Factory Reset Management. machine # [ 6.447064] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.452133] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.453584] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.455894] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.457084] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.458295] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.459751] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.465050] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.466196] systemd[1]: Listening on udev Control Socket. machine # [ 6.467117] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.469760] systemd[1]: Mounting Huge Pages File System... machine # [ 6.472168] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.474826] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.484685] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.491768] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.500884] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.503410] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.507223] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.511397] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.521264] systemd[1]: Mounting FUSE Control File System... machine # [ 6.523688] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.532535] systemd[1]: Starting Journal Service... machine # [ 6.545464] systemd[1]: Starting Load Kernel Modules... machine # [ 6.548348] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.550725] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.551759] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.554702] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.557333] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.558558] systemd[1]: Mounted Huge Pages File System. machine # [ 6.559634] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.560773] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.561769] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.563369] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.565040] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.566542] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.567923] systemd[1]: Mounted FUSE Control File System. machine # [ 6.571143] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.573756] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.587967] systemd-journald[333]: Collecting audit messages is enabled. machine # [ 6.593450] loop: module loaded machine # [ 6.598872] systemd[1]: Finished Load Kernel Modules. machine # [ 6.599651] EXT4-fs (vda): re-mounted e44400f4-16e9-4e77-8dc3-81b723eb7f4d. machine # [ 6.602202] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.604897] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.451343] systemd[1]: Queued start job for default target M[ 6.606104] systemd[1]: Started Journal Service. machine # ulti-User System. machine # [ 6.453368] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.455414] systemd-modules-load[334]: Using 2 probe threads machine # [ 6.456557] systemd-modules-load[334]: Inserted module 'loop' machine # [ 6.457955] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.459127] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.460457] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.461610] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.464290] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.468067] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.637574] systemd-journald[333]: Received client request to flush runtime journal. machine # [ 6.541112] systemd-oomd[336]: No swap; memory pressure usage will be degraded machine # [ 6.542906] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.544173] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.545293] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.546085] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.547080] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.547881] systemd[1]: Reached target First Boot Complete. machine # [ 6.548727] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.549667] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.550709] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.551811] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.564890] systemd-udevd[362]: Using default interface naming scheme 'v261'. machine # [ 6.597419] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.604722] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.677145] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.696799] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.720914] (udev-worker)[391]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.723722] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.725346] (udev-worker)[374]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.726583] (udev-worker)[391]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.748581] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.751975] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.753654] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.756180] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.757888] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.759545] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.924824] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.926141] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.940128] Console: switching to colour dummy device 80x25 machine # [ 6.941357] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.941359] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.947387] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.948176] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.950332] mousedev: PS/2 mouse device common for all mice machine # [ 6.951200] ACPI: button: Power Button [PWRF] machine # [ 6.958111] Console: switching to colour frame buffer device 160x50 machine # [ 6.959413] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.973877] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.979589] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.981700] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.987973] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.997110] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.997857] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.998464] rtc_cmos PNP0B00:00: setting system clock to 2026-09-27T14:59:52 UTC (1790521192) machine # [ 6.999573] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.999874] systemd-journald[333]: Time jumped backwards, rotating. machine # [ 7.027543] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.029950] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 7.036803] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.038850] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.910432] systemd[1]: Starting Virtual Console Setup... machine # [ 6.930064] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 7.089741] ppdev: user-space parallel port driver machine # [ 6.936157] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.940055] systemd[1]: Starting Virtual Console Setup... machine # [ 6.945051] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.946161] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.949058] systemd[1]: Starting Virtual Console Setup... machine # [ 7.146273] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.147934] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 7.171624] kvm_amd: TSC scaling supported machine # [ 7.172145] kvm_amd: Nested Virtualization enabled machine # [ 7.172742] kvm_amd: Nested Paging enabled machine # [ 7.173196] kvm_amd: LBR virtualization supported machine # [ 7.173810] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.174399] kvm_amd: Virtual GIF supported machine # [ 7.174893] kvm_amd: Virtual NMI enabled machine # [ 7.267340] EDAC MC: Ver: 3.0.0 machine # [ 7.138671] systemd-vconsole-setup[409]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.141387] systemd[1]: Finished Virtual Console Setup. machine # [ 7.229865] systemd[1]: Mounting /run/wrappers... machine # [ 7.253219] systemd[1]: Mounted /run/wrappers. machine # [ 7.254756] systemd[1]: Reached target Local File Systems. machine # [ 7.257940] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.261115] systemd[1]: Starting register-nix-paths.service... machine # [ 7.263700] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.265278] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.269710] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.278335] systemd[1]: Starting Create System Files and Directories... machine # [ 7.342050] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.344510] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.357476] systemd[1]: Finished Create System Files and Directories. machine # [ 7.360101] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.361583] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.391932] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.398956] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.401507] systemd[1]: Starting Update is Completed... machine # [ 7.423926] systemd[1]: Finished Update is Completed. machine # [ 7.551053] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.552574] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.786237] systemd[1]: Finished register-nix-paths.service. machine # [ 7.787761] systemd[1]: Reached target System Initialization. machine # [ 7.789170] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.790664] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.792058] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.793509] systemd[1]: Reached target Timer Units. machine # [ 7.794685] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.799116] systemd[1]: Listening on niks3 server socket. machine # [ 7.800498] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.801734] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.803398] systemd[1]: Reached target Socket Units. machine # [ 7.804642] systemd[1]: Reached target Basic System. machine # [ 7.806065] systemd[1]: Started backdoor.service. machine # [ 7.807363] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.809944] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.829205] systemd[1]: Starting Post-Boot Actions... machine # [ 7.831599] systemd[1]: Started Reset console on configuration changes. machine # [ 7.835838] systemd[1]: Starting resolvconf update... machine # [ 7.839142] systemd[1]: Started rustfs.service. machine # [ 7.848294] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.854864] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.875472] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.877595] nsncd[493]: Sep 27 14:59:53.530 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.879904] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.880926] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.881921] systemd[1]: Starting User Login Management... machine # [ 7.882780] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine # [ 7.909475] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: (connecting took 8.58 seconds) machine: (finished: waiting for the VM to finish booting, in 8.88 seconds) machine # [ 7.943479] systemd-logind[517]: New seat seat0. machine # [ 7.946046] systemd-logind[517]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.948582] systemd-logind[517]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.949533] systemd-logind[517]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.950563] systemd[1]: Started User Login Management. machine # [ 7.951347] systemd[1]: Starting linger-users.service... machine # [ 7.952962] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.968426] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' machine # [ 7.969146] dbus-broker-launch[501]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.984497] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.989898] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.990864] systemd[1]: Finished linger-users.service. machine # [ 7.995314] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.995951] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.996712] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.997184] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.997647] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.998449] dbus-broker-launch[501]: Ready machine # [ 8.002832] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.003586] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.009367] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.043688] nsncd[598]: Sep 27 14:59:53.698 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.045707] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.046612] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.047511] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.063325] systemd[1]: Finished resolvconf update. machine # [ 8.064048] systemd[1]: Reached target Preparation for Network. machine # [ 8.066754] systemd[1]: Starting DHCP Client... machine # [ 8.068258] systemd[1]: Starting Address configuration of eth1... machine # [ 8.072266] systemd[1]: Starting Extra networking commands.... machine # [ 8.142875] network-addresses-eth1-start[628]: adding address 192.168.1.1/24... done machine # [ 8.157387] network-addresses-eth1-start[628]: adding address 2001:db8:1::1/64... done machine # [ 8.170507] dhcpcd[636]: dhcpcd-10.3.2 starting machine # [ 8.171629] systemd[1]: Finished Address configuration of eth1. machine # [ 8.175925] dhcpcd[682]: dev: loaded udev machine # [ 8.340386] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.341563] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.197859] systemd[1]: Finished Extra networking commands.. machine # [ 8.198950] systemd[1]: Reached target Network. machine # [ 8.201310] systemd[1]: Starting PostgreSQL Server... machine # [ 8.203467] systemd[1]: Starting Permit User Sessions... machine # [ 8.214311] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.228063] systemd[1]: Finished Permit User Sessions. machine # [ 8.230479] systemd[1]: Started Getty on tty1. machine # [ 8.231563] systemd[1]: Reached target Login Prompts. machine # [ 8.443776] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.457576] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.458970] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.460766] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.461998] cfg80211: failed to load regulatory.db machine # [ 8.326387] postgresql-pre-start[712]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.328084] postgresql-pre-start[712]: This user must also own the server process. machine # [ 8.329268] postgresql-pre-start[712]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.331064] postgresql-pre-start[712]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.332407] postgresql-pre-start[712]: The default text search configuration will be set to "english". machine # [ 8.333730] postgresql-pre-start[712]: Data page checksums are enabled. machine # [ 8.334748] postgresql-pre-start[712]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.336145] postgresql-pre-start[712]: creating subdirectories ... ok machine # [ 8.337120] postgresql-pre-start[712]: selecting dynamic shared memory implementation ... posix machine # [ 8.500910] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.348546] dhcpcd[682]: eth0: waiting for carrier machine # [ 8.349399] dhcpcd[682]: eth0: carrier acquired machine # [ 8.357811] dhcpcd[682]: DUID 00:01:00:01:32:4b:eb:ea:52:54:00:12:34:56 machine # [ 8.358893] dhcpcd[682]: eth0: IAID 00:12:34:56 machine # [ 8.359643] dhcpcd[682]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.393657] postgresql-pre-start[712]: selecting default "max_connections" ... 100 machine # [ 8.439583] postgresql-pre-start[712]: selecting default "shared_buffers" ... 128MB machine # [ 9.172909] postgresql-pre-start[712]: selecting default time zone ... UTC machine # [ 9.174786] postgresql-pre-start[712]: creating configuration files ... ok machine # [ 9.360202] postgresql-pre-start[712]: running bootstrap script ... ok machine # [ 9.752709] postgresql-pre-start[712]: performing post-bootstrap initialization ... ok machine # [ 9.893185] postgresql-pre-start[712]: syncing data to disk ... ok machine # [ 9.894217] postgresql-pre-start[712]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.895514] postgresql-pre-start[712]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.897555] postgresql-pre-start[712]: Success. You can now start the database server using: machine # [ 9.898644] postgresql-pre-start[712]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.040969] postgres[749]: [749] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.045162] postgres[749]: [749] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.046252] postgres[749]: [749] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.052076] postgres[749]: [749] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.064281] postgres[758]: [758] LOG: database system was shut down at 2026-09-27 14:59:55 GMT machine # [ 10.073648] postgres[749]: [749] LOG: database system is ready to accept connections machine # [ 10.079441] systemd[1]: Started PostgreSQL Server. machine # [ 10.085350] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.107437] dhcpcd[682]: eth0: soliciting a DHCP lease machine # [ 10.279885] NET: Registered PF_PACKET protocol family machine # [ 10.137833] dhcpcd[682]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 10.141579] dhcpcd[682]: eth0: probing address 10.0.2.15/24 machine # [ 10.245837] dhcpcd[682]: eth0: soliciting an IPv6 router machine # [ 10.247069] dhcpcd[682]: eth0: Router Advertisement from fe80::2 machine # [ 10.247929] dhcpcd[682]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.248915] dhcpcd[682]: eth0: adding route to fec0::/64 machine # [ 10.249747] dhcpcd[682]: eth0: adding default route via fe80::2 machine # [ 10.267388] postgresql-setup-start[780]: CREATE DATABASE machine # [ 10.307911] postgresql-setup-start[785]: CREATE ROLE machine # [ 10.331735] postgresql-setup-start[787]: ALTER DATABASE machine # [ 10.335893] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.337315] systemd[1]: Reached target PostgreSQL. machine # [ 15.491793] dhcpcd[682]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 15.494232] dhcpcd[682]: eth0: adding route to 10.0.2.0/24 machine # [ 15.496342] dhcpcd[682]: eth0: adding default route via 10.0.2.2 machine # [ 15.641836] systemd[1]: Started DHCP Client. machine # [ 15.643806] systemd[1]: Reached target Network is Online. machine # [ 15.646941] systemd[1]: Starting k3s service... machine # [ 15.737611] k3s[896]: time="2026-09-27T15:00:01Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 15.739234] k3s[896]: time="2026-09-27T15:00:01Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 16.700532] rustfs-bucket-start[906]: mb s3://farm machine # [ 16.704925] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.920221] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 17.931637] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.932819] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.933606] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.947731] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.948821] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.955723] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.957922] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.958782] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.959941] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.961072] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:03.615900483 +0000 UTC notAfter=2036-09-24 14:00:03.615900483 +0000 UTC" machine # [ 17.961787] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.962927] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.964072] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.964794] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.965917] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.967131] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.968023] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790521203: notBefore=2026-09-27 14:00:03.619077423 +0000 UTC notAfter=2036-09-24 14:00:03.619077423 +0000 UTC" machine # [ 17.968613] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.969847] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.970762] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.971632] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790521203: notBefore=2026-09-27 14:00:03.620623709 +0000 UTC notAfter=2036-09-24 14:00:03.620623709 +0000 UTC" machine # [ 17.972829] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.973728] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790521203: notBefore=2026-09-27 14:00:03.621322401 +0000 UTC notAfter=2036-09-24 14:00:03.621322401 +0000 UTC" machine # [ 17.974634] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.975843] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790521203: notBefore=2026-09-27 14:00:03.621959353 +0000 UTC notAfter=2036-09-24 14:00:03.621959353 +0000 UTC" machine # [ 17.976734] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 17.977929] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 18.019342] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790521203: notBefore=2026-09-27 14:00:03 +0000 UTC notAfter=2027-09-27 14:00:03 +0000 UTC" machine # [ 18.022488] k3s[896]: time="2026-09-27T15:00:03Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 18.026135] k3s[896]: time="2026-09-27T15:00:03Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__ab5b_2276_8f75_4eb6-d56646:fec0::ab5b:2276:8f75:4eb6 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=870079A371DF50E0B2D455C25EA27E15CAABC2F3]" machine # [ 18.969596] k3s[896]: time="2026-09-27T15:00:04Z" level=info msg="Password verified locally for node machine" machine # [ 18.973104] k3s[896]: time="2026-09-27T15:00:04Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790521203: notBefore=2026-09-27 14:00:04 +0000 UTC notAfter=2027-09-27 14:00:04 +0000 UTC" machine # [ 19.216155] k3s[896]: time="2026-09-27T15:00:04Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:04 +0000 UTC notAfter=2027-09-27 14:00:04 +0000 UTC" machine # [ 19.307115] k3s[896]: time="2026-09-27T15:00:04Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:04 +0000 UTC notAfter=2027-09-27 14:00:04 +0000 UTC" machine # [ 19.410669] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790521203: notBefore=2026-09-27 14:00:05 +0000 UTC notAfter=2027-09-27 14:00:05 +0000 UTC" machine # [ 19.516496] k3s[896]: time="2026-09-27T15:00:05Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:46202: runtime core not ready" machine # [ 19.626593] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Module overlay was already loaded" machine # [ 19.852319] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.859674] Bridge firewalling registered machine # [ 19.718802] k3s[896]: time="2026-09-27T15:00:05Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.729344] k3s[896]: time="2026-09-27T15:00:05Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.740340] k3s[896]: time="2026-09-27T15:00:05Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.817313] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.819316] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.820315] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.821281] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.822317] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.823236] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.824241] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.825180] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Connection to etcd is ready" machine # [ 19.826163] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="ETCD server is now running" machine # [ 19.829213] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.835882] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.837347] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.847140] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.869526] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.870650] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.871622] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.872578] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.876704] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.883214] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.884155] k3s[896]: I0927 15:00:05.539767 896 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.904129] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.911878] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.912847] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.913671] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.914330] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.915316] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.915929] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Run: k3s kubectl" machine # [ 19.920387] k3s[896]: I0927 15:00:05.576481 896 server.go:158] Version: v1.35.8+k3s1 machine # [ 19.921037] k3s[896]: I0927 15:00:05.576532 896 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.982422] k3s[896]: time="2026-09-27T15:00:05Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:46248: runtime core not ready" machine # [ 20.074103] k3s[896]: I0927 15:00:05.730064 896 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 20.077096] k3s[896]: I0927 15:00:05.733209 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 20.078650] k3s[896]: I0927 15:00:05.734744 896 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 20.079455] k3s[896]: I0927 15:00:05.734773 896 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 20.079993] k3s[896]: I0927 15:00:05.735062 896 instance.go:240] Using reconciler: lease machine # [ 20.085768] k3s[896]: I0927 15:00:05.741865 896 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 20.086528] k3s[896]: W0927 15:00:05.741892 896 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 20.087931] k3s[896]: I0927 15:00:05.744036 896 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 20.101979] k3s[896]: time="2026-09-27T15:00:05Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 20.121187] k3s[896]: I0927 15:00:05.777287 896 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 20.122121] k3s[896]: I0927 15:00:05.778244 896 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 20.149517] k3s[896]: I0927 15:00:05.805560 896 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 20.189759] k3s[896]: I0927 15:00:05.845821 896 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 20.190446] k3s[896]: W0927 15:00:05.845864 896 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 20.190885] k3s[896]: W0927 15:00:05.845876 896 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 20.191568] k3s[896]: I0927 15:00:05.846235 896 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 20.192029] k3s[896]: W0927 15:00:05.846251 896 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.192536] k3s[896]: I0927 15:00:05.846911 896 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 20.192994] k3s[896]: I0927 15:00:05.847412 896 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 20.193465] k3s[896]: W0927 15:00:05.847428 896 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 20.193979] k3s[896]: W0927 15:00:05.847439 896 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 20.194679] k3s[896]: I0927 15:00:05.848344 896 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 20.195170] k3s[896]: W0927 15:00:05.848362 896 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 20.195670] k3s[896]: I0927 15:00:05.848870 896 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 20.196186] k3s[896]: W0927 15:00:05.848886 896 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 20.196676] k3s[896]: W0927 15:00:05.848896 896 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 20.197193] k3s[896]: I0927 15:00:05.849242 896 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 20.197687] k3s[896]: W0927 15:00:05.849256 896 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 20.198193] k3s[896]: W0927 15:00:05.849267 896 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 20.198683] k3s[896]: I0927 15:00:05.849609 896 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 20.199160] k3s[896]: W0927 15:00:05.849624 896 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 20.199648] k3s[896]: I0927 15:00:05.850952 896 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 20.200105] k3s[896]: W0927 15:00:05.850971 896 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 20.200543] k3s[896]: I0927 15:00:05.851249 896 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 20.201023] k3s[896]: W0927 15:00:05.851267 896 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 20.201487] k3s[896]: W0927 15:00:05.851278 896 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 20.201950] k3s[896]: I0927 15:00:05.851863 896 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 20.202595] k3s[896]: W0927 15:00:05.851883 896 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 20.203078] k3s[896]: I0927 15:00:05.852877 896 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 20.203594] k3s[896]: W0927 15:00:05.852894 896 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.204075] k3s[896]: W0927 15:00:05.852905 896 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 20.204550] k3s[896]: I0927 15:00:05.853160 896 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 20.205034] k3s[896]: W0927 15:00:05.853197 896 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 20.205758] k3s[896]: W0927 15:00:05.853208 896 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 20.206427] k3s[896]: I0927 15:00:05.854646 896 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 20.206908] k3s[896]: W0927 15:00:05.854665 896 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 20.207575] k3s[896]: W0927 15:00:05.854676 896 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 20.208056] k3s[896]: I0927 15:00:05.855343 896 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 20.208554] k3s[896]: W0927 15:00:05.855360 896 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 20.209080] k3s[896]: W0927 15:00:05.855371 896 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 20.209557] k3s[896]: W0927 15:00:05.855381 896 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 20.210106] k3s[896]: I0927 15:00:05.857772 896 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 20.210578] k3s[896]: W0927 15:00:05.857791 896 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 20.211066] k3s[896]: W0927 15:00:05.857803 896 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 20.211554] k3s[896]: I0927 15:00:05.859340 896 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 20.212064] k3s[896]: W0927 15:00:05.859357 896 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.212395] k3s[896]: W0927 15:00:05.859368 896 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 20.213995] k3s[896]: I0927 15:00:05.859954 896 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 20.255256] k3s[896]: W0927 15:00:05.859972 896 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 20.255885] k3s[896]: I0927 15:00:05.862296 896 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 20.256604] k3s[896]: W0927 15:00:05.862315 896 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 20.257110] k3s[896]: W0927 15:00:05.862326 896 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 20.257564] k3s[896]: W0927 15:00:05.862335 896 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 20.258052] k3s[896]: I0927 15:00:05.865727 896 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 20.258569] k3s[896]: W0927 15:00:05.865762 896 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.565899] k3s[896]: I0927 15:00:06.221838 896 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.566666] k3s[896]: I0927 15:00:06.221981 896 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.567109] k3s[896]: I0927 15:00:06.221840 896 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.572362] k3s[896]: I0927 15:00:06.228445 896 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 20.572952] k3s[896]: I0927 15:00:06.228565 896 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.573267] k3s[896]: I0927 15:00:06.228597 896 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.573767] k3s[896]: I0927 15:00:06.228724 896 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.574424] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.574944] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.578727] k3s[896]: I0927 15:00:06.229448 896 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.579164] k3s[896]: I0927 15:00:06.229467 896 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.579632] k3s[896]: I0927 15:00:06.229492 896 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.580109] k3s[896]: I0927 15:00:06.229532 896 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.580599] k3s[896]: I0927 15:00:06.229592 896 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.581104] k3s[896]: I0927 15:00:06.229605 896 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.581551] k3s[896]: I0927 15:00:06.230246 896 controller.go:142] Starting OpenAPI controller machine # [ 20.582061] k3s[896]: I0927 15:00:06.230594 896 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.582558] k3s[896]: I0927 15:00:06.230610 896 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.583089] k3s[896]: I0927 15:00:06.231454 896 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.583585] k3s[896]: I0927 15:00:06.231506 896 naming_controller.go:305] Starting NamingConditionController machine # [ 20.587086] k3s[896]: I0927 15:00:06.232333 896 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.587601] k3s[896]: I0927 15:00:06.232350 896 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.588120] k3s[896]: I0927 15:00:06.232688 896 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 20.588270] k3s[896]: I0927 15:00:06.232708 896 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 20.588740] k3s[896]: I0927 15:00:06.233358 896 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.589436] k3s[896]: I0927 15:00:06.233372 896 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.589945] k3s[896]: I0927 15:00:06.233410 896 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 20.590573] k3s[896]: I0927 15:00:06.233421 896 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.591058] k3s[896]: I0927 15:00:06.233467 896 controller.go:78] Starting OpenAPI AggregationController machine # [ 20.591577] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.592082] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.592567] k3s[896]: I0927 15:00:06.236991 896 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.593088] k3s[896]: I0927 15:00:06.237032 896 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.593616] k3s[896]: I0927 15:00:06.237105 896 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 20.597086] k3s[896]: I0927 15:00:06.237227 896 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 20.616349] k3s[896]: I0927 15:00:06.272433 896 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.617060] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.617720] k3s[896]: I0927 15:00:06.272529 896 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.621533] k3s[896]: I0927 15:00:06.277641 896 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.672885] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.674171] k3s[896]: I0927 15:00:06.330283 896 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.674797] k3s[896]: I0927 15:00:06.330310 896 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.675322] k3s[896]: I0927 15:00:06.330438 896 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 20.675824] k3s[896]: I0927 15:00:06.330536 896 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 20.676474] k3s[896]: I0927 15:00:06.330618 896 aggregator.go:187] initial CRD sync complete... machine # [ 20.676958] k3s[896]: I0927 15:00:06.330634 896 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.677696] k3s[896]: I0927 15:00:06.330649 896 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.678231] k3s[896]: I0927 15:00:06.330661 896 cache.go:39] Caches are synced for autoregister controller machine # [ 20.678749] k3s[896]: I0927 15:00:06.330710 896 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.679423] k3s[896]: I0927 15:00:06.332928 896 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 20.679869] k3s[896]: I0927 15:00:06.332962 896 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 20.680503] k3s[896]: I0927 15:00:06.332980 896 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.681173] k3s[896]: I0927 15:00:06.333392 896 shared_informer.go:377] "Caches are synced" machine # [ 20.681675] k3s[896]: I0927 15:00:06.333422 896 policy_source.go:248] refreshing policies machine # [ 20.682234] k3s[896]: I0927 15:00:06.333505 896 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.682650] k3s[896]: I0927 15:00:06.333575 896 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.683159] k3s[896]: I0927 15:00:06.333646 896 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 20.683654] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.702122] k3s[896]: I0927 15:00:06.356277 896 controller.go:667] quota admission added evaluator for: namespaces machine # [ 20.703724] k3s[896]: E0927 15:00:06.359813 896 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 20.704571] k3s[896]: I0927 15:00:06.359900 896 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.709035] k3s[896]: I0927 15:00:06.365063 896 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.712301] k3s[896]: I0927 15:00:06.367430 896 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.713927] k3s[896]: I0927 15:00:06.368016 896 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.721318] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.735715] k3s[896]: I0927 15:00:06.391770 896 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.740599] k3s[896]: W0927 15:00:06.396702 896 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.742749] k3s[896]: I0927 15:00:06.398850 896 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.747036] k3s[896]: I0927 15:00:06.403116 896 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 20.756736] k3s[896]: E0927 15:00:06.412766 896 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 20.840863] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="containerd is now running" machine # [ 20.851346] k3s[896]: time="2026-09-27T15:00:06Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 20.907977] k3s[896]: I0927 15:00:06.564028 896 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 21.583451] k3s[896]: I0927 15:00:07.239081 896 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.589957] k3s[896]: I0927 15:00:07.246032 896 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.590605] k3s[896]: I0927 15:00:07.246055 896 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 21.825354] k3s[896]: time="2026-09-27T15:00:07Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 22.483795] k3s[896]: I0927 15:00:08.139839 896 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.525383] k3s[896]: I0927 15:00:08.181281 896 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 23.830557] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Kube API server is now running" machine # [ 23.831355] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="k3s is up and running" machine # [ 23.832080] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Waiting for untainted node" machine # [ 23.832966] systemd[1]: Started k3s service. machine # [ 23.837787] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.838777] systemd[1]: Starting niks3 server... machine # [ 23.846908] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.855899] k3s[896]: I0927 15:00:09.512004 896 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 23.856622] k3s[896]: I0927 15:00:09.512035 896 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.864065] k3s[896]: I0927 15:00:09.518157 896 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.864797] k3s[896]: I0927 15:00:09.518187 896 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 23.865271] k3s[896]: I0927 15:00:09.518208 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.865861] k3s[896]: I0927 15:00:09.518252 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.866276] k3s[896]: I0927 15:00:09.518272 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.866815] k3s[896]: I0927 15:00:09.518275 896 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.867316] k3s[896]: I0927 15:00:09.518300 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.867844] k3s[896]: I0927 15:00:09.518316 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.868498] k3s[896]: I0927 15:00:09.518350 896 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.889091] k3s[896]: I0927 15:00:09.545116 896 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.942672] k3s[896]: I0927 15:00:09.598730 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.961603] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.963056] k3s[896]: I0927 15:00:09.618690 896 shared_informer.go:377] "Caches are synced" machine # [ 23.963719] k3s[896]: I0927 15:00:09.619074 896 shared_informer.go:377] "Caches are synced" machine # [ 23.964233] k3s[896]: I0927 15:00:09.618816 896 shared_informer.go:377] "Caches are synced" machine # [ 23.966911] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.974118] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.978278] k3s[896]: I0927 15:00:09.634198 896 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 23.981939] k3s[896]: I0927 15:00:09.638054 896 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.987120] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.993061] k3s[896]: I0927 15:00:09.649129 896 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.000033] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.018116] k3s[896]: I0927 15:00:09.674204 896 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.042969] k3s[896]: I0927 15:00:09.699025 896 shared_informer.go:377] "Caches are synced" machine # [ 24.075959] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 24.079753] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 24.080479] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 24.086418] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 24.087321] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 24.090306] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 24.091115] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 24.097476] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 24.098180] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 24.102792] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 24.103581] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 24.108864] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 24.109326] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 24.120063] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 24.120805] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 24.122608] k3s[896]: time="2026-09-27T15:00:09Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 24.390788] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.539867218s" machine # [ 24.391392] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 24.514847] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.515623] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.523420] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.525270] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 24.527874] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 24.531083] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.531790] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.532396] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.532934] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.533617] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.534158] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.638092] k3s[896]: I0927 15:00:10.294120 896 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine: (finished: waiting for unit k3s.service, in 25.75 seconds) machine: waiting for success: kubectl get ns farm machine # [ 24.793913] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::ab5b:2276:8f75:4eb6 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.794660] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Tunnel server egress proxy mode: agent" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.021588] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__ab5b_2276_8f75_4eb6-d56646:fec0::ab5b:2276:8f75:4eb6 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=870079A371DF50E0B2D455C25EA27E15CAABC2F3]" machine # [ 25.039126] k3s[896]: time="2026-09-27T15:00:10Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=237) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__ab5b_2276_8f75_4eb6-d56646:fec0::ab5b:2276:8f75:4eb6 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=870079A371DF50E0B2D455C25EA27E15CAABC2F3]" machine # [ 25.191408] k3s[896]: I0927 15:00:10.847276 896 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 25.193423] k3s[896]: I0927 15:00:10.847433 896 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 25.194792] k3s[896]: I0927 15:00:10.847478 896 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 25.197387] k3s[896]: I0927 15:00:10.847548 896 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 25.541472] k3s[896]: I0927 15:00:11.197338 896 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 25.914161] k3s[896]: time="2026-09-27T15:00:11Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.916076] k3s[896]: time="2026-09-27T15:00:11Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.924466] k3s[896]: I0927 15:00:11.580482 896 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.931063] k3s[896]: time="2026-09-27T15:00:11Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.931981] k3s[896]: time="2026-09-27T15:00:11Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.944064] k3s[896]: time="2026-09-27T15:00:11Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.945916] k3s[896]: time="2026-09-27T15:00:11Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.952662] k3s[896]: time="2026-09-27T15:00:11Z" level=info msg="Cluster dns configmap has been set successfully" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 26.240075] k3s[896]: I0927 15:00:11.895744 896 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 26.389124] k3s[896]: W0927 15:00:12.045112 896 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 26.395966] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 26.406401] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 26.543324] k3s[896]: I0927 15:00:12.199134 896 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 26.545374] k3s[896]: I0927 15:00:12.199262 896 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 26.700128] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 26.713531] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 26.934170] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.988084] k3s[896]: I0927 15:00:12.643830 896 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 26.993116] k3s[896]: I0927 15:00:12.649146 896 serving.go:392] Generated self-signed cert in-memory machine # [ 27.048893] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 27.053125] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 27.054848] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 27.056237] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 27.057642] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 27.059020] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 27.060541] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 27.066958] k3s[896]: I0927 15:00:12.723004 896 serving.go:392] Generated self-signed cert in-memory machine # [ 27.139050] k3s[896]: I0927 15:00:12.795071 896 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 27.139493] k3s[896]: I0927 15:00:12.795104 896 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 27.187767] k3s[896]: I0927 15:00:12.843769 896 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 27.190936] k3s[896]: I0927 15:00:12.847053 896 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 27.192679] k3s[896]: I0927 15:00:12.848230 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.194126] k3s[896]: I0927 15:00:12.847442 896 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 27.195538] k3s[896]: I0927 15:00:12.847220 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 27.198171] k3s[896]: I0927 15:00:12.848330 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.199902] k3s[896]: I0927 15:00:12.847195 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 27.203022] k3s[896]: I0927 15:00:12.848543 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.204497] k3s[896]: I0927 15:00:12.847460 896 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 27.206123] k3s[896]: time="2026-09-27T15:00:12Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 27.289045] k3s[896]: I0927 15:00:12.944745 896 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 27.291850] k3s[896]: I0927 15:00:12.944778 896 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 27.293880] k3s[896]: I0927 15:00:12.949340 896 shared_informer.go:377] "Caches are synced" machine # [ 27.295184] k3s[896]: I0927 15:00:12.949500 896 shared_informer.go:377] "Caches are synced" machine # [ 27.299363] k3s[896]: I0927 15:00:12.950070 896 shared_informer.go:377] "Caches are synced" machine: (finished: waiting for success: kubectl get ns farm, in 2.53 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 27.443838] k3s[896]: I0927 15:00:13.098949 896 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 27.473635] k3s[896]: I0927 15:00:13.129502 896 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 27.475556] k3s[896]: time="2026-09-27T15:00:13Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 27.497292] k3s[896]: time="2026-09-27T15:00:13Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 27.502865] k3s[896]: time="2026-09-27T15:00:13Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 27.508069] k3s[896]: time="2026-09-27T15:00:13Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 27.514764] k3s[896]: I0927 15:00:13.170711 896 controllermanager.go:329] Started "cloud-node-controller" machine # [ 27.516244] k3s[896]: I0927 15:00:13.170832 896 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 27.517739] k3s[896]: I0927 15:00:13.171222 896 controllermanager.go:329] Started "service-lb-controller" machine # [ 27.520539] k3s[896]: W0927 15:00:13.171236 896 controllermanager.go:306] "node-route-controller" is disabled machine # [ 27.521576] k3s[896]: time="2026-09-27T15:00:13Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 27.522763] k3s[896]: I0927 15:00:13.171904 896 node_controller.go:176] Sending events to api server. machine # [ 27.523260] k3s[896]: I0927 15:00:13.171940 896 node_lifecycle_controller.go:112] Sending events to api server machine # [ 27.524139] k3s[896]: I0927 15:00:13.172089 896 node_controller.go:185] Waiting for informer caches to sync machine # [ 27.524626] k3s[896]: I0927 15:00:13.174763 896 controller.go:235] Starting service controller machine # [ 27.525116] k3s[896]: I0927 15:00:13.174787 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.597161] k3s[896]: I0927 15:00:13.253217 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 27.597909] k3s[896]: I0927 15:00:13.253266 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 27.598591] k3s[896]: I0927 15:00:13.253294 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 27.599116] k3s[896]: I0927 15:00:13.253319 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 27.599705] k3s[896]: I0927 15:00:13.253347 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 27.600234] k3s[896]: I0927 15:00:13.253372 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 27.600836] k3s[896]: I0927 15:00:13.253401 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 27.601730] k3s[896]: I0927 15:00:13.253463 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 27.602258] k3s[896]: I0927 15:00:13.253489 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 27.603124] k3s[896]: I0927 15:00:13.253510 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 27.604048] k3s[896]: I0927 15:00:13.253533 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 27.604846] k3s[896]: I0927 15:00:13.253558 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 27.605842] k3s[896]: I0927 15:00:13.253580 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 27.606664] k3s[896]: I0927 15:00:13.253604 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 27.607710] k3s[896]: I0927 15:00:13.253640 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 27.608670] k3s[896]: I0927 15:00:13.253665 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 27.609720] k3s[896]: I0927 15:00:13.253700 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 27.610680] k3s[896]: I0927 15:00:13.253723 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 27.611757] k3s[896]: I0927 15:00:13.253745 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 27.612780] k3s[896]: I0927 15:00:13.253781 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 27.613803] k3s[896]: I0927 15:00:13.253815 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 27.614668] k3s[896]: I0927 15:00:13.253836 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 27.615647] k3s[896]: I0927 15:00:13.253879 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 27.616633] k3s[896]: I0927 15:00:13.253913 896 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.23 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 27.719564] k3s[896]: I0927 15:00:13.375570 896 shared_informer.go:377] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.16 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 27.933895] k3s[896]: time="2026-09-27T15:00:13Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.136677] k3s[896]: I0927 15:00:13.792660 896 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 28.439174] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 28.448437] k3s[896]: I0927 15:00:14.098686 896 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 28.449320] k3s[896]: I0927 15:00:14.098715 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.449756] k3s[896]: I0927 15:00:14.098781 896 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 28.450388] k3s[896]: I0927 15:00:14.098816 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.450900] k3s[896]: I0927 15:00:14.098994 896 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 28.452559] k3s[896]: I0927 15:00:14.099009 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.453099] k3s[896]: I0927 15:00:14.099245 896 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.453586] k3s[896]: I0927 15:00:14.099259 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.454099] k3s[896]: I0927 15:00:14.099435 896 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 28.454620] k3s[896]: I0927 15:00:14.099450 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.457085] k3s[896]: I0927 15:00:14.099596 896 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.457814] k3s[896]: I0927 15:00:14.099612 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.458562] k3s[896]: I0927 15:00:14.099692 896 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 28.459085] k3s[896]: I0927 15:00:14.099706 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.459617] k3s[896]: I0927 15:00:14.099790 896 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.461256] k3s[896]: I0927 15:00:14.099804 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.461765] k3s[896]: I0927 15:00:14.099905 896 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.462451] k3s[896]: I0927 15:00:14.099919 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.462953] k3s[896]: I0927 15:00:14.100084 896 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 28.463688] k3s[896]: I0927 15:00:14.100099 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.465477] k3s[896]: I0927 15:00:14.100189 896 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.466117] k3s[896]: I0927 15:00:14.100201 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.466608] k3s[896]: I0927 15:00:14.100264 896 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 28.467152] k3s[896]: I0927 15:00:14.100278 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.467708] k3s[896]: I0927 15:00:14.100329 896 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.469451] k3s[896]: I0927 15:00:14.100342 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.470146] k3s[896]: I0927 15:00:14.100383 896 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.470664] k3s[896]: I0927 15:00:14.100397 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.471227] k3s[896]: I0927 15:00:14.100426 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.471766] k3s[896]: I0927 15:00:14.100504 896 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.472494] k3s[896]: I0927 15:00:14.100517 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.473649] k3s[896]: I0927 15:00:14.100567 896 gc_controller.go:98] "Starting GC controller" machine # [ 28.474664] k3s[896]: I0927 15:00:14.100578 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.475483] k3s[896]: I0927 15:00:14.100611 896 disruption.go:458] "Sending events to api server." machine # [ 28.476022] k3s[896]: I0927 15:00:14.100644 896 disruption.go:465] "Starting disruption controller" machine # [ 28.476495] k3s[896]: I0927 15:00:14.100654 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.477177] k3s[896]: I0927 15:00:14.100704 896 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 28.477678] k3s[896]: I0927 15:00:14.100736 896 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 28.478230] k3s[896]: I0927 15:00:14.100745 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.478917] k3s[896]: I0927 15:00:14.100789 896 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.479618] k3s[896]: I0927 15:00:14.100803 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.480153] k3s[896]: I0927 15:00:14.100878 896 controller.go:423] "Starting resource claim controller" machine # [ 28.480711] k3s[896]: I0927 15:00:14.100892 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.481223] k3s[896]: I0927 15:00:14.100923 896 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.481949] k3s[896]: I0927 15:00:14.100974 896 taint_eviction.go:288] "Sending events to API server" machine # [ 28.482597] k3s[896]: I0927 15:00:14.100986 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.483133] k3s[896]: I0927 15:00:14.101053 896 job_controller.go:254] "Starting job controller" machine # [ 28.483605] k3s[896]: I0927 15:00:14.101066 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.484083] k3s[896]: I0927 15:00:14.101133 896 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 28.484606] k3s[896]: I0927 15:00:14.101146 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.485118] k3s[896]: I0927 15:00:14.101193 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.485612] k3s[896]: I0927 15:00:14.101204 896 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.486147] k3s[896]: I0927 15:00:14.101217 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.486699] k3s[896]: I0927 15:00:14.101246 896 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.487259] k3s[896]: I0927 15:00:14.101260 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.487801] k3s[896]: I0927 15:00:14.101323 896 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 28.488494] k3s[896]: I0927 15:00:14.101337 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.488987] k3s[896]: I0927 15:00:14.101367 896 expand_controller.go:328] "Starting expand controller" machine # [ 28.489734] k3s[896]: I0927 15:00:14.101379 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.490434] k3s[896]: I0927 15:00:14.101454 896 stateful_set.go:180] "Starting stateful set controller" machine # [ 28.490892] k3s[896]: I0927 15:00:14.101466 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.491567] k3s[896]: I0927 15:00:14.101544 896 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.492074] k3s[896]: I0927 15:00:14.101556 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.492612] k3s[896]: I0927 15:00:14.101612 896 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.493166] k3s[896]: I0927 15:00:14.101624 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.493671] k3s[896]: I0927 15:00:14.101692 896 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 28.494149] k3s[896]: I0927 15:00:14.101704 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.494665] k3s[896]: I0927 15:00:14.101737 896 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.495212] k3s[896]: I0927 15:00:14.101749 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.495642] k3s[896]: I0927 15:00:14.102158 896 horizontal.go:204] "Starting HPA controller" machine # [ 28.496140] k3s[896]: I0927 15:00:14.102196 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.496627] k3s[896]: I0927 15:00:14.102229 896 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.497106] k3s[896]: I0927 15:00:14.102241 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.497743] k3s[896]: I0927 15:00:14.102268 896 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.498204] k3s[896]: I0927 15:00:14.102324 896 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.498711] k3s[896]: I0927 15:00:14.102336 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.499595] k3s[896]: I0927 15:00:14.102529 896 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.501053] k3s[896]: I0927 15:00:14.102544 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.502192] k3s[896]: I0927 15:00:14.102611 896 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.503630] k3s[896]: I0927 15:00:14.102623 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.504777] k3s[896]: I0927 15:00:14.102653 896 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.506598] k3s[896]: I0927 15:00:14.102666 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.507600] k3s[896]: I0927 15:00:14.102708 896 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.510032] k3s[896]: I0927 15:00:14.102826 896 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.511562] k3s[896]: I0927 15:00:14.102840 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.512529] k3s[896]: I0927 15:00:14.102912 896 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.513830] k3s[896]: I0927 15:00:14.102941 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.515023] k3s[896]: I0927 15:00:14.102980 896 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.517452] k3s[896]: I0927 15:00:14.103044 896 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.519744] k3s[896]: I0927 15:00:14.103107 896 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.522110] k3s[896]: I0927 15:00:14.103349 896 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.523437] k3s[896]: I0927 15:00:14.103510 896 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 28.539178] k3s[896]: I0927 15:00:14.195255 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.548066] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 28.580123] k3s[896]: I0927 15:00:14.236222 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.644535] k3s[896]: I0927 15:00:14.300621 896 shared_informer.go:377] "Caches are synced" machine # [ 28.645362] k3s[896]: I0927 15:00:14.301159 896 shared_informer.go:377] "Caches are synced" machine # [ 28.645962] k3s[896]: I0927 15:00:14.301695 896 shared_informer.go:377] "Caches are synced" machine # [ 28.646725] k3s[896]: I0927 15:00:14.301712 896 shared_informer.go:377] "Caches are synced" machine # [ 28.647212] k3s[896]: I0927 15:00:14.302240 896 shared_informer.go:377] "Caches are synced" machine # [ 28.647705] k3s[896]: I0927 15:00:14.301810 896 shared_informer.go:377] "Caches are synced" machine # [ 28.701130] k3s[896]: I0927 15:00:14.357105 896 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 28.707635] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 28.723757] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 28.739376] k3s[896]: I0927 15:00:14.395478 896 shared_informer.go:377] "Caches are synced" machine # [ 28.744299] k3s[896]: I0927 15:00:14.398764 896 shared_informer.go:377] "Caches are synced" machine # [ 28.745503] k3s[896]: I0927 15:00:14.399272 896 shared_informer.go:377] "Caches are synced" machine # [ 28.746748] k3s[896]: I0927 15:00:14.399290 896 shared_informer.go:377] "Caches are synced" machine # [ 28.747962] k3s[896]: I0927 15:00:14.399345 896 shared_informer.go:377] "Caches are synced" machine # [ 28.749233] k3s[896]: I0927 15:00:14.399515 896 shared_informer.go:377] "Caches are synced" machine # [ 28.751107] k3s[896]: I0927 15:00:14.399653 896 shared_informer.go:377] "Caches are synced" machine # [ 28.752432] k3s[896]: I0927 15:00:14.399695 896 range_allocator.go:177] "Sending events to api server" machine # [ 28.753770] k3s[896]: I0927 15:00:14.399720 896 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.755162] k3s[896]: I0927 15:00:14.399730 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.756991] k3s[896]: I0927 15:00:14.399741 896 shared_informer.go:377] "Caches are synced" machine # [ 28.757688] k3s[896]: I0927 15:00:14.399802 896 shared_informer.go:377] "Caches are synced" machine # [ 28.758465] k3s[896]: I0927 15:00:14.399863 896 shared_informer.go:377] "Caches are synced" machine # [ 28.758968] k3s[896]: I0927 15:00:14.400156 896 shared_informer.go:377] "Caches are synced" machine # [ 28.759721] k3s[896]: I0927 15:00:14.400239 896 shared_informer.go:377] "Caches are synced" machine # [ 28.760271] k3s[896]: I0927 15:00:14.400322 896 shared_informer.go:377] "Caches are synced" machine # [ 28.760934] k3s[896]: I0927 15:00:14.400839 896 shared_informer.go:377] "Caches are synced" machine # [ 28.761249] k3s[896]: I0927 15:00:14.401000 896 shared_informer.go:377] "Caches are synced" machine # [ 28.761828] k3s[896]: I0927 15:00:14.401069 896 shared_informer.go:377] "Caches are synced" machine # [ 28.762448] k3s[896]: I0927 15:00:14.401205 896 shared_informer.go:377] "Caches are synced" machine # [ 28.762967] k3s[896]: I0927 15:00:14.401437 896 shared_informer.go:377] "Caches are synced" machine # [ 28.763824] k3s[896]: I0927 15:00:14.401473 896 shared_informer.go:377] "Caches are synced" machine # [ 28.764534] k3s[896]: I0927 15:00:14.401503 896 shared_informer.go:377] "Caches are synced" machine # [ 28.765040] k3s[896]: I0927 15:00:14.401538 896 shared_informer.go:377] "Caches are synced" machine # [ 28.765600] k3s[896]: I0927 15:00:14.401590 896 shared_informer.go:377] "Caches are synced" machine # [ 28.766113] k3s[896]: I0927 15:00:14.401625 896 shared_informer.go:377] "Caches are synced" machine # [ 28.766707] k3s[896]: I0927 15:00:14.401653 896 shared_informer.go:377] "Caches are synced" machine # [ 28.767904] k3s[896]: I0927 15:00:14.401670 896 shared_informer.go:377] "Caches are synced" machine # [ 28.768580] k3s[896]: I0927 15:00:14.401740 896 shared_informer.go:377] "Caches are synced" machine # [ 28.769112] k3s[896]: I0927 15:00:14.402137 896 shared_informer.go:377] "Caches are synced" machine # [ 28.769593] k3s[896]: I0927 15:00:14.402257 896 shared_informer.go:377] "Caches are synced" machine # [ 28.770209] k3s[896]: I0927 15:00:14.402277 896 shared_informer.go:377] "Caches are synced" machine # [ 28.770716] k3s[896]: I0927 15:00:14.402300 896 shared_informer.go:377] "Caches are synced" machine # [ 28.771511] k3s[896]: I0927 15:00:14.402338 896 shared_informer.go:377] "Caches are synced" machine # [ 28.772079] k3s[896]: I0927 15:00:14.402363 896 shared_informer.go:377] "Caches are synced" machine # [ 28.772619] k3s[896]: I0927 15:00:14.402388 896 shared_informer.go:377] "Caches are synced" machine # [ 28.773285] k3s[896]: I0927 15:00:14.402641 896 shared_informer.go:377] "Caches are synced" machine # [ 28.773711] k3s[896]: I0927 15:00:14.402677 896 shared_informer.go:377] "Caches are synced" machine # [ 28.774207] k3s[896]: I0927 15:00:14.402705 896 shared_informer.go:377] "Caches are synced" machine # [ 28.774740] k3s[896]: I0927 15:00:14.402911 896 shared_informer.go:377] "Caches are synced" machine # [ 28.934412] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.962751] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 28.982403] k3s[896]: I0927 15:00:14.638489 896 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 29.047684] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 29.057223] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 29.068242] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 29.197145] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 29.242776] k3s[896]: I0927 15:00:14.898781 896 controller.go:667] quota admission added evaluator for: replicasets.apps machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.249057] k3s[896]: time="2026-09-27T15:00:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 29.342733] k3s[896]: I0927 15:00:14.998790 896 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.347332] k3s[896]: I0927 15:00:15.003386 896 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.511728] k3s[896]: time="2026-09-27T15:00:15Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.933248] k3s[896]: time="2026-09-27T15:00:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.981147] k3s[896]: I0927 15:00:15.637224 896 shared_informer.go:377] "Caches are synced" machine # [ 30.047041] k3s[896]: I0927 15:00:15.703069 896 shared_informer.go:377] "Caches are synced" machine # [ 30.048403] k3s[896]: I0927 15:00:15.703104 896 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 30.049911] k3s[896]: I0927 15:00:15.703115 896 garbagecollector.go:169] "Proceeding to collect garbage" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.561976] postgres[1202]: [1202] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 30.563424] postgres[1202]: [1202] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 30.584569] niks3-server[1193]: 2026/09/27 15:00:16 OK 20241026095416_initial_model.sql (11.28ms) machine # [ 30.588534] niks3-server[1193]: 2026/09/27 15:00:16 OK 20251210153512_drop_unused_gin_index.sql (4.05ms) machine # [ 30.592342] niks3-server[1193]: 2026/09/27 15:00:16 OK 20251218171726_add_pins.sql (3.7ms) machine # [ 30.596197] niks3-server[1193]: 2026/09/27 15:00:16 OK 20260628120000_add_object_size_and_stats.sql (3.85ms) machine # [ 30.600982] niks3-server[1193]: 2026/09/27 15:00:16 OK 20260905000000_add_claims.sql (4.7ms) machine # [ 30.605067] niks3-server[1193]: 2026/09/27 15:00:16 OK 20260920000000_drop_claims.sql (4ms) machine # [ 30.608038] niks3-server[1193]: 2026/09/27 15:00:16 OK 20260923120000_add_pushes.sql (2.99ms) machine # [ 30.608683] niks3-server[1193]: 2026/09/27 15:00:16 goose: successfully migrated database to version: 20260923120000 machine # [ 30.613794] niks3-server[1193]: 2026/09/27 15:00:16 OK 1_commit_pending_closure.sql (3.16ms) machine # [ 30.615962] niks3-server[1193]: 2026/09/27 15:00:16 OK 2_object_stats_trigger.sql (2.11ms) machine # [ 30.618744] niks3-server[1193]: 2026/09/27 15:00:16 OK 3_commit_push.sql (2.62ms) machine # [ 30.619262] niks3-server[1193]: 2026/09/27 15:00:16 goose: up to current file version: 3 machine # [ 30.624182] niks3-server[1193]: 2026/09/27 15:00:16 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.624860] niks3-server[1193]: 2026/09/27 15:00:16 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.625538] niks3-server[1193]: 2026/09/27 15:00:16 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.657385] niks3-server[1193]: 2026/09/27 15:00:16 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.658888] niks3-server[1193]: 2026/09/27 15:00:16 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.659554] niks3-server[1193]: 2026/09/27 15:00:16 INFO systemd watchdog enabled interval=15s machine # [ 30.661505] niks3-server[1193]: 2026/09/27 15:00:16 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.662746] systemd[1]: Started niks3 server. machine # [ 30.663457] systemd[1]: Reached target Multi-User System. machine # [ 30.664238] systemd[1]: Startup finished in 1.262s (kernel) + 3.793s (initrd) + 25.605s (userspace) = 30.660s. machine # [ 30.937849] k3s[896]: time="2026-09-27T15:00:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.433472] k3s[896]: time="2026-09-27T15:00:17Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 31.436978] k3s[896]: time="2026-09-27T15:00:17Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:0355d29a0971b36a1b2c54fa993d050be4b7b13cdfc0258c0636743cf0217c0b" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.903222] k3s[896]: time="2026-09-27T15:00:17Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.511972331s" machine # [ 31.908239] k3s[896]: time="2026-09-27T15:00:17Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # [ 31.936610] k3s[896]: time="2026-09-27T15:00:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.934454] k3s[896]: time="2026-09-27T15:00:18Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.961456] k3s[896]: time="2026-09-27T15:00:18Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 32.962149] k3s[896]: time="2026-09-27T15:00:18Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 32.962844] k3s[896]: time="2026-09-27T15:00:18Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.963622] k3s[896]: time="2026-09-27T15:00:18Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 32.964175] k3s[896]: time="2026-09-27T15:00:18Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 32.970862] k3s[896]: time="2026-09-27T15:00:18Z" level=info msg="Handling backend connection request [machine]" machine # [ 32.971925] k3s[896]: time="2026-09-27T15:00:18Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.973817] k3s[896]: time="2026-09-27T15:00:18Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 33.520854] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 33.524932] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 33.586262] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.682833991s" machine # [ 33.590134] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 33.860263] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::ab5b:2276:8f75:4eb6 --node-labels= --read-only-port=0" machine # [ 33.861975] k3s[896]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 33.869090] k3s[896]: I0927 15:00:19.525098 896 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 33.870462] k3s[896]: I0927 15:00:19.525136 896 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.871436] k3s[896]: I0927 15:00:19.525190 896 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 33.872918] k3s[896]: I0927 15:00:19.525202 896 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 33.874109] k3s[896]: I0927 15:00:19.526520 896 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 33.875035] k3s[896]: I0927 15:00:19.531032 896 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 33.879569] k3s[896]: I0927 15:00:19.535618 896 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 33.880468] k3s[896]: I0927 15:00:19.535675 896 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 33.888512] k3s[896]: I0927 15:00:19.535969 896 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 33.889216] k3s[896]: I0927 15:00:19.544673 896 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 33.890507] k3s[896]: I0927 15:00:19.544957 896 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 33.891503] k3s[896]: I0927 15:00:19.544975 896 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 33.892073] k3s[896]: I0927 15:00:19.545078 896 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 33.894756] k3s[896]: I0927 15:00:19.550865 896 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 33.895562] k3s[896]: I0927 15:00:19.551125 896 kubelet.go:482] "Attempting to sync node with API server" machine # [ 33.896143] k3s[896]: I0927 15:00:19.551144 896 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 33.896642] k3s[896]: I0927 15:00:19.551197 896 kubelet.go:394] "Adding apiserver pod source" machine # [ 33.897262] k3s[896]: I0927 15:00:19.551217 896 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 33.897820] k3s[896]: I0927 15:00:19.552243 896 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 33.898631] k3s[896]: I0927 15:00:19.552991 896 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 33.899362] k3s[896]: I0927 15:00:19.553017 896 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 33.926058] k3s[896]: I0927 15:00:19.580072 896 server.go:1252] "Started kubelet" machine # [ 33.926753] k3s[896]: I0927 15:00:19.580270 896 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 33.927421] k3s[896]: I0927 15:00:19.580465 896 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 33.927995] k3s[896]: I0927 15:00:19.580547 896 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 33.928947] k3s[896]: I0927 15:00:19.580703 896 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 33.929735] k3s[896]: I0927 15:00:19.581218 896 server.go:317] "Adding debug handlers to kubelet server" machine # [ 33.930488] k3s[896]: I0927 15:00:19.584374 896 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 33.931033] k3s[896]: I0927 15:00:19.585137 896 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 33.931562] k3s[896]: E0927 15:00:19.585420 896 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 33.934385] k3s[896]: I0927 15:00:19.588302 896 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 33.934918] k3s[896]: I0927 15:00:19.588525 896 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 33.935635] k3s[896]: I0927 15:00:19.588580 896 reconciler.go:29] "Reconciler: start to sync state" machine # [ 33.936592] k3s[896]: I0927 15:00:19.592707 896 factory.go:223] Registration of the systemd container factory successfully machine # [ 33.937510] k3s[896]: I0927 15:00:19.592831 896 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 33.939183] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.940047] k3s[896]: E0927 15:00:19.596144 896 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 33.942059] k3s[896]: E0927 15:00:19.597004 896 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 33.942775] k3s[896]: I0927 15:00:19.598013 896 factory.go:223] Registration of the containerd container factory successfully machine # [ 33.956989] k3s[896]: I0927 15:00:19.613050 896 cpu_manager.go:225] "Starting" policy="none" machine # [ 33.957904] k3s[896]: I0927 15:00:19.613594 896 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 33.958639] k3s[896]: I0927 15:00:19.613621 896 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 33.967107] k3s[896]: I0927 15:00:19.622370 896 policy_none.go:50] "Start" machine # [ 33.968263] k3s[896]: I0927 15:00:19.622398 896 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 33.969841] k3s[896]: I0927 15:00:19.622415 896 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 33.973954] k3s[896]: I0927 15:00:19.630058 896 policy_none.go:44] "Start" machine # [ 33.987212] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 34.005110] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 34.011245] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 34.021407] k3s[896]: E0927 15:00:19.677514 896 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 34.022846] k3s[896]: I0927 15:00:19.678396 896 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 34.023591] k3s[896]: I0927 15:00:19.678432 896 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 34.024102] k3s[896]: I0927 15:00:19.678934 896 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 34.032075] k3s[896]: E0927 15:00:19.686781 896 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 34.032753] k3s[896]: E0927 15:00:19.686821 896 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.089663] k3s[896]: I0927 15:00:19.745728 896 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 34.096784] k3s[896]: I0927 15:00:19.752614 896 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 34.098970] k3s[896]: I0927 15:00:19.752665 896 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 34.100972] k3s[896]: I0927 15:00:19.752719 896 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 34.101654] k3s[896]: E0927 15:00:19.752775 896 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 34.125202] k3s[896]: I0927 15:00:19.781227 896 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 34.133154] k3s[896]: I0927 15:00:19.789209 896 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 34.133906] k3s[896]: I0927 15:00:19.789723 896 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.134307] k3s[896]: I0927 15:00:19.789773 896 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.134831] k3s[896]: E0927 15:00:19.789796 896 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.138060] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 34.139606] k3s[896]: I0927 15:00:19.795418 896 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.140489] k3s[896]: I0927 15:00:19.795470 896 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.141051] k3s[896]: E0927 15:00:19.795488 896 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.150790] k3s[896]: I0927 15:00:19.806370 896 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 34.151482] k3s[896]: I0927 15:00:19.806669 896 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.151951] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 34.152638] k3s[896]: I0927 15:00:19.806870 896 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 34.153114] k3s[896]: E0927 15:00:19.806890 896 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 34.153657] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Warning: watch ended with error" err="an error on the server (\"unable to decode an event from the watch stream: context canceled\") has prevented the request from succeeding" logger=k3s reflector="k8s.io/client-go@v0.36.0/tools/cache/reflector.go:289" type="*v1.Node" machine # [ 34.154182] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Starting flannel with backend vxlan" machine # [ 34.159534] k3s[896]: I0927 15:00:19.815632 896 node_controller.go:429] Initializing node machine with cloud provider machine # [ 34.164356] k3s[896]: I0927 15:00:19.820466 896 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 34.167654] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 34.187067] k3s[896]: I0927 15:00:19.830292 896 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 34.188921] k3s[896]: I0927 15:00:19.831625 896 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 34.190666] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 34.192041] k3s[896]: E0927 15:00:19.846523 896 range_allocator.go:438] "Failed to update node PodCIDR after multiple attempts" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" podCIDRs=["10.42.1.0/24"] machine # [ 34.196901] k3s[896]: E0927 15:00:19.846564 896 range_allocator.go:444] "CIDR assignment for node failed. Releasing allocated CIDR" err="failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid]" node="machine" machine # [ 34.201720] k3s[896]: E0927 15:00:19.846631 896 range_allocator.go:257] "Error processing node work item" err="error syncing 'machine': failed to patch node CIDR: Node \"machine\" is invalid: [spec.podCIDRs: Invalid value: [\"10.42.1.0/24\",\"10.42.0.0/24\"]: may specify no more than one CIDR for each IP family, spec.podCIDRs: Forbidden: node updates may not change podCIDR except from \"\" to valid], requeuing" logger="UnhandledError" machine # [ 34.202502] k3s[896]: time="2026-09-27T15:00:19Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 34.202973] k3s[896]: I0927 15:00:19.848022 896 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 34.203623] k3s[896]: I0927 15:00:19.848210 896 kube.go:537] Starting kube subnet manager machine # [ 34.247735] k3s[896]: I0927 15:00:19.903796 896 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 34.249427] k3s[896]: I0927 15:00:19.904072 896 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 34.255223] k3s[896]: I0927 15:00:19.911314 896 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 34.255846] k3s[896]: I0927 15:00:19.911337 896 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.261729] k3s[896]: I0927 15:00:19.916705 896 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 34.262531] k3s[896]: I0927 15:00:19.916738 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.263050] k3s[896]: I0927 15:00:19.916736 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 34.263544] k3s[896]: I0927 15:00:19.916768 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.264036] k3s[896]: I0927 15:00:19.916783 896 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 34.264581] k3s[896]: I0927 15:00:19.916787 896 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 34.265123] k3s[896]: I0927 15:00:19.916803 896 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.265647] k3s[896]: I0927 15:00:19.916833 896 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 34.266148] k3s[896]: I0927 15:00:19.916768 896 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 34.283086] k3s[896]: I0927 15:00:19.939148 896 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 34.291146] k3s[896]: I0927 15:00:19.947249 896 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 34.360901] k3s[896]: I0927 15:00:20.016937 896 shared_informer.go:377] "Caches are synced" machine # [ 34.362265] k3s[896]: I0927 15:00:20.016971 896 shared_informer.go:377] "Caches are synced" machine # [ 34.363441] k3s[896]: I0927 15:00:20.017050 896 shared_informer.go:377] "Caches are synced" machine # [ 34.841740] k3s[896]: time="2026-09-27T15:00:20Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 34.896770] k3s[896]: I0927 15:00:20.552713 896 apiserver.go:52] "Watching apiserver" machine # [ 34.949973] k3s[896]: time="2026-09-27T15:00:20Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 34.994400] systemd[1]: Created slice libcontainer container kubepods-burstable-podd10df79b_800e_46f4_92a2_1cb51e81748e.slice. machine # [ 35.010125] systemd[1]: Created slice libcontainer container kubepods-burstable-pod7af0a361_be5b_4b99_b423_ac75b58f7b7d.slice. machine # [ 35.032768] k3s[896]: I0927 15:00:20.688838 896 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 35.044088] k3s[896]: I0927 15:00:20.700124 896 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::ab5b:2276:8f75:4eb6"] machine # [ 35.046186] k3s[896]: E0927 15:00:20.700258 896 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 35.055788] k3s[896]: I0927 15:00:20.711873 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-helm\") pod \"helm-install-nix-grpc-farm-mqp8n\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " pod="kube-system/helm-install-nix-grpc-farm-mqp8n" machine # [ 35.060383] k3s[896]: I0927 15:00:20.711909 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-cache\") pod \"helm-install-nix-grpc-farm-mqp8n\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " pod="kube-system/helm-install-nix-grpc-farm-mqp8n" machine # [ 35.061092] k3s[896]: I0927 15:00:20.711943 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/7af0a361-be5b-4b99-b423-ac75b58f7b7d-content\") pod \"helm-install-nix-grpc-farm-mqp8n\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " pod="kube-system/helm-install-nix-grpc-farm-mqp8n" machine # [ 35.061511] k3s[896]: I0927 15:00:20.711977 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcr87\" (UniqueName: \"kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-kube-api-access-xcr87\") pod \"helm-install-nix-grpc-farm-mqp8n\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " pod="kube-system/helm-install-nix-grpc-farm-mqp8n" machine # [ 35.062059] k3s[896]: I0927 15:00:20.712066 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d10df79b-800e-46f4-92a2-1cb51e81748e-config-volume\") pod \"coredns-c5fdd76cf-mw9dd\" (UID: \"d10df79b-800e-46f4-92a2-1cb51e81748e\") " pod="kube-system/coredns-c5fdd76cf-mw9dd" machine # [ 35.062593] k3s[896]: I0927 15:00:20.712111 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/d10df79b-800e-46f4-92a2-1cb51e81748e-custom-config-volume\") pod \"coredns-c5fdd76cf-mw9dd\" (UID: \"d10df79b-800e-46f4-92a2-1cb51e81748e\") " pod="kube-system/coredns-c5fdd76cf-mw9dd" machine # [ 35.063112] k3s[896]: I0927 15:00:20.712253 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlq9f\" (UniqueName: \"kubernetes.io/projected/d10df79b-800e-46f4-92a2-1cb51e81748e-kube-api-access-nlq9f\") pod \"coredns-c5fdd76cf-mw9dd\" (UID: \"d10df79b-800e-46f4-92a2-1cb51e81748e\") " pod="kube-system/coredns-c5fdd76cf-mw9dd" machine # [ 35.063599] k3s[896]: I0927 15:00:20.712293 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-config\") pod \"helm-install-nix-grpc-farm-mqp8n\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " pod="kube-system/helm-install-nix-grpc-farm-mqp8n" machine # [ 35.064114] k3s[896]: I0927 15:00:20.712326 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-tmp\") pod \"helm-install-nix-grpc-farm-mqp8n\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " pod="kube-system/helm-install-nix-grpc-farm-mqp8n" machine # [ 35.064597] k3s[896]: I0927 15:00:20.712454 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-values\") pod \"helm-install-nix-grpc-farm-mqp8n\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " pod="kube-system/helm-install-nix-grpc-farm-mqp8n" machine # [ 35.065184] k3s[896]: I0927 15:00:20.721280 896 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 35.065777] k3s[896]: I0927 15:00:20.721329 896 server_linux.go:136] "Using iptables Proxier" machine # [ 35.089292] k3s[896]: I0927 15:00:20.745375 896 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 35.116595] k3s[896]: I0927 15:00:20.772642 896 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 35.119073] k3s[896]: I0927 15:00:20.773763 896 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.120305] k3s[896]: I0927 15:00:20.776423 896 config.go:200] "Starting service config controller" machine # [ 35.121747] k3s[896]: I0927 15:00:20.777068 896 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 35.122283] k3s[896]: I0927 15:00:20.777107 896 config.go:106] "Starting endpoint slice config controller" machine # [ 35.123075] k3s[896]: I0927 15:00:20.777122 896 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 35.123230] k3s[896]: I0927 15:00:20.777149 896 config.go:403] "Starting serviceCIDR config controller" machine # [ 35.123835] k3s[896]: I0927 15:00:20.777160 896 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 35.127117] k3s[896]: I0927 15:00:20.780908 896 config.go:309] "Starting node config controller" machine # [ 35.127721] k3s[896]: I0927 15:00:20.780927 896 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 35.128255] k3s[896]: I0927 15:00:20.780939 896 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 35.192177] k3s[896]: I0927 15:00:20.848227 896 kube.go:163] Node controller sync successful machine # [ 35.192897] k3s[896]: I0927 15:00:20.848298 896 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 35.197936] k3s[896]: I0927 15:00:20.853933 896 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::ab5b:2276:8f75:4eb6", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::ab5b:2276:8f75:4eb6", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.237802] (udev-worker)[1268]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.244060] k3s[896]: I0927 15:00:20.900076 896 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 35.246531] k3s[896]: I0927 15:00:20.902250 896 iptables.go:50] Starting flannel in iptables mode... machine # [ 35.247159] k3s[896]: time="2026-09-27T15:00:20Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.247617] k3s[896]: time="2026-09-27T15:00:20Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.248091] k3s[896]: time="2026-09-27T15:00:20Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.248629] k3s[896]: time="2026-09-27T15:00:20Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.249450] k3s[896]: I0927 15:00:20.902363 896 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 35.273474] dhcpcd[682]: flannel.1: IAID 3a:23:7f:6d machine # [ 35.274257] dhcpcd[682]: flannel.1: adding address fe80::74b6:3aff:fe23:7f6d machine # [ 35.303876] k3s[896]: I0927 15:00:20.959955 896 iptables.go:111] Setting up masking rules machine # [ 35.321256] k3s[896]: I0927 15:00:20.977304 896 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 35.321897] k3s[896]: I0927 15:00:20.977326 896 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 35.322956] k3s[896]: I0927 15:00:20.977281 896 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 35.326611] k3s[896]: I0927 15:00:20.982700 896 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 35.347642] k3s[896]: time="2026-09-27T15:00:21Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 35.348562] k3s[896]: time="2026-09-27T15:00:21Z" level=info msg="Running flannel backend" machine # [ 35.349259] k3s[896]: I0927 15:00:21.003757 896 vxlan_network.go:68] watching for new subnet leases machine # [ 35.349900] k3s[896]: I0927 15:00:21.003788 896 vxlan_network.go:115] starting vxlan device watcher machine # [ 35.366210] (udev-worker)[1334]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.538357] cni0: port 1(veth40f32ec2) entered blocking state machine # [ 35.539250] cni0: port 1(veth40f32ec2) entered disabled state machine # [ 35.540462] veth40f32ec2: entered allmulticast mode machine # [ 35.541520] veth40f32ec2: entered promiscuous mode machine # [ 35.388990] (udev-worker)[1420]: Network inte[ 35.543942] cni0: port 2(veth9382540a) entered blocking state machine # rface NamePolicy[ 35.544991] cni0: port 2(veth9382540a) entered disabled state machine # = disabled on kernel command line. machine # [ 35.546027] veth9382540a: entered allmulticast mode machine # [ 35.546986] veth9382540a: entered promiscuous mode machine # [ 35.561679] cni0: port 1(veth40f32ec2) entered blocking state machine # [ 35.562362] cni0: port 1(veth40f32ec2) entered forwarding state machine # [ 35.568063] cni0: port 2(veth9382540a) entered blocking state machine # [ 35.568796] cni0: port 2(veth9382540a) entered forwarding state machine # [ 35.439607] dhcpcd[682]: veth9382540a: waiting for carrier machine # [ 35.454586] dhcpcd[682]: veth40f32ec2: IAID 5e:3c:b2:97 machine # [ 35.455700] dhcpcd[682]: veth40f32ec2: adding address fe80::a0f5:5eff:fe3c:b297 machine # [ 35.456512] dhcpcd[682]: veth9382540a: carrier acquired machine # [ 35.459048] k3s[896]: I0927 15:00:21.114807 896 iptables.go:358] bootstrap done machine # [ 35.460752] dhcpcd[682]: veth9382540a: IAID 51:42:41:ce machine # [ 35.461684] dhcpcd[682]: veth9382540a: adding address fe80::54f7:51ff:fe42:41ce machine # [ 35.506668] k3s[896]: I0927 15:00:21.162750 896 iptables.go:358] bootstrap done machine # [ 35.530184] dhcpcd[682]: flannel.1: soliciting a DHCP lease machine # [ 35.619686] systemd[1]: Started libcontainer container 100c95c4ca0febb4b4950dc0670d886ba6d7cae83e7c3d45fdc8163cf20ac4ac. machine # [ 35.623276] systemd[1]: Started libcontainer container bf764d7784842d0a8fdc0204fcd3f758cc6d1575180663f9bf5193ee1ee777e3. machine # [ 36.349595] k3s[896]: time="2026-09-27T15:00:22Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 36.351569] k3s[896]: I0927 15:00:22.003891 896 network_policy_controller.go:164] Starting network policy controller machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.607091] k3s[896]: I0927 15:00:22.263064 896 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 36.629376] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2966364111.mount: Deactivated successfully. machine # [ 36.676372] systemd[1]: Started libcontainer container ca309c44112b835c868d6fc0556c1b3157bf99c046dd8d61f490b2aca4fee936. machine # [ 36.807292] systemd[1]: Started libcontainer container f2f27ffe4deb78cf07bae3ec49368a869a79c0b9c94cd808e601148e964b631e. machine # [ 36.853529] dhcpcd[682]: veth40f32ec2: soliciting an IPv6 router machine # [ 37.154595] k3s[896]: I0927 15:00:22.809223 896 endpointslice_controller.go:361] "Error syncing endpoint slices for service, retrying" key="kube-system/kube-dns" err="EndpointSlice informer cache is out of date" machine # [ 37.157811] k3s[896]: I0927 15:00:22.813693 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-mw9dd" podStartSLOduration=7.813627287 podStartE2EDuration="7.813627287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 15:00:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 15:00:22.79211282 +0000 UTC m=+19.367567106" watchObservedRunningTime="2026-09-27 15:00:22.813627287 +0000 UTC m=+19.389081293" machine # [ 37.205042] k3s[896]: I0927 15:00:22.860423 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-mqp8n" podStartSLOduration=7.860403064 podStartE2EDuration="7.860403064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 15:00:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 15:00:22.852516307 +0000 UTC m=+19.427970872" watchObservedRunningTime="2026-09-27 15:00:22.860403064 +0000 UTC m=+19.435857349" machine # [ 37.242401] dhcpcd[682]: veth9382540a: soliciting a DHCP lease machine # [ 37.258816] dhcpcd[682]: flannel.1: soliciting an IPv6 router machine # [ 37.432372] dhcpcd[682]: veth40f32ec2: soliciting a DHCP lease machine # [ 37.478393] k3s[896]: I0927 15:00:23.134118 896 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.10.110"} machine # [ 37.537594] systemd[1]: cri-containerd-f2f27ffe4deb78cf07bae3ec49368a869a79c0b9c94cd808e601148e964b631e.scope: Deactivated successfully. machine # [ 37.539651] systemd[1]: cri-containerd-f2f27ffe4deb78cf07bae3ec49368a869a79c0b9c94cd808e601148e964b631e.scope: Consumed 575ms CPU time over 729ms wall clock time, 34.9M memory peak, 2.4M incoming IP traffic, 150.1K outgoing IP traffic. machine # [ 37.594235] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f2f27ffe4deb78cf07bae3ec49368a869a79c0b9c94cd808e601148e964b631e-rootfs.mount: Deactivated successfully. machine # [ 37.622202] dhcpcd[682]: veth9382540a: soliciting an IPv6 router machine # [ 38.001795] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod5495b4fb_88de_44cb_9a2f_bb3649feeae3.slice. machine # [ 38.017475] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod1803c2f8_a5d3_4a0f_ae5a_c2bd8b8b6701.slice. machine # [ 38.030163] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6ceedac4_9f57_4dc3_897a_fdefca3af323.slice. machine # [ 38.035823] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod00b67c72_d2d1_4162_ac7b_d58536597035.slice. machine # [ 38.071063] k3s[896]: I0927 15:00:23.727128 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/5495b4fb-88de-44cb-9a2f-bb3649feeae3-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2\" (UID: \"5495b4fb-88de-44cb-9a2f-bb3649feeae3\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" machine # [ 38.076209] k3s[896]: I0927 15:00:23.727207 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/5495b4fb-88de-44cb-9a2f-bb3649feeae3-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2\" (UID: \"5495b4fb-88de-44cb-9a2f-bb3649feeae3\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" machine # [ 38.081095] k3s[896]: I0927 15:00:23.727374 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/5495b4fb-88de-44cb-9a2f-bb3649feeae3-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2\" (UID: \"5495b4fb-88de-44cb-9a2f-bb3649feeae3\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" machine # [ 38.086120] k3s[896]: I0927 15:00:23.727425 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/00b67c72-d2d1-4162-ac7b-d58536597035-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85\" (UID: \"00b67c72-d2d1-4162-ac7b-d58536597035\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" machine # [ 38.091085] k3s[896]: I0927 15:00:23.727459 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/00b67c72-d2d1-4162-ac7b-d58536597035-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85\" (UID: \"00b67c72-d2d1-4162-ac7b-d58536597035\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" machine # [ 38.095656] k3s[896]: I0927 15:00:23.727503 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcbx6\" (UniqueName: \"kubernetes.io/projected/00b67c72-d2d1-4162-ac7b-d58536597035-kube-api-access-hcbx6\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85\" (UID: \"00b67c72-d2d1-4162-ac7b-d58536597035\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" machine # [ 38.100889] k3s[896]: I0927 15:00:23.727542 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/00b67c72-d2d1-4162-ac7b-d58536597035-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85\" (UID: \"00b67c72-d2d1-4162-ac7b-d58536597035\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" machine # [ 38.106124] k3s[896]: I0927 15:00:23.727615 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5495b4fb-88de-44cb-9a2f-bb3649feeae3-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2\" (UID: \"5495b4fb-88de-44cb-9a2f-bb3649feeae3\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" machine # [ 38.110881] k3s[896]: I0927 15:00:23.727662 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701-tls\") pod \"nix-grpc-farm-scheduler-c5d75967-qrhx9\" (UID: \"1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-qrhx9" machine # [ 38.115566] k3s[896]: I0927 15:00:23.727690 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/00b67c72-d2d1-4162-ac7b-d58536597035-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85\" (UID: \"00b67c72-d2d1-4162-ac7b-d58536597035\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" machine # [ 38.120533] k3s[896]: I0927 15:00:23.727728 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-8bmjs\" (UID: \"6ceedac4-9f57-4dc3-897a-fdefca3af323\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-8bmjs" machine # [ 38.124820] k3s[896]: I0927 15:00:23.727794 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/5495b4fb-88de-44cb-9a2f-bb3649feeae3-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2\" (UID: \"5495b4fb-88de-44cb-9a2f-bb3649feeae3\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" machine # [ 38.129397] k3s[896]: I0927 15:00:23.727840 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldtnk\" (UniqueName: \"kubernetes.io/projected/5495b4fb-88de-44cb-9a2f-bb3649feeae3-kube-api-access-ldtnk\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2\" (UID: \"5495b4fb-88de-44cb-9a2f-bb3649feeae3\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" machine # [ 38.133977] k3s[896]: I0927 15:00:23.727917 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmvzz\" (UniqueName: \"kubernetes.io/projected/1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701-kube-api-access-dmvzz\") pod \"nix-grpc-farm-scheduler-c5d75967-qrhx9\" (UID: \"1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-qrhx9" machine # [ 38.138659] k3s[896]: I0927 15:00:23.728015 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ceedac4-9f57-4dc3-897a-fdefca3af323-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-8bmjs\" (UID: \"6ceedac4-9f57-4dc3-897a-fdefca3af323\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-8bmjs" machine # [ 38.142772] k3s[896]: I0927 15:00:23.728101 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701-niks3-token\") pod \"nix-grpc-farm-scheduler-c5d75967-qrhx9\" (UID: \"1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-qrhx9" machine # [ 38.147299] k3s[896]: I0927 15:00:23.728129 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701-ca\") pod \"nix-grpc-farm-scheduler-c5d75967-qrhx9\" (UID: \"1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-qrhx9" machine # [ 38.151904] k3s[896]: I0927 15:00:23.728193 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701-oidc\") pod \"nix-grpc-farm-scheduler-c5d75967-qrhx9\" (UID: \"1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-qrhx9" machine # [ 38.156600] k3s[896]: I0927 15:00:23.728222 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/00b67c72-d2d1-4162-ac7b-d58536597035-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85\" (UID: \"00b67c72-d2d1-4162-ac7b-d58536597035\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" machine # [ 38.161602] k3s[896]: I0927 15:00:23.728249 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/00b67c72-d2d1-4162-ac7b-d58536597035-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85\" (UID: \"00b67c72-d2d1-4162-ac7b-d58536597035\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" machine # [ 38.166594] k3s[896]: I0927 15:00:23.728281 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ceedac4-9f57-4dc3-897a-fdefca3af323-config\") pod \"nix-grpc-farm-lb-75b44f88dd-8bmjs\" (UID: \"6ceedac4-9f57-4dc3-897a-fdefca3af323\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-8bmjs" machine # [ 38.171241] k3s[896]: I0927 15:00:23.728311 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-8bmjs\" (UID: \"6ceedac4-9f57-4dc3-897a-fdefca3af323\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-8bmjs" machine # [ 38.175980] k3s[896]: I0927 15:00:23.728337 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/5495b4fb-88de-44cb-9a2f-bb3649feeae3-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2\" (UID: \"5495b4fb-88de-44cb-9a2f-bb3649feeae3\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" machine # [ 38.181057] k3s[896]: I0927 15:00:23.728361 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/5495b4fb-88de-44cb-9a2f-bb3649feeae3-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2\" (UID: \"5495b4fb-88de-44cb-9a2f-bb3649feeae3\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" machine # [ 38.185904] k3s[896]: I0927 15:00:23.728387 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/00b67c72-d2d1-4162-ac7b-d58536597035-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85\" (UID: \"00b67c72-d2d1-4162-ac7b-d58536597035\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" machine # [ 38.190569] k3s[896]: I0927 15:00:23.728410 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/00b67c72-d2d1-4162-ac7b-d58536597035-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85\" (UID: \"00b67c72-d2d1-4162-ac7b-d58536597035\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" machine # [ 38.196641] k3s[896]: I0927 15:00:23.728436 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/5495b4fb-88de-44cb-9a2f-bb3649feeae3-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2\" (UID: \"5495b4fb-88de-44cb-9a2f-bb3649feeae3\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" machine # [ 38.514730] cni0: port 3(veth9eab26b7) entered blocking state machine # [ 38.515596] cni0: port 3(veth9eab26b7) entered disabled state machine # [ 38.516330] veth9eab26b7: entered allmulticast mode machine # [ 38.517504] veth9eab26b7: entered promiscuous mode machine # [ 38.365218] (udev-worker)[1859]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.376268] (udev-worker)[1902]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.541904] cni0: port 4(vethae218027) entered blocking state machine # [ 38.542614] cni0: port 4(vethae218027) entered disabled state machine # [ 38.543234] vethae218027: entered allmulticast mode machine # [ 38.547446] vethae218027: entered promiscuous mode machine # [ 38.552392] cni0: port 3(veth9eab26b7) entered blocking state machine # [ 38.553089] cni0: port 3(veth9eab26b7) entered forwarding state machine # [ 38.577265] cni0: port 4(vethae218027) entered blocking state machine # [ 38.577934] cni0: port 4(vethae218027) entered forwarding state machine # [ 38.579793] cni0: port 5(veth07618a07) entered blocking state machine # [ 38.580447] cni0: port 5(veth07618a07) entered disabled state machine # [ 38.427093] dhcpcd[682]: veth9eab26b7: waiting for carrier machine # [ 38.583148] veth07618a07: entered allmulticast mode machine # [ 38.584051] veth07618a07: entered promiscuous mode machine # [ 38.436308] (udev-worker)[2095]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.595962] cni0: port 6(vethd14f21aa) entered blocking state machine # [ 38.598203] cni0: port 6(vethd14f21aa) entered disabled state machine # [ 38.599673] vethd14f21aa: entered allmulticast mode machine # [ 38.600362] vethd14f21aa: entered promiscuous mode machine # [ 38.453444] dhcpcd[682]: vethae218027: IAID 5d:2f:44:d4 machine # [ 38.454318] dhcpcd[682]: vethae218027: adding address fe80::a868:5dff:fe2f:44d4 machine # [ 38.615509] cni0: port 5(veth07618a07) entered blocking state machine # [ 38.616141] cni0: port 5(veth07618a07) entered forwarding state machine # [ 38.620007] cni0: port 6(vethd14f21aa) entered blocking state machine # [ 38.620634] cni0: port 6(vethd14f21aa) entered forwarding state machine # [ 38.495320] dhcpcd[682]: veth07618a07: waiting for carrier machine # [ 38.508344] dhcpcd[682]: vethd14f21aa: IAID ef:a1:10:fc machine # [ 38.509708] dhcpcd[682]: vethd14f21aa: adding address fe80::ccb9:efff:fea1:10fc machine # [ 38.510845] dhcpcd[682]: vethae218027: carrier lost machine # [ 38.537607] dhcpcd[682]: vethae218027: deleting address fe80::a868:5dff:fe2f:44d4 machine # [ 38.538908] dhcpcd[682]: veth9eab26b7: carrier acquired machine # [ 38.542815] dhcpcd[682]: veth9eab26b7: IAID 57:cc:0a:cd machine # [ 38.543633] dhcpcd[682]: veth9eab26b7: adding address fe80::a854:57ff:fecc:acd machine # [ 38.544345] dhcpcd[682]: veth07618a07: old hardware address: 2a:a3:f7:e4:45:3a machine # [ 38.545085] dhcpcd[682]: veth07618a07: new hardware address: be:aa:e9:f7:59:6f machine # [ 38.545681] dhcpcd[682]: veth07618a07: old hardware address: be:aa:e9:f7:59:6f machine # [ 38.546266] dhcpcd[682]: veth07618a07: new hardware address: 2a:a3:f7:e4:45:3a machine # [ 38.546856] dhcpcd[682]: vethae218027: carrier acquired machine # [ 38.550649] dhcpcd[682]: vethae218027: IAID 5d:2f:44:d4 machine # [ 38.551676] dhcpcd[682]: vethae218027: adding address fe80::a868:5dff:fe2f:44d4 machine # [ 38.552539] dhcpcd[682]: vethd14f21aa: old hardware address: ce:b9:ef:a1:10:fc machine # [ 38.553252] dhcpcd[682]: vethd14f21aa: new hardware address: 0a:52:7f:19:7f:a3 machine # [ 38.553699] dhcpcd[682]: vethd14f21aa: carrier lost machine # [ 38.577648] dhcpcd[682]: vethd14f21aa: deleting address fe80::ccb9:efff:fea1:10fc machine # [ 38.578827] dhcpcd[682]: vethd14f21aa: old hardware address: 0a:52:7f:19:7f:a3 machine # [ 38.579422] dhcpcd[682]: vethd14f21aa: new hardware address: ce:b9:ef:a1:10:fc machine # [ 38.579891] dhcpcd[682]: veth07618a07: carrier acquired machine # [ 38.588093] dhcpcd[682]: veth07618a07: IAID f7:e4:45:3a machine # [ 38.592189] dhcpcd[682]: veth07618a07: adding address fe80::28a3:f7ff:fee4:453a machine # [ 38.592849] systemd[1]: Started libcontainer container 8202c22130a6a4cef5f852d2edca6f1ac1de635ac606ff00e89e6f9e85004df2. machine # [ 38.596186] dhcpcd[682]: vethd14f21aa: carrier acquired machine # [ 38.597100] dhcpcd[682]: vethd14f21aa: IAID ef:a1:10:fc machine # [ 38.597610] dhcpcd[682]: vethd14f21aa: adding address fe80::ccb9:efff:fea1:10fc machine # [ 38.625705] systemd[1]: Started libcontainer container f70236eb1d58e567d2f4662aa325c315936b9526c1a7ec40a7f3936e4c9426fe. machine # [ 38.633731] systemd[1]: Started libcontainer container 00a1e43edb87606061dcd6268d1f2fe88f8e1b36f4343255e86613976084df8a. machine # [ 38.636238] systemd[1]: Started libcontainer container 8bd38b8ca4298c105b767afcb14ec4ef264258e2b104d1bce92b884afd1ed807. machine # [ 38.726066] k3s[896]: E0927 15:00:24.381461 896 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.731261] k3s[896]: E0927 15:00:24.381541 896 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.736448] k3s[896]: E0927 15:00:24.381674 896 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-c5d75967-qrhx9_farm(1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 38.742979] k3s[896]: E0927 15:00:24.381741 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-c5d75967-qrhx9" podUID="1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701" machine # [ 38.749877] k3s[896]: E0927 15:00:24.382001 896 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.756358] k3s[896]: E0927 15:00:24.382054 896 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.761824] k3s[896]: E0927 15:00:24.382359 896 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2_farm(5495b4fb-88de-44cb-9a2f-bb3649feeae3): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 38.769070] k3s[896]: E0927 15:00:24.382825 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" podUID="5495b4fb-88de-44cb-9a2f-bb3649feeae3" machine # [ 38.776769] k3s[896]: I0927 15:00:24.403231 896 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.778617] k3s[896]: I0927 15:00:24.403330 896 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.780713] k3s[896]: I0927 15:00:24.403412 896 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.782771] k3s[896]: E0927 15:00:24.413728 896 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.788644] k3s[896]: E0927 15:00:24.413776 896 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 38.794436] k3s[896]: E0927 15:00:24.414208 896 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85_farm(00b67c72-d2d1-4162-ac7b-d58536597035): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 38.795180] k3s[896]: E0927 15:00:24.414268 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" podUID="00b67c72-d2d1-4162-ac7b-d58536597035" machine # [ 39.141833] k3s[896]: E0927 15:00:24.797896 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" podUID="00b67c72-d2d1-4162-ac7b-d58536597035" machine # [ 39.144835] k3s[896]: E0927 15:00:24.800895 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" podUID="5495b4fb-88de-44cb-9a2f-bb3649feeae3" machine # [ 39.150555] k3s[896]: E0927 15:00:24.806611 896 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.4\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-c5d75967-qrhx9" podUID="1803c2f8-a5d3-4a0f-ae5a-c2bd8b8b6701" machine # [ 39.174699] systemd[1]: cri-containerd-100c95c4ca0febb4b4950dc0670d886ba6d7cae83e7c3d45fdc8163cf20ac4ac.scope: Deactivated successfully. machine # [ 39.219670] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2876203423.mount: Deactivated successfully. machine # [ 39.225881] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-100c95c4ca0febb4b4950dc0670d886ba6d7cae83e7c3d45fdc8163cf20ac4ac-rootfs.mount: Deactivated successfully. machine # [ 39.228554] k3s[896]: time="2026-09-27T15:00:24Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 39.271942] k3s[896]: time="2026-09-27T15:00:24Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:0e980daa78152e76426b601fb07af526e0efa6892677da143fc0af7390bc1f60" machine # [ 39.279362] systemd[1]: Started libcontainer container 9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5. machine # [ 39.570623] cni0: port 1(veth40f32ec2) entered disabled state machine # [ 39.416402] dhcpcd[682]: veth40f32ec2: carrier lost machine # [ 39.572397] veth40f32ec2 (unregistering): left allmulticast mode machine # [ 39.573276] veth40f32ec2 (unregistering): left promiscuous mode machine # [ 39.574058] cni0: port 1(veth40f32ec2) entered disabled state machine # [ 39.441495] dhcpcd[682]: veth40f32ec2: deleting address fe80::a0f5:5eff:fe3c:b297 machine # [ 39.478476] dhcpcd[682]: veth40f32ec2: removing interface machine # [ 39.482031] k3s[896]: I0927 15:00:25.137929 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-tmp\") pod \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " machine # [ 39.483357] k3s[896]: I0927 15:00:25.137974 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-config\") pod \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " machine # [ 39.484433] k3s[896]: I0927 15:00:25.138009 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-kube-api-access-xcr87\" (UniqueName: \"kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-kube-api-access-xcr87\") pod \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " machine # [ 39.485465] k3s[896]: I0927 15:00:25.138036 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-cache\") pod \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " machine # [ 39.486647] k3s[896]: I0927 15:00:25.138067 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7af0a361-be5b-4b99-b423-ac75b58f7b7d-content\" (UniqueName: \"kubernetes.io/configmap/7af0a361-be5b-4b99-b423-ac75b58f7b7d-content\") pod \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " machine # [ 39.487453] k3s[896]: I0927 15:00:25.138096 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-helm\") pod \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " machine # [ 39.487905] k3s[896]: I0927 15:00:25.138129 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-values\" (UniqueName: \"kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-values\") pod \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\" (UID: \"7af0a361-be5b-4b99-b423-ac75b58f7b7d\") " machine # [ 39.488570] k3s[896]: I0927 15:00:25.142488 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7af0a361-be5b-4b99-b423-ac75b58f7b7d-content" pod "7af0a361-be5b-4b99-b423-ac75b58f7b7d" (UID: "7af0a361-be5b-4b99-b423-ac75b58f7b7d"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 39.515263] k3s[896]: I0927 15:00:25.171210 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-values" pod "7af0a361-be5b-4b99-b423-ac75b58f7b7d" (UID: "7af0a361-be5b-4b99-b423-ac75b58f7b7d"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 39.516563] k3s[896]: I0927 15:00:25.171515 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-config" pod "7af0a361-be5b-4b99-b423-ac75b58f7b7d" (UID: "7af0a361-be5b-4b99-b423-ac75b58f7b7d"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.517756] k3s[896]: I0927 15:00:25.172411 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-tmp" pod "7af0a361-be5b-4b99-b423-ac75b58f7b7d" (UID: "7af0a361-be5b-4b99-b423-ac75b58f7b7d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.519042] k3s[896]: I0927 15:00:25.173405 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-kube-api-access-xcr87" pod "7af0a361-be5b-4b99-b423-ac75b58f7b7d" (UID: "7af0a361-be5b-4b99-b423-ac75b58f7b7d"). InnerVolumeSpecName "kube-api-access-xcr87". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 39.519890] k3s[896]: I0927 15:00:25.173492 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-helm" pod "7af0a361-be5b-4b99-b423-ac75b58f7b7d" (UID: "7af0a361-be5b-4b99-b423-ac75b58f7b7d"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.520542] k3s[896]: I0927 15:00:25.175122 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-cache" pod "7af0a361-be5b-4b99-b423-ac75b58f7b7d" (UID: "7af0a361-be5b-4b99-b423-ac75b58f7b7d"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 39.583217] k3s[896]: I0927 15:00:25.239285 896 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcr87\" (UniqueName: \"kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-kube-api-access-xcr87\") on node \"machine\" DevicePath \"\"" machine # [ 39.584143] k3s[896]: I0927 15:00:25.239314 896 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 39.584688] k3s[896]: I0927 15:00:25.239328 896 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/7af0a361-be5b-4b99-b423-ac75b58f7b7d-content\") on node \"machine\" DevicePath \"\"" machine # [ 39.585464] k3s[896]: I0927 15:00:25.239340 896 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 39.586066] k3s[896]: I0927 15:00:25.239357 896 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/7af0a361-be5b-4b99-b423-ac75b58f7b7d-values\") on node \"machine\" DevicePath \"\"" machine # [ 39.586652] k3s[896]: I0927 15:00:25.239370 896 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 39.587342] k3s[896]: I0927 15:00:25.239382 896 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/7af0a361-be5b-4b99-b423-ac75b58f7b7d-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 39.739594] k3s[896]: time="2026-09-27T15:00:25Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 6.152683651s" machine # [ 39.856499] dhcpcd[682]: vethd14f21aa: soliciting a DHCP lease machine # [ 39.987056] dhcpcd[682]: veth07618a07: soliciting a DHCP lease machine # [ 40.050849] dhcpcd[682]: vethae218027: soliciting a DHCP lease machine # [ 40.121884] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod7af0a361_be5b_4b99_b423_ac75b58f7b7d.slice. machine # [ 40.123679] systemd[1]: kubepods-burstable-pod7af0a361_be5b_4b99_b423_ac75b58f7b7d.slice: Consumed 605ms CPU time over 5.109s wall clock time, 35.4M memory peak, 2.4M incoming IP traffic, 150.1K outgoing IP traffic. machine # [ 40.130832] dhcpcd[682]: veth9eab26b7: soliciting an IPv6 router machine # [ 40.158366] k3s[896]: I0927 15:00:25.814328 896 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="100c95c4ca0febb4b4950dc0670d886ba6d7cae83e7c3d45fdc8163cf20ac4ac" machine # [ 40.180104] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-100c95c4ca0febb4b4950dc0670d886ba6d7cae83e7c3d45fdc8163cf20ac4ac-shm.mount: Deactivated successfully. machine # [ 40.181674] systemd[1]: run-netns-cni\x2d812639c1\x2db45e\x2da507\x2d915f\x2d58e93e52032d.mount: Deactivated successfully. machine # [ 40.183406] systemd[1]: var-lib-kubelet-pods-7af0a361\x2dbe5b\x2d4b99\x2db423\x2dac75b58f7b7d-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dxcr87.mount: Deactivated successfully. machine # [ 40.184314] systemd[1]: var-lib-kubelet-pods-7af0a361\x2dbe5b\x2d4b99\x2db423\x2dac75b58f7b7d-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 40.185065] systemd[1]: var-lib-kubelet-pods-7af0a361\x2dbe5b\x2d4b99\x2db423\x2dac75b58f7b7d-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 40.187266] systemd[1]: var-lib-kubelet-pods-7af0a361\x2dbe5b\x2d4b99\x2db423\x2dac75b58f7b7d-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 40.200323] systemd[1]: var-lib-kubelet-pods-7af0a361\x2dbe5b\x2d4b99\x2db423\x2dac75b58f7b7d-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 40.201567] systemd[1]: var-lib-kubelet-pods-7af0a361\x2dbe5b\x2d4b99\x2db423\x2dac75b58f7b7d-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 40.210321] k3s[896]: I0927 15:00:25.866363 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-8bmjs" podStartSLOduration=2.86633622 podStartE2EDuration="2.86633622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 15:00:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 15:00:25.866211623 +0000 UTC m=+22.441665909" watchObservedRunningTime="2026-09-27 15:00:25.86633622 +0000 UTC m=+22.441790226" machine # [ 40.333273] dhcpcd[682]: veth9eab26b7: soliciting a DHCP lease machine # [ 40.531341] dhcpcd[682]: flannel.1: probing for an IPv4LL address machine # [ 40.835975] dhcpcd[682]: vethae218027: soliciting an IPv6 router machine # [ 41.342260] dhcpcd[682]: vethd14f21aa: soliciting an IPv6 router machine # [ 41.422727] dhcpcd[682]: veth07618a07: soliciting an IPv6 router machine # [ 42.244257] dhcpcd[682]: veth9382540a: probing for an IPv4LL address machine # [ 44.857886] dhcpcd[682]: vethd14f21aa: probing for an IPv4LL address machine # [ 44.987851] dhcpcd[682]: veth07618a07: probing for an IPv4LL address machine # [ 45.051988] dhcpcd[682]: vethae218027: probing for an IPv4LL address machine # [ 45.334275] dhcpcd[682]: veth9eab26b7: probing for an IPv4LL address machine # [ 45.364077] dhcpcd[682]: flannel.1: using IPv4LL address 169.254.195.122 machine # [ 45.366082] dhcpcd[682]: flannel.1: adding route to 169.254.0.0/16 machine # [ 46.703270] dhcpcd[682]: veth9382540a: using IPv4LL address 169.254.39.162 machine # [ 46.705651] dhcpcd[682]: veth9382540a: adding route to 169.254.0.0/16 machine # error: timed out waiting for the condition machine # [ 49.262348] dhcpcd[682]: flannel.1: no IPv6 Routers available machine # [ 49.390481] dhcpcd[682]: veth07618a07: using IPv4LL address 169.254.227.98 machine # [ 49.391887] dhcpcd[682]: veth07618a07: adding route to 169.254.0.0/16 machine # [ 49.625309] dhcpcd[682]: veth9382540a: no IPv6 Routers available machine # [ 49.982812] dhcpcd[682]: vethd14f21aa: using IPv4LL address 169.254.47.231 machine # [ 49.984097] dhcpcd[682]: vethd14f21aa: adding route to 169.254.0.0/16 machine # [ 50.026935] dhcpcd[682]: vethae218027: using IPv4LL address 169.254.195.156 machine # [ 50.028244] dhcpcd[682]: vethae218027: adding route to 169.254.0.0/16 machine # [ 50.141213] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3255896139.mount: Deactivated successfully. machine # [ 50.241502] dhcpcd[682]: veth9eab26b7: using IPv4LL address 169.254.62.87 machine # [ 50.243192] dhcpcd[682]: veth9eab26b7: adding route to 169.254.0.0/16 machine # [ 52.134260] dhcpcd[682]: veth9eab26b7: no IPv6 Routers available machine # [ 52.534543] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped971082354.mount: Deactivated successfully. machine # [ 52.594262] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped576493248.mount: Deactivated successfully. machine # [ 52.705513] systemd[1]: Started libcontainer container 1ca5762f0c1091649858e485f0d6f1c83d2186d2076a32b438a1519ab00d9cd0. machine # [ 52.838752] dhcpcd[682]: vethae218027: no IPv6 Routers available machine # [ 53.346249] dhcpcd[682]: vethd14f21aa: no IPv6 Routers available machine # [ 53.376731] systemd[1]: cri-containerd-1ca5762f0c1091649858e485f0d6f1c83d2186d2076a32b438a1519ab00d9cd0.scope: Deactivated successfully. machine # [ 53.381321] systemd[1]: cri-containerd-1ca5762f0c1091649858e485f0d6f1c83d2186d2076a32b438a1519ab00d9cd0.scope: Consumed 539ms CPU time over 673ms wall clock time, 307.5M memory peak, 8.6M read from disk, 232.5M written to disk. machine # [ 53.436622] dhcpcd[682]: veth07618a07: no IPv6 Routers available machine # [ 53.524821] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3234025421.mount: Deactivated successfully. machine # [ 54.156768] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1253596559.mount: Deactivated successfully. machine # [ 54.208311] systemd[1]: Started libcontainer container 3489ef47c7ff75deb596e4006300392e5636158a7bd071dce3cd544cae3f04e2. machine # [ 54.322588] niks3-server[1193]: 2026/09/27 15:00:39 INFO lead: acquired remote=10.42.0.4:40096 machine # [ 54.343258] systemd[1]: Started libcontainer container 2ccb0999c32028e88a6b74a8d540d7cb291c95f55a64db2e816599f89ae0386a. machine # [ 54.390270] systemd[1]: Started libcontainer container ea72e9057ae74a5b520a9517d3b107669346fed8070b11a0133042fbfae32700. machine # [ 54.529503] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped245689886.mount: Deactivated successfully. machine # [ 54.545850] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped4172253137.mount: Deactivated successfully. machine # [ 54.548230] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2750688360.mount: Deactivated successfully. machine # [ 54.621417] systemd[1]: tmp-ovl\x2didmapped2651481112.mount: Deactivated successfully. machine # [ 54.637287] systemd[1]: Started libcontainer container 8c5bd6cb655bae8359d42c5ea9d2e49466b3aef8b8e3a1552e29f99391b4331f. machine # [ 54.908389] systemd[1]: Started libcontainer container d490448c2c4a26c0ea335b314b3dbd1d81392efbe077da7727d1c135705565ee. machine # [ 55.144850] systemd[1]: cri-containerd-2ccb0999c32028e88a6b74a8d540d7cb291c95f55a64db2e816599f89ae0386a.scope: Deactivated successfully. machine # [ 55.146931] systemd[1]: cri-containerd-2ccb0999c32028e88a6b74a8d540d7cb291c95f55a64db2e816599f89ae0386a.scope: Consumed 497ms CPU time over 801ms wall clock time, 351.2M memory peak, 43.2M read from disk, 178M written to disk. machine # [ 55.282085] k3s[896]: I0927 15:00:40.936024 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2" podStartSLOduration=5.902664021 podStartE2EDuration="17.935998424s" totalImagesPullingTime="11.392413001s" totalInitContainerRuntime="640.921402ms" isStatefulPod=false podCreationTimestamp="2026-09-27 15:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 15:00:40.934991033 +0000 UTC m=+37.510445319" watchObservedRunningTime="2026-09-27 15:00:40.935998424 +0000 UTC m=+37.511452430" machine # [ 55.299226] k3s[896]: I0927 15:00:40.954383 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-c5d75967-qrhx9" podStartSLOduration=2.561021997 podStartE2EDuration="17.954359975s" totalImagesPullingTime="15.393337978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 15:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 15:00:40.953994845 +0000 UTC m=+37.529451924" watchObservedRunningTime="2026-09-27 15:00:40.954359975 +0000 UTC m=+37.529813702" machine # [ 55.526579] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2ccb0999c32028e88a6b74a8d540d7cb291c95f55a64db2e816599f89ae0386a-rootfs.mount: Deactivated successfully. machine # [ 56.434400] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped588218659.mount: Deactivated successfully. machine # [ 56.528923] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3817118239.mount: Deactivated successfully. machine # [ 56.545335] systemd[1]: Started libcontainer container 739759c6dd73c757d85f65e5a12677fe84ff9c976d12511b975131b345d1b93e. machine # [ 56.658140] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped680802690.mount: Deactivated successfully. machine # [ 56.722386] systemd[1]: Started libcontainer container a1ebfc664fb35407d28337743425666e43e449c94a84e1f94ca3914fdb0101dd. machine # [ 56.876456] systemd[1]: Started libcontainer container b52784c4d8854ae1da5c42f52746081f790ef1e91fbdc3b9688ea07810316eb1. machine # [ 57.328487] k3s[896]: I0927 15:00:42.983023 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85" podStartSLOduration=3.8465764460000003 podStartE2EDuration="19.982987915s" totalImagesPullingTime="15.36109198s" totalInitContainerRuntime="775.319489ms" isStatefulPod=false podCreationTimestamp="2026-09-27 15:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 15:00:42.981787763 +0000 UTC m=+39.557247356" watchObservedRunningTime="2026-09-27 15:00:42.982987915 +0000 UTC m=+39.558444994" machine # [ 57.533098] systemd[1]: tmp-ovl\x2didmapped3713581135.mount: Deactivated successfully. machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 34.41 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.20 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.16 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.04 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.30 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 10.67 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.20 seconds) machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 46.02 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.17 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.13 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 136.279353] niks3-server[1193]: 2026/09/27 15:02:01 INFO Received push request method=POST path=/api/pushes machine # [ 136.307306] niks3-server[1193]: 2026/09/27 15:02:01 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 136.319065] niks3-server[1193]: 2026/09/27 15:02:01 INFO Signed narinfos id=1 count=1 machine # [ 136.320684] niks3-server[1193]: 2026/09/27 15:02:01 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 136.323263] niks3-server[1193]: 2026/09/27 15:02:01 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 136.337517] niks3-server[1193]: 2026/09/27 15:02:01 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 136.342403] niks3-server[1193]: 2026/09/27 15:02:01 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 161.666413] niks3-server[1193]: 2026/09/27 15:02:27 INFO Received push request method=POST path=/api/pushes machine # [ 161.691809] niks3-server[1193]: 2026/09/27 15:02:27 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 161.697103] niks3-server[1193]: 2026/09/27 15:02:27 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 161.698328] niks3-server[1193]: 2026/09/27 15:02:27 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 161.699815] niks3-server[1193]: 2026/09/27 15:02:27 INFO Signed narinfos id=2 count=1 machine # [ 161.704423] niks3-server[1193]: 2026/09/27 15:02:27 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 161.709869] niks3-server[1193]: 2026/09/27 15:02:27 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 161.717603] niks3-server[1193]: 2026/09/27 15:02:27 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 161.783956] niks3-server[1193]: 2026/09/27 15:02:27 INFO Received push request method=POST path=/api/pushes machine # [ 161.793897] niks3-server[1193]: 2026/09/27 15:02:27 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 161.794640] niks3-server[1193]: 2026/09/27 15:02:27 INFO Signed narinfos id=3 count=1 machine # [ 161.797104] niks3-server[1193]: 2026/09/27 15:02:27 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 161.798941] niks3-server[1193]: 2026/09/27 15:02:27 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 161.800825] niks3-server[1193]: 2026/09/27 15:02:27 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 161.805335] niks3-server[1193]: 2026/09/27 15:02:27 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 186.298958] niks3-server[1193]: 2026/09/27 15:02:51 INFO Received push request method=POST path=/api/pushes machine # [ 186.316421] niks3-server[1193]: 2026/09/27 15:02:51 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 186.319550] niks3-server[1193]: 2026/09/27 15:02:51 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 186.322605] niks3-server[1193]: 2026/09/27 15:02:51 INFO Signed narinfos id=4 count=1 machine # [ 186.324198] niks3-server[1193]: 2026/09/27 15:02:51 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 186.325912] niks3-server[1193]: 2026/09/27 15:02:51 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 186.334898] niks3-server[1193]: 2026/09/27 15:02:51 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 186.340128] niks3-server[1193]: 2026/09/27 15:02:51 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 186.395618] niks3-server[1193]: 2026/09/27 15:02:52 INFO Received push request method=POST path=/api/pushes machine # [ 186.405101] niks3-server[1193]: 2026/09/27 15:02:52 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 186.407075] niks3-server[1193]: 2026/09/27 15:02:52 INFO Signed narinfos id=5 count=1 machine # [ 186.408709] niks3-server[1193]: 2026/09/27 15:02:52 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 186.410804] niks3-server[1193]: 2026/09/27 15:02:52 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 186.412415] niks3-server[1193]: 2026/09/27 15:02:52 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 186.415513] niks3-server[1193]: 2026/09/27 15:02:52 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 211.101733] niks3-server[1193]: 2026/09/27 15:03:16 INFO Received push request method=POST path=/api/pushes machine # [ 211.121641] niks3-server[1193]: 2026/09/27 15:03:16 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 211.123141] niks3-server[1193]: 2026/09/27 15:03:16 INFO Signed narinfos id=6 count=1 machine # [ 211.126227] niks3-server[1193]: 2026/09/27 15:03:16 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 211.129048] niks3-server[1193]: 2026/09/27 15:03:16 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 211.130787] niks3-server[1193]: 2026/09/27 15:03:16 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 211.133453] niks3-server[1193]: 2026/09/27 15:03:16 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 211.137814] niks3-server[1193]: 2026/09/27 15:03:16 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 138.01 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.20 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.23 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 212.955340] niks3-server[1193]: 2026/09/27 15:03:18 INFO Received push request method=POST path=/api/pushes machine # [ 212.978832] niks3-server[1193]: 2026/09/27 15:03:18 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 212.979954] niks3-server[1193]: 2026/09/27 15:03:18 INFO Signed narinfos id=7 count=1 machine # [ 212.982537] niks3-server[1193]: 2026/09/27 15:03:18 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 212.993513] niks3-server[1193]: 2026/09/27 15:03:18 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 212.996102] niks3-server[1193]: 2026/09/27 15:03:18 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 213.000898] niks3-server[1193]: 2026/09/27 15:03:18 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 237.710899] niks3-server[1193]: 2026/09/27 15:03:43 INFO Received push request method=POST path=/api/pushes machine # [ 237.731352] niks3-server[1193]: 2026/09/27 15:03:43 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 237.735517] niks3-server[1193]: 2026/09/27 15:03:43 INFO Signed narinfos id=8 count=1 machine # [ 237.736716] niks3-server[1193]: 2026/09/27 15:03:43 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 237.738175] niks3-server[1193]: 2026/09/27 15:03:43 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 237.745145] niks3-server[1193]: 2026/09/27 15:03:43 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 237.750734] niks3-server[1193]: 2026/09/27 15:03:43 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 237.755166] niks3-server[1193]: 2026/09/27 15:03:43 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 237.814363] niks3-server[1193]: 2026/09/27 15:03:43 INFO Received push request method=POST path=/api/pushes machine # [ 237.824891] niks3-server[1193]: 2026/09/27 15:03:43 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 237.827456] niks3-server[1193]: 2026/09/27 15:03:43 INFO Signed narinfos id=9 count=1 machine # [ 237.828731] niks3-server[1193]: 2026/09/27 15:03:43 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 237.831387] niks3-server[1193]: 2026/09/27 15:03:43 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 237.832591] niks3-server[1193]: 2026/09/27 15:03:43 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 237.835430] niks3-server[1193]: 2026/09/27 15:03:43 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 262.546904] niks3-server[1193]: 2026/09/27 15:04:08 INFO Received push request method=POST path=/api/pushes machine # [ 262.567627] niks3-server[1193]: 2026/09/27 15:04:08 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 262.568831] niks3-server[1193]: 2026/09/27 15:04:08 INFO Signed narinfos id=10 count=1 machine # [ 262.574467] niks3-server[1193]: 2026/09/27 15:04:08 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 262.576846] niks3-server[1193]: 2026/09/27 15:04:08 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 262.579087] niks3-server[1193]: 2026/09/27 15:04:08 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 262.582061] niks3-server[1193]: 2026/09/27 15:04:08 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 262.589246] niks3-server[1193]: 2026/09/27 15:04:08 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 262.654117] niks3-server[1193]: 2026/09/27 15:04:08 INFO Received push request method=POST path=/api/pushes machine # [ 262.667759] niks3-server[1193]: 2026/09/27 15:04:08 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 262.669318] niks3-server[1193]: 2026/09/27 15:04:08 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 262.672397] niks3-server[1193]: 2026/09/27 15:04:08 INFO Signed narinfos id=11 count=1 machine # [ 262.674246] niks3-server[1193]: 2026/09/27 15:04:08 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 262.681965] niks3-server[1193]: 2026/09/27 15:04:08 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 262.686349] niks3-server[1193]: 2026/09/27 15:04:08 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 287.804427] niks3-server[1193]: 2026/09/27 15:04:33 INFO Received push request method=POST path=/api/pushes machine # [ 287.824539] niks3-server[1193]: 2026/09/27 15:04:33 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 287.829844] niks3-server[1193]: 2026/09/27 15:04:33 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 287.830734] niks3-server[1193]: 2026/09/27 15:04:33 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 287.831877] niks3-server[1193]: 2026/09/27 15:04:33 INFO Signed narinfos id=12 count=1 machine # [ 287.835649] niks3-server[1193]: 2026/09/27 15:04:33 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 287.843808] niks3-server[1193]: 2026/09/27 15:04:33 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 287.847516] niks3-server[1193]: 2026/09/27 15:04:33 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 76.27 seconds) (finished: subtest: build through the balancer lands in the cache, in 214.72 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.18 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.14 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.19 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 290.006589] systemd[1]: Created slice libcontainer container kubepods-besteffort-podc7b1686d_35ab_48e5_807b_9ba9eb8d8212.slice. machine # [ 290.041789] k3s[896]: I0927 15:04:35.697217 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-job\") pod \"ci-56xwt\" (UID: \"c7b1686d-35ab-48e5-807b-9ba9eb8d8212\") " pod="ci/ci-56xwt" machine # [ 290.043546] k3s[896]: I0927 15:04:35.697311 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrp4\" (UniqueName: \"kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-kube-api-access-vsrp4\") pod \"ci-56xwt\" (UID: \"c7b1686d-35ab-48e5-807b-9ba9eb8d8212\") " pod="ci/ci-56xwt" machine # [ 290.044870] k3s[896]: I0927 15:04:35.697370 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-nix-grpc-farm\") pod \"ci-56xwt\" (UID: \"c7b1686d-35ab-48e5-807b-9ba9eb8d8212\") " pod="ci/ci-56xwt" machine # [ 291.417985] cni0: port 1(veth90c9fc2a) entered blocking state machine # [ 291.419730] cni0: port 1(veth90c9fc2a) entered disabled state machine # [ 291.422648] veth90c9fc2a: entered allmulticast mode machine # [ 291.425171] veth90c9fc2a: entered promiscuous mode machine # [ 291.444144] cni0: port 1(veth90c9fc2a) entered blocking state machine # [ 291.446346] cni0: port 1(veth90c9fc2a) entered forwarding state machine # [ 291.338582] (udev-worker)[4950]: Network interface NamePolicy= disabled on kernel command line. machine # [ 291.365610] dhcpcd[682]: veth90c9fc2a: IAID 8a:75:c2:d2 machine # [ 291.366466] dhcpcd[682]: veth90c9fc2a: adding address fe80::5ccd:8aff:fe75:c2d2 machine # [ 291.393613] systemd[1]: Started libcontainer container 1c39dadce885f19a421ab926dd88fc0d16f2afdc8e5fa91a3d40b41d0a65cce4. machine # [ 292.619760] dhcpcd[682]: veth90c9fc2a: soliciting a DHCP lease machine # [ 293.046489] dhcpcd[682]: veth90c9fc2a: soliciting an IPv6 router machine # [ 293.880785] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1283488847.mount: Deactivated successfully. machine # [ 293.939737] systemd[1]: Started libcontainer container a6aa0e03c1b1cb5e1027ec8677aac04d206c5de9e6dbec2ce68d45b710a090b2. machine # [ 294.327570] k3s[896]: I0927 15:04:39.982838 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-56xwt" podStartSLOduration=4.982810491 podStartE2EDuration="4.982810491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 15:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 15:04:39.982104256 +0000 UTC m=+276.557563012" watchObservedRunningTime="2026-09-27 15:04:39.982810491 +0000 UTC m=+276.558264497" machine # [ 295.276099] niks3-server[1193]: 2026/09/27 15:04:40 INFO Received push request method=POST path=/api/pushes machine # [ 295.293333] niks3-server[1193]: 2026/09/27 15:04:40 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 295.297761] niks3-server[1193]: 2026/09/27 15:04:40 INFO Signed narinfos id=13 count=1 machine # [ 295.300442] niks3-server[1193]: 2026/09/27 15:04:40 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 295.302866] niks3-server[1193]: 2026/09/27 15:04:40 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 295.314316] niks3-server[1193]: 2026/09/27 15:04:40 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 295.321286] niks3-server[1193]: 2026/09/27 15:04:40 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 297.621409] dhcpcd[682]: veth90c9fc2a: probing for an IPv4LL address machine # [ 302.839568] dhcpcd[682]: veth90c9fc2a: using IPv4LL address 169.254.243.207 machine # [ 302.841408] dhcpcd[682]: veth90c9fc2a: adding route to 169.254.0.0/16 machine # [ 305.050212] dhcpcd[682]: veth90c9fc2a: no IPv6 Routers available machine # [ 310.162979] postgres[756]: [756] LOG: checkpoint starting: time machine # [ 320.427255] niks3-server[1193]: 2026/09/27 15:05:06 INFO Received push request method=POST path=/api/pushes machine # [ 320.446525] niks3-server[1193]: 2026/09/27 15:05:06 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 320.450937] niks3-server[1193]: 2026/09/27 15:05:06 INFO Signed narinfos id=14 count=1 machine # [ 320.454443] niks3-server[1193]: 2026/09/27 15:05:06 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 320.455629] niks3-server[1193]: 2026/09/27 15:05:06 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 320.462907] niks3-server[1193]: 2026/09/27 15:05:06 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 320.464355] niks3-server[1193]: 2026/09/27 15:05:06 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 320.472237] niks3-server[1193]: 2026/09/27 15:05:06 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 320.539462] niks3-server[1193]: 2026/09/27 15:05:06 INFO Received push request method=POST path=/api/pushes machine # [ 320.548432] niks3-server[1193]: 2026/09/27 15:05:06 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 320.551610] niks3-server[1193]: 2026/09/27 15:05:06 INFO Signed narinfos id=15 count=1 machine # [ 320.553157] niks3-server[1193]: 2026/09/27 15:05:06 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 320.554889] niks3-server[1193]: 2026/09/27 15:05:06 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 320.560675] niks3-server[1193]: 2026/09/27 15:05:06 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 320.566249] niks3-server[1193]: 2026/09/27 15:05:06 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 345.653423] niks3-server[1193]: 2026/09/27 15:05:31 INFO Received push request method=POST path=/api/pushes machine # [ 345.664055] niks3-server[1193]: 2026/09/27 15:05:31 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 345.666395] niks3-server[1193]: 2026/09/27 15:05:31 INFO Signed narinfos id=16 count=1 machine # [ 345.667899] niks3-server[1193]: 2026/09/27 15:05:31 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 345.669073] niks3-server[1193]: 2026/09/27 15:05:31 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 345.670623] niks3-server[1193]: 2026/09/27 15:05:31 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 345.672224] niks3-server[1193]: 2026/09/27 15:05:31 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 345.676602] niks3-server[1193]: 2026/09/27 15:05:31 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 345.730353] niks3-server[1193]: 2026/09/27 15:05:31 INFO Received push request method=POST path=/api/pushes machine # [ 345.738326] niks3-server[1193]: 2026/09/27 15:05:31 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 345.740074] niks3-server[1193]: 2026/09/27 15:05:31 INFO Signed narinfos id=17 count=1 machine # [ 345.742292] niks3-server[1193]: 2026/09/27 15:05:31 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 345.743473] niks3-server[1193]: 2026/09/27 15:05:31 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 345.746124] niks3-server[1193]: 2026/09/27 15:05:31 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 345.748649] niks3-server[1193]: 2026/09/27 15:05:31 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 370.239439] niks3-server[1193]: 2026/09/27 15:05:55 INFO Received push request method=POST path=/api/pushes machine # [ 370.256661] niks3-server[1193]: 2026/09/27 15:05:55 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 370.260436] niks3-server[1193]: 2026/09/27 15:05:55 INFO Signed narinfos id=18 count=1 machine # [ 370.264334] niks3-server[1193]: 2026/09/27 15:05:55 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 370.268543] niks3-server[1193]: 2026/09/27 15:05:55 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 370.270570] niks3-server[1193]: 2026/09/27 15:05:55 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 370.273787] niks3-server[1193]: 2026/09/27 15:05:55 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 370.282780] niks3-server[1193]: 2026/09/27 15:05:55 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 373.000726] niks3-server[1193]: 2026/09/27 15:05:58 INFO Received push request method=POST path=/api/pushes machine # [ 373.018318] niks3-server[1193]: 2026/09/27 15:05:58 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 373.021206] niks3-server[1193]: 2026/09/27 15:05:58 INFO Signed narinfos id=19 count=1 machine # [ 373.023383] niks3-server[1193]: 2026/09/27 15:05:58 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 373.028386] niks3-server[1193]: 2026/09/27 15:05:58 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 373.033299] niks3-server[1193]: 2026/09/27 15:05:58 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 373.040798] niks3-server[1193]: 2026/09/27 15:05:58 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 397.557858] niks3-server[1193]: 2026/09/27 15:06:23 INFO Received push request method=POST path=/api/pushes machine # [ 397.584253] niks3-server[1193]: 2026/09/27 15:06:23 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 397.586977] niks3-server[1193]: 2026/09/27 15:06:23 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 397.588108] niks3-server[1193]: 2026/09/27 15:06:23 INFO Signed narinfos id=20 count=1 machine # [ 397.588888] niks3-server[1193]: 2026/09/27 15:06:23 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 397.591389] niks3-server[1193]: 2026/09/27 15:06:23 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 397.603958] niks3-server[1193]: 2026/09/27 15:06:23 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 397.610792] niks3-server[1193]: 2026/09/27 15:06:23 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 397.750839] systemd[1]: cri-containerd-a6aa0e03c1b1cb5e1027ec8677aac04d206c5de9e6dbec2ce68d45b710a090b2.scope: Deactivated successfully. machine # [ 397.755300] systemd[1]: cri-containerd-a6aa0e03c1b1cb5e1027ec8677aac04d206c5de9e6dbec2ce68d45b710a090b2.scope: Consumed 1.020s CPU time over 1min 43.811s wall clock time, 96.6M memory peak, 27M read from disk, 428K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 397.798841] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a6aa0e03c1b1cb5e1027ec8677aac04d206c5de9e6dbec2ce68d45b710a090b2-rootfs.mount: Deactivated successfully. machine # [ 399.774610] systemd[1]: cri-containerd-1c39dadce885f19a421ab926dd88fc0d16f2afdc8e5fa91a3d40b41d0a65cce4.scope: Deactivated successfully. machine # [ 399.822813] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1c39dadce885f19a421ab926dd88fc0d16f2afdc8e5fa91a3d40b41d0a65cce4-rootfs.mount: Deactivated successfully. machine # [ 399.850227] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-1c39dadce885f19a421ab926dd88fc0d16f2afdc8e5fa91a3d40b41d0a65cce4-shm.mount: Deactivated successfully. machine # [ 399.882187] d[ 400.034746] cni0: port 1(veth90c9fc2a) entered disabled state machine # hcpcd[682]: veth90c9fc2a: carrier lost machine # [ 400.037330] veth90c9fc2a (unregistering): left allmulticast mode machine # [ 400.038626] veth90c9fc2a (unregistering): left promiscuous mode machine # [ 400.039709] cni0: port 1(veth90c9fc2a) entered disabled state machine # [ 399.906056] systemd[1]: run-netns-cni\x2d6b4888b0\x2dfcd3\x2dd273\x2d4fd1\x2dc40c8939b529.mount: Deactivated successfully. machine # [ 399.907773] dhcpcd[682]: veth90c9fc2a: deleting address fe80::5ccd:8aff:fe75:c2d2 machine # [ 399.911349] dhcpcd[682]: veth90c9fc2a: deleting route to 169.254.0.0/16 machine # [ 399.976317] dhcpcd[682]: veth90c9fc2a: removing interface machine # [ 400.121305] k3s[896]: I0927 15:06:25.776556 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-kube-api-access-vsrp4\" (UniqueName: \"kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-kube-api-access-vsrp4\") pod \"c7b1686d-35ab-48e5-807b-9ba9eb8d8212\" (UID: \"c7b1686d-35ab-48e5-807b-9ba9eb8d8212\") " machine # [ 400.121699] k3s[896]: I0927 15:06:25.776625 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-nix-grpc-farm\") pod \"c7b1686d-35ab-48e5-807b-9ba9eb8d8212\" (UID: \"c7b1686d-35ab-48e5-807b-9ba9eb8d8212\") " machine # [ 400.122878] k3s[896]: I0927 15:06:25.776664 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-job\" (UniqueName: \"kubernetes.io/configmap/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-job\") pod \"c7b1686d-35ab-48e5-807b-9ba9eb8d8212\" (UID: \"c7b1686d-35ab-48e5-807b-9ba9eb8d8212\") " machine # [ 400.124138] k3s[896]: I0927 15:06:25.777155 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-job" pod "c7b1686d-35ab-48e5-807b-9ba9eb8d8212" (UID: "c7b1686d-35ab-48e5-807b-9ba9eb8d8212"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 400.125103] systemd[1]: var-lib-kubelet-pods-c7b1686d\x2d35ab\x2d48e5\x2d807b\x2d9ba9eb8d8212-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dvsrp4.mount: Deactivated successfully. machine # [ 400.149300] k3s[896]: I0927 15:06:25.805361 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-kube-api-access-vsrp4" pod "c7b1686d-35ab-48e5-807b-9ba9eb8d8212" (UID: "c7b1686d-35ab-48e5-807b-9ba9eb8d8212"). InnerVolumeSpecName "kube-api-access-vsrp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 400.152084] systemd[1]: var-lib-kubelet-pods-c7b1686d\x2d35ab\x2d48e5\x2d807b\x2d9ba9eb8d8212-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 400.156318] k3s[896]: I0927 15:06:25.812392 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-nix-grpc-farm" pod "c7b1686d-35ab-48e5-807b-9ba9eb8d8212" (UID: "c7b1686d-35ab-48e5-807b-9ba9eb8d8212"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 400.221817] k3s[896]: I0927 15:06:25.877621 896 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-job\") on node \"machine\" DevicePath \"\"" machine # [ 400.223452] k3s[896]: I0927 15:06:25.877696 896 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsrp4\" (UniqueName: \"kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-kube-api-access-vsrp4\") on node \"machine\" DevicePath \"\"" machine # [ 400.224924] k3s[896]: I0927 15:06:25.877735 896 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/c7b1686d-35ab-48e5-807b-9ba9eb8d8212-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 400.763387] k3s[896]: I0927 15:06:26.419341 896 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c39dadce885f19a421ab926dd88fc0d16f2afdc8e5fa91a3d40b41d0a65cce4" machine # [ 400.785241] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podc7b1686d_35ab_48e5_807b_9ba9eb8d8212.slice. machine # [ 400.789155] systemd[1]: kubepods-besteffort-podc7b1686d_35ab_48e5_807b_9ba9eb8d8212.slice: Consumed 1.048s CPU time over 1min 50.776s wall clock time, 96.8M memory peak, 27M read from disk, 632K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 111.62 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.16 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpeeeb5ic4/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (25s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.15 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 113.34 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.28 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.18 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-8bmjs -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 402.941627] k3s[896]: E0927 15:06:28.597303 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:47230: use of closed network connection machine # [ 404.254801] k3s[896]: E0927 15:06:29.910448 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60744: use of closed network connection machine # [ 405.525738] k3s[896]: E0927 15:06:31.181503 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60766: use of closed network connection machine # [ 406.821959] k3s[896]: E0927 15:06:32.477709 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60788: use of closed network connection machine # [ 408.114779] k3s[896]: E0927 15:06:33.770401 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60822: use of closed network connection machine # [ 409.427679] k3s[896]: E0927 15:06:35.083128 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60858: use of closed network connection machine # [ 410.716729] k3s[896]: E0927 15:06:36.372479 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60898: use of closed network connection machine # [ 410.717744] k3s[896]: E0927 15:06:36.373035 896 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:60168->127.0.0.1:10010: write tcp 127.0.0.1:60168->127.0.0.1:10010: write: broken pipe machine # [ 412.029310] k3s[896]: E0927 15:06:37.684575 896 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:60182->127.0.0.1:10010: write tcp 127.0.0.1:60182->127.0.0.1:10010: write: broken pipe machine # [ 412.030860] k3s[896]: E0927 15:06:37.684815 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60940: use of closed network connection machine # [ 413.347780] k3s[896]: E0927 15:06:39.003310 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38864: use of closed network connection machine # [ 414.186526] postgres[756]: [756] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.916 s, sync=0.065 s, total=104.024 s; sync files=364, longest=0.003 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C74D70, redo lsn=0/1C42B90 machine # [ 414.643327] k3s[896]: E0927 15:06:40.298815 896 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:43446->127.0.0.1:10010: write tcp 127.0.0.1:43446->127.0.0.1:10010: write: broken pipe machine # [ 414.644375] k3s[896]: time="2026-09-27T15:06:40Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:49150->127.0.0.1:10250: read: connection reset by peer" machine # [ 415.877651] k3s[896]: E0927 15:06:41.533365 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38922: use of closed network connection machine # [ 417.185772] k3s[896]: E0927 15:06:42.841018 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38944: use of closed network connection machine # [ 418.467366] k3s[896]: E0927 15:06:44.122998 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38972: use of closed network connection machine # [ 419.784543] k3s[896]: E0927 15:06:45.440100 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39012: use of closed network connection machine # [ 421.107101] k3s[896]: E0927 15:06:46.762617 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39022: use of closed network connection machine # [ 422.410591] k3s[896]: E0927 15:06:48.066284 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39042: use of closed network connection machine # [ 423.696161] k3s[896]: E0927 15:06:49.351911 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57370: use of closed network connection machine # [ 424.945279] k3s[896]: E0927 15:06:50.600995 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57400: use of closed network connection machine # [ 426.220233] k3s[896]: E0927 15:06:51.875772 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57448: use of closed network connection machine # [ 427.511802] k3s[896]: E0927 15:06:53.167364 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57466: use of closed network connection machine # [ 428.816200] k3s[896]: E0927 15:06:54.471570 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57498: use of closed network connection machine # [ 430.119229] k3s[896]: E0927 15:06:55.774838 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57524: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-8bmjs -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 27.43 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 430.344060] niks3-server[1193]: 2026/09/27 15:06:55 INFO Received push request method=POST path=/api/pushes machine # [ 430.355393] niks3-server[1193]: 2026/09/27 15:06:56 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 430.358088] niks3-server[1193]: 2026/09/27 15:06:56 INFO Signed narinfos id=21 count=1 machine # [ 430.360298] niks3-server[1193]: 2026/09/27 15:06:56 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 430.362597] niks3-server[1193]: 2026/09/27 15:06:56 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 430.364610] niks3-server[1193]: 2026/09/27 15:06:56 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 430.367882] niks3-server[1193]: 2026/09/27 15:06:56 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 455.284459] niks3-server[1193]: 2026/09/27 15:07:20 INFO Received push request method=POST path=/api/pushes machine # [ 455.304260] niks3-server[1193]: 2026/09/27 15:07:20 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 455.306864] niks3-server[1193]: 2026/09/27 15:07:20 INFO Signed narinfos id=22 count=1 machine # [ 455.310166] niks3-server[1193]: 2026/09/27 15:07:20 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 455.312733] niks3-server[1193]: 2026/09/27 15:07:20 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 455.317282] niks3-server[1193]: 2026/09/27 15:07:20 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 455.322844] niks3-server[1193]: 2026/09/27 15:07:20 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 455.337023] niks3-server[1193]: 2026/09/27 15:07:20 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 455.389829] niks3-server[1193]: 2026/09/27 15:07:21 INFO Received push request method=POST path=/api/pushes machine # [ 455.401892] niks3-server[1193]: 2026/09/27 15:07:21 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 455.404784] niks3-server[1193]: 2026/09/27 15:07:21 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 455.405967] niks3-server[1193]: 2026/09/27 15:07:21 INFO Signed narinfos id=23 count=1 machine # [ 455.407184] niks3-server[1193]: 2026/09/27 15:07:21 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 455.411541] niks3-server[1193]: 2026/09/27 15:07:21 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 455.415023] niks3-server[1193]: 2026/09/27 15:07:21 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 480.334868] niks3-server[1193]: 2026/09/27 15:07:45 INFO Received push request method=POST path=/api/pushes machine # [ 480.353141] niks3-server[1193]: 2026/09/27 15:07:46 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 480.355418] niks3-server[1193]: 2026/09/27 15:07:46 INFO Signed narinfos id=24 count=1 machine # [ 480.359732] niks3-server[1193]: 2026/09/27 15:07:46 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 480.362395] niks3-server[1193]: 2026/09/27 15:07:46 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 480.367159] niks3-server[1193]: 2026/09/27 15:07:46 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 480.371793] niks3-server[1193]: 2026/09/27 15:07:46 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 480.377534] niks3-server[1193]: 2026/09/27 15:07:46 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 480.442402] niks3-server[1193]: 2026/09/27 15:07:46 INFO Received push request method=POST path=/api/pushes machine # [ 480.453730] niks3-server[1193]: 2026/09/27 15:07:46 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 480.455871] niks3-server[1193]: 2026/09/27 15:07:46 INFO Signed narinfos id=25 count=1 machine # [ 480.457396] niks3-server[1193]: 2026/09/27 15:07:46 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 480.459748] niks3-server[1193]: 2026/09/27 15:07:46 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 480.461710] niks3-server[1193]: 2026/09/27 15:07:46 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 480.465924] niks3-server[1193]: 2026/09/27 15:07:46 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 504.786306] niks3-server[1193]: 2026/09/27 15:08:10 INFO Received push request method=POST path=/api/pushes machine # [ 504.805362] niks3-server[1193]: 2026/09/27 15:08:10 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 504.807051] niks3-server[1193]: 2026/09/27 15:08:10 INFO Signed narinfos id=26 count=1 machine # [ 504.811281] niks3-server[1193]: 2026/09/27 15:08:10 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 504.813154] niks3-server[1193]: 2026/09/27 15:08:10 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 504.816878] niks3-server[1193]: 2026/09/27 15:08:10 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 504.820246] niks3-server[1193]: 2026/09/27 15:08:10 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 504.826309] niks3-server[1193]: 2026/09/27 15:08:10 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 74.70 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 102.62 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.14 seconds) machine: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2"' machine: (finished: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2"', in 0.03 seconds) (finished: subtest: metrics carry build_info, in 0.17 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 505.209176] k3s[896]: E0927 15:08:10.864835 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41874: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.18 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 505.460157] k3s[896]: E0927 15:08:11.116116 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41898: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.25 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc -- sh -c 'fallocate -l 11438764032 /nix/fill' machine # [ 505.678035] k3s[896]: E0927 15:08:11.333967 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41920: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc -- sh -c 'fallocate -l 11438764032 /nix/fill', in 0.22 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc --since=30s | grep -q 'store paths deleted', in 10.16 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc -- sh -c 'rm /nix/fill' machine # [ 516.030724] k3s[896]: E0927 15:08:21.686154 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46042: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc -- sh -c 'rm /nix/fill', in 0.19 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.13 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 516.336768] k3s[896]: E0927 15:08:21.992757 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46076: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.17 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 11.31 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 516.361499] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: ed8563d1405f459d8aca323ac243b878 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 516.485593] nix[9663]: don't know how to build these paths: machine # [ 516.486845] nix[9663]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 516.510574] nix[9663]: copying 1 paths to '127.0.0.1:30051'... machine # [ 516.512485] nix[9663]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 516.562286] niks3-server[1193]: 2026/09/27 15:08:22 INFO Received push request method=POST path=/api/pushes machine # [ 516.581605] niks3-server[1193]: 2026/09/27 15:08:22 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 516.583950] niks3-server[1193]: 2026/09/27 15:08:22 INFO Signed narinfos id=27 count=1 machine # [ 516.585953] niks3-server[1193]: 2026/09/27 15:08:22 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 516.588406] niks3-server[1193]: 2026/09/27 15:08:22 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 516.593768] niks3-server[1193]: 2026/09/27 15:08:22 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 516.596515] niks3-server[1193]: 2026/09/27 15:08:22 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 516.608390] nix[9663]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 516.609266] nix[9663]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.23 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 517.676783] nix[9663]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 517.678688] nix[9663]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 517.698308] systemd[1]: cri-containerd-9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5.scope: Deactivated successfully. machine # [ 517.699205] systemd[1]: cri-containerd-9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5.scope: Consumed 4.395s CPU time over 7min 58.418s wall clock time, 55.5M memory peak, 34.1M read from disk, 616.4K incoming IP traffic, 763.5K outgoing IP traffic. machine # [ 517.731499] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5-rootfs.mount: Deactivated successfully. machine # [ 517.761877] systemd[1]: cri-containerd-8bd38b8ca4298c105b767afcb14ec4ef264258e2b104d1bce92b884afd1ed807.scope: Deactivated successfully. machine # [ 517.789744] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8bd38b8ca4298c105b767afcb14ec4ef264258e2b104d1bce92b884afd1ed807-rootfs.mount: Deactivated successfully. machine # [ 517.813529] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-8bd38b8ca4298c105b767afcb14ec4ef264258e2b104d1bce92b884afd1ed807-shm.mount: Deactivated successfully. machine # [ 517.997471] cni0: port 5(veth07618a07) entered disabled state machine # [ 518.000818] veth07618a07 (unregistering): left allmulticast mode machine # [ 517.849899] dhcpcd[682]: veth07618a07: carrier lost machine # [ 518.001981] veth07618a07 (unregistering): left promiscuous mode machine # [ 518.004097] cni0: port 5(veth07618a07) entered disabled state machine # [ 517.870740] systemd[1]: run-netns-cni\x2de3cd657d\x2de14e\x2d00d8\x2d2c48\x2dcdcf467f3707.mount: Deactivated successfully. machine # [ 517.883216] dhcpcd[682]: veth07618a07: deleting address fe80::28a3:f7ff:fee4:453a machine # [ 517.886227] dhcpcd[682]: veth07618a07: deleting route to 169.254.0.0/16 machine # [ 517.957567] dhcpcd[682]: veth07618a07: removing interface machine # [ 517.958992] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2e012002_a800_4984_b586_cc20c6929d3d.slice. machine # [ 517.998365] k3s[896]: I0927 15:08:23.654132 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ceedac4-9f57-4dc3-897a-fdefca3af323-config\" (UniqueName: \"kubernetes.io/configmap/6ceedac4-9f57-4dc3-897a-fdefca3af323-config\") pod \"6ceedac4-9f57-4dc3-897a-fdefca3af323\" (UID: \"6ceedac4-9f57-4dc3-897a-fdefca3af323\") " machine # [ 517.999154] k3s[896]: I0927 15:08:23.654278 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-lb\" (UniqueName: \"kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-lb\") pod \"6ceedac4-9f57-4dc3-897a-fdefca3af323\" (UID: \"6ceedac4-9f57-4dc3-897a-fdefca3af323\") " machine # [ 517.999703] k3s[896]: I0927 15:08:23.654313 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ceedac4-9f57-4dc3-897a-fdefca3af323-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ceedac4-9f57-4dc3-897a-fdefca3af323-tmp\") pod \"6ceedac4-9f57-4dc3-897a-fdefca3af323\" (UID: \"6ceedac4-9f57-4dc3-897a-fdefca3af323\") " machine # [ 518.000209] k3s[896]: I0927 15:08:23.654340 896 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-ca\" (UniqueName: \"kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-ca\") pod \"6ceedac4-9f57-4dc3-897a-fdefca3af323\" (UID: \"6ceedac4-9f57-4dc3-897a-fdefca3af323\") " machine # [ 518.007147] systemd[1]: var-lib-kubelet-pods-6ceedac4\x2d9f57\x2d4dc3\x2d897a\x2dfdefca3af323-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 518.025507] k3s[896]: I0927 15:08:23.681563 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ceedac4-9f57-4dc3-897a-fdefca3af323-tmp" pod "6ceedac4-9f57-4dc3-897a-fdefca3af323" (UID: "6ceedac4-9f57-4dc3-897a-fdefca3af323"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 518.030354] k3s[896]: I0927 15:08:23.686415 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-lb" pod "6ceedac4-9f57-4dc3-897a-fdefca3af323" (UID: "6ceedac4-9f57-4dc3-897a-fdefca3af323"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 518.031225] k3s[896]: I0927 15:08:23.686994 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-ca" pod "6ceedac4-9f57-4dc3-897a-fdefca3af323" (UID: "6ceedac4-9f57-4dc3-897a-fdefca3af323"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 518.040451] k3s[896]: I0927 15:08:23.696536 896 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ceedac4-9f57-4dc3-897a-fdefca3af323-config" pod "6ceedac4-9f57-4dc3-897a-fdefca3af323" (UID: "6ceedac4-9f57-4dc3-897a-fdefca3af323"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 518.098971] k3s[896]: I0927 15:08:23.755006 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e012002-a800-4984-b586-cc20c6929d3d-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-zllj7\" (UID: \"2e012002-a800-4984-b586-cc20c6929d3d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-zllj7" machine # [ 518.099802] k3s[896]: I0927 15:08:23.755059 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e012002-a800-4984-b586-cc20c6929d3d-config\") pod \"nix-grpc-farm-lb-75b44f88dd-zllj7\" (UID: \"2e012002-a800-4984-b586-cc20c6929d3d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-zllj7" machine # [ 518.100426] k3s[896]: I0927 15:08:23.755085 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/2e012002-a800-4984-b586-cc20c6929d3d-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-zllj7\" (UID: \"2e012002-a800-4984-b586-cc20c6929d3d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-zllj7" machine # [ 518.100914] k3s[896]: I0927 15:08:23.755110 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/2e012002-a800-4984-b586-cc20c6929d3d-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-zllj7\" (UID: \"2e012002-a800-4984-b586-cc20c6929d3d\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-zllj7" machine # [ 518.101318] k3s[896]: I0927 15:08:23.755138 896 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ceedac4-9f57-4dc3-897a-fdefca3af323-config\") on node \"machine\" DevicePath \"\"" machine # [ 518.101780] k3s[896]: I0927 15:08:23.755153 896 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 518.102464] k3s[896]: I0927 15:08:23.755200 896 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ceedac4-9f57-4dc3-897a-fdefca3af323-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 518.102900] k3s[896]: I0927 15:08:23.755212 896 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/6ceedac4-9f57-4dc3-897a-fdefca3af323-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 518.133465] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod6ceedac4_9f57_4dc3_897a_fdefca3af323.slice. machine # [ 518.134307] systemd[1]: kubepods-besteffort-pod6ceedac4_9f57_4dc3_897a_fdefca3af323.slice: Consumed 4.427s CPU time over 8min 102ms wall clock time, 55.8M memory peak, 34.1M read from disk, 616.4K incoming IP traffic, 763.5K outgoing IP traffic. machine # [ 518.274708] k3s[896]: I0927 15:08:23.930766 896 scope.go:122] "RemoveContainer" containerID="9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5" machine # [ 518.286311] k3s[896]: I0927 15:08:23.942376 896 scope.go:122] "RemoveContainer" containerID="9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5" machine # [ 518.288495] k3s[896]: E0927 15:08:23.944156 896 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5\": not found" containerID="9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5" machine # [ 518.289148] k3s[896]: I0927 15:08:23.944220 896 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5"} err="failed to get container status \"9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5\": rpc error: code = NotFound desc = an error occurred when try to find container \"9d901d246c19543512da3a6d64be70d962a63344e988edadd7fb53af7d71d6f5\": not found" machine # [ 518.457471] cni0: port 1(veth14094985) entered blocking state machine # [ 518.458890] cni0: port 1(veth14094985) entered disabled state machine # [ 518.460131] veth14094985: entered allmulticast mode machine # [ 518.461289] veth14094985: entered promiscuous mode machine # [ 518.310994] (udev-worker)[9850]: Network interface NamePolicy= disabled on kernel command line. machine # [ 518.470126] cni0: port 1(veth14094985) entered blocking state machine # [ 518.471330] cni0: port 1(veth14094985) entered forwarding state machine # [ 518.339096] dhcpcd[682]: veth14094985: IAID 14:59:d5:bc machine # [ 518.339873] dhcpcd[682]: veth14094985: adding address fe80::c9f:14ff:fe59:d5bc machine # [ 518.400544] systemd[1]: Started libcontainer container 6c8838bb88660ad1122f07132fb9e782f01ceab07db81aa21c9a2d730e138ae7. machine # [ 518.527507] systemd[1]: Started libcontainer container e8e14c0e0fdb85d715c77b9d46f2418c1571b4f7d50395dbb85c5121e1705976. machine # [ 518.740616] systemd[1]: var-lib-kubelet-pods-6ceedac4\x2d9f57\x2d4dc3\x2d897a\x2dfdefca3af323-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 518.741876] systemd[1]: var-lib-kubelet-pods-6ceedac4\x2d9f57\x2d4dc3\x2d897a\x2dfdefca3af323-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 518.742809] systemd[1]: var-lib-kubelet-pods-6ceedac4\x2d9f57\x2d4dc3\x2d897a\x2dfdefca3af323-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 518.743985] systemd[1]: var-lib-kubelet-pods-6ceedac4\x2d9f57\x2d4dc3\x2d897a\x2dfdefca3af323-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 518.744884] systemd[1]: var-lib-kubelet-pods-6ceedac4\x2d9f57\x2d4dc3\x2d897a\x2dfdefca3af323-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 519.334288] k3s[896]: I0927 15:08:24.989692 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-zllj7" podStartSLOduration=1.9896546320000001 podStartE2EDuration="1.989654632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 15:08:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 15:08:24.965999949 +0000 UTC m=+501.541459543" watchObservedRunningTime="2026-09-27 15:08:24.989654632 +0000 UTC m=+501.565111431" machine # [ 520.105465] k3s[896]: I0927 15:08:25.761419 896 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ceedac4-9f57-4dc3-897a-fdefca3af323" path="/var/lib/kubelet/pods/6ceedac4-9f57-4dc3-897a-fdefca3af323/volumes" machine # [ 520.134582] dhcpcd[682]: veth14094985: soliciting an IPv6 router machine # [ 520.177607] nix[9663]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 520.210541] dhcpcd[682]: veth14094985: soliciting a DHCP lease machine # [ 521.227846] nix[9663]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 521.229455] nix[9663]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-r4b85: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 525.212964] dhcpcd[682]: veth14094985: probing for an IPv4LL address machine # [ 530.047940] dhcpcd[682]: veth14094985: using IPv4LL address 169.254.107.25 machine # [ 530.050654] dhcpcd[682]: veth14094985: adding route to 169.254.0.0/16 machine # [ 532.136972] dhcpcd[682]: veth14094985: no IPv6 Routers available machine # [ 566.382737] niks3-server[1193]: 2026/09/27 15:09:12 INFO Received push request method=POST path=/api/pushes machine # [ 566.402751] niks3-server[1193]: 2026/09/27 15:09:12 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 566.406911] niks3-server[1193]: 2026/09/27 15:09:12 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 566.411628] niks3-server[1193]: 2026/09/27 15:09:12 INFO Signed narinfos id=28 count=1 machine # [ 566.414841] niks3-server[1193]: 2026/09/27 15:09:12 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 566.424588] niks3-server[1193]: 2026/09/27 15:09:12 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 566.425518] niks3-server[1193]: 2026/09/27 15:09:12 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 566.459908] systemd[1]: vialb.service: Deactivated successfully. machine # [ 566.461375] systemd[1]: vialb.service: Consumed 201ms CPU time over 50.098s wall clock time, 44.2M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.90 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.18 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.43 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 566.798600] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 9e42150bb4a041c4a20167ee1e203a62 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.03 seconds) machine # [ 566.924501] nix[10580]: don't know how to build these paths: machine # [ 566.925290] nix[10580]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 566.946779] nix[10580]: copying 1 paths to '127.0.0.1:30051'... machine # [ 566.948629] nix[10580]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 566.984708] niks3-server[1193]: 2026/09/27 15:09:12 INFO Received push request method=POST path=/api/pushes machine # command terminated with exit code 1 machine # [ 566.992501] k3s[896]: E0927 15:09:12.648240 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39170: use of closed network connection machine # [ 566.997262] niks3-server[1193]: 2026/09/27 15:09:12 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 566.999052] niks3-server[1193]: 2026/09/27 15:09:12 INFO Signed narinfos id=29 count=1 machine # [ 567.001329] niks3-server[1193]: 2026/09/27 15:09:12 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 567.002788] niks3-server[1193]: 2026/09/27 15:09:12 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 567.005740] niks3-server[1193]: 2026/09/27 15:09:12 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 567.008723] niks3-server[1193]: 2026/09/27 15:09:12 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 567.019457] nix[10580]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 567.019965] nix[10580]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 567.201609] k3s[896]: E0927 15:09:12.857599 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39192: use of closed network connection machine # command terminated with exit code 1 machine # [ 568.480945] k3s[896]: E0927 15:09:14.136680 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39214: use of closed network connection machine # command terminated with exit code 1 machine # [ 568.661864] k3s[896]: E0927 15:09:14.317922 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39238: use of closed network connection machine # command terminated with exit code 1 machine # [ 569.967858] k3s[896]: E0927 15:09:15.623600 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39272: use of closed network connection machine # command terminated with exit code 1 machine # [ 570.146839] k3s[896]: E0927 15:09:15.802886 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39294: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 571.427103] k3s[896]: E0927 15:09:17.082537 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39310: use of closed network connection machine # [ 571.644259] k3s[896]: E0927 15:09:17.300318 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39332: use of closed network connection machine # command terminated with exit code 1 machine # [ 572.910313] k3s[896]: E0927 15:09:18.566069 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39360: use of closed network connection machine # command terminated with exit code 1 machine # [ 573.089254] k3s[896]: E0927 15:09:18.745298 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51366: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 574.291863] k3s[896]: E0927 15:09:19.946873 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51388: use of closed network connection machine # [ 574.468215] k3s[896]: E0927 15:09:20.124228 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51414: use of closed network connection machine # command terminated with exit code 1 machine # [ 575.750883] k3s[896]: time="2026-09-27T15:09:21Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:52094->127.0.0.1:10250: write: broken pipe" machine # [ 575.751524] k3s[896]: E0927 15:09:21.406961 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51440: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 575.951108] k3s[896]: E0927 15:09:21.606618 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51468: use of closed network connection machine # command terminated with exit code 1 machine # [ 577.238762] k3s[896]: E0927 15:09:22.893737 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51496: use of closed network connection machine # [ 577.240708] k3s[896]: E0927 15:09:22.893743 896 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:59674->127.0.0.1:10010: write tcp 127.0.0.1:59674->127.0.0.1:10010: write: broken pipe machine # command terminated with exit code 1 machine # [ 577.438804] k3s[896]: E0927 15:09:23.094594 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51518: use of closed network connection machine # command terminated with exit code 1 machine # [ 578.737821] k3s[896]: E0927 15:09:24.389613 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51548: use of closed network connection machine # [ 578.937576] k3s[896]: E0927 15:09:24.593623 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51570: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 580.238546] k3s[896]: E0927 15:09:25.894145 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51584: use of closed network connection machine # [ 580.431351] k3s[896]: E0927 15:09:26.087227 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51614: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 581.755796] k3s[896]: E0927 15:09:27.411449 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51636: use of closed network connection machine # [ 581.955365] k3s[896]: E0927 15:09:27.611437 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51656: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 583.269748] k3s[896]: E0927 15:09:28.925424 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57642: use of closed network connection machine # [ 583.461473] k3s[896]: E0927 15:09:29.117502 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57684: use of closed network connection machine # command terminated with exit code 1 machine # [ 584.736031] k3s[896]: E0927 15:09:30.391704 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57720: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 584.937680] k3s[896]: E0927 15:09:30.592838 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57746: use of closed network connection machine # [ 586.184991] k3s[896]: E0927 15:09:31.840730 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57756: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 586.366164] k3s[896]: E0927 15:09:32.021976 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57778: use of closed network connection machine # [ 587.665828] k3s[896]: E0927 15:09:33.321444 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57802: use of closed network connection machine # command terminated with exit code 1 machine # [ 587.876033] k3s[896]: E0927 15:09:33.532048 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57826: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 589.180382] k3s[896]: E0927 15:09:34.836150 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57844: use of closed network connection machine # [ 589.383307] k3s[896]: E0927 15:09:35.039371 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57878: use of closed network connection machine # command terminated with exit code 1 machine # [ 590.681237] k3s[896]: E0927 15:09:36.336602 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57902: use of closed network connection machine # command terminated with exit code 1 machine # [ 590.863575] k3s[896]: E0927 15:09:36.519635 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57930: use of closed network connection machine # command terminated with exit code 1 machine # [ 592.106443] k3s[896]: E0927 15:09:37.761985 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57960: use of closed network connection machine # [ 592.282842] k3s[896]: E0927 15:09:37.938916 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57978: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-795755579b-dmld2 --wait=false, in 0.15 seconds) machine: must succeed: sleep 5.0 machine # [ 592.468752] systemd[1]: cri-containerd-d490448c2c4a26c0ea335b314b3dbd1d81392efbe077da7727d1c135705565ee.scope: Deactivated successfully. machine # [ 592.470847] systemd[1]: cri-containerd-d490448c2c4a26c0ea335b314b3dbd1d81392efbe077da7727d1c135705565ee.scope: Consumed 628ms CPU time over 8min 57.560s wall clock time, 14.5M memory peak, 6.6M read from disk. machine # [ 592.501976] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d490448c2c4a26c0ea335b314b3dbd1d81392efbe077da7727d1c135705565ee-rootfs.mount: Deactivated successfully. machine # [ 592.750104] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod7c5615cb_8967_45ab_a68b_78984dc78623.slice. machine # [ 592.770324] k3s[896]: I0927 15:09:38.426390 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7c5615cb-8967-45ab-a68b-78984dc78623-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57\" (UID: \"7c5615cb-8967-45ab-a68b-78984dc78623\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" machine # [ 592.774911] k3s[896]: I0927 15:09:38.426455 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsvgc\" (UniqueName: \"kubernetes.io/projected/7c5615cb-8967-45ab-a68b-78984dc78623-kube-api-access-fsvgc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57\" (UID: \"7c5615cb-8967-45ab-a68b-78984dc78623\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" machine # [ 592.780145] k3s[896]: I0927 15:09:38.426483 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/7c5615cb-8967-45ab-a68b-78984dc78623-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57\" (UID: \"7c5615cb-8967-45ab-a68b-78984dc78623\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" machine # [ 592.785165] k3s[896]: I0927 15:09:38.426507 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/7c5615cb-8967-45ab-a68b-78984dc78623-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57\" (UID: \"7c5615cb-8967-45ab-a68b-78984dc78623\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" machine # [ 592.789854] k3s[896]: I0927 15:09:38.426535 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/7c5615cb-8967-45ab-a68b-78984dc78623-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57\" (UID: \"7c5615cb-8967-45ab-a68b-78984dc78623\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" machine # [ 592.794620] k3s[896]: I0927 15:09:38.426560 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/7c5615cb-8967-45ab-a68b-78984dc78623-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57\" (UID: \"7c5615cb-8967-45ab-a68b-78984dc78623\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" machine # [ 592.799169] k3s[896]: I0927 15:09:38.426584 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/7c5615cb-8967-45ab-a68b-78984dc78623-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57\" (UID: \"7c5615cb-8967-45ab-a68b-78984dc78623\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" machine # [ 592.803712] k3s[896]: I0927 15:09:38.426613 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/7c5615cb-8967-45ab-a68b-78984dc78623-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57\" (UID: \"7c5615cb-8967-45ab-a68b-78984dc78623\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" machine # [ 592.808179] k3s[896]: I0927 15:09:38.426640 896 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/7c5615cb-8967-45ab-a68b-78984dc78623-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57\" (UID: \"7c5615cb-8967-45ab-a68b-78984dc78623\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" machine # [ 593.284521] cni0: port 5(veth19314695) entered blocking state machine # [ 593.290982] cni0: port 5(veth19314695) entered disabled state machine # [ 593.292762] veth19314695: entered allmulticast mode machine # [ 593.295346] veth19314695: entered promiscuous mode machine # [ 593.314576] cni0: port 5(veth19314695) entered blocking state machine # [ 593.316608] cni0: port 5(veth19314695) entered forwarding state machine # [ 593.197918] (udev-worker)[12229]: Network interface NamePolicy= disabled on kernel command line. machine # [ 593.221928] dhcpcd[682]: veth19314695: IAID a0:84:73:37 machine # [ 593.223687] dhcpcd[682]: veth19314695: adding address fe80::6c9e:a0ff:fe84:7337 machine # [ 593.266457] systemd[1]: Started libcontainer container 7db8d8878d3f9ace2cc1326e774a28c79e0ed2770dc3a0e6a500f379cc476cf5. machine # [ 593.521865] systemd[1]: tmp-ovl\x2didmapped1580055280.mount: Deactivated successfully. machine # [ 593.555759] systemd[1]: Started libcontainer container cd7a6813565044b4b0948503799a5c6ccb68b536d9628bc30a5c26783295268b. machine # [ 594.095455] dhcpcd[682]: veth19314695: soliciting a DHCP lease machine # [ 594.960537] systemd[1]: cri-containerd-cd7a6813565044b4b0948503799a5c6ccb68b536d9628bc30a5c26783295268b.scope: Deactivated successfully. machine # [ 594.966561] systemd[1]: cri-containerd-cd7a6813565044b4b0948503799a5c6ccb68b536d9628bc30a5c26783295268b.scope: Consumed 728ms CPU time over 1.403s wall clock time, 469.3M memory peak, 173.4M read from disk, 136M written to disk. machine # [ 595.024928] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-cd7a6813565044b4b0948503799a5c6ccb68b536d9628bc30a5c26783295268b-rootfs.mount: Deactivated successfully. machine # [ 595.468459] dhcpcd[682]: veth19314695: soliciting an IPv6 router machine # [ 595.722195] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2065026867.mount: Deactivated successfully. machine # [ 595.725571] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount330249359.mount: Deactivated successfully. machine # [ 595.800271] systemd[1]: Started libcontainer container 77f26222718d70dc6f288ecaadd1c481070bd673383d4659b84eec0677eba91a. machine # [ 595.938361] systemd[1]: Started libcontainer container d6db2adbc5e4bbfbcf09efefea23b2ed5c9b53bdd0fde66c7a4910ecb8235621. machine # [ 596.040434] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount141458244.mount: Deactivated successfully. machine # [ 596.041178] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1105221991.mount: Deactivated successfully. machine # [ 596.097277] systemd[1]: Started libcontainer container 5a51c1d3a734b71b3b1551aa9e24136988b1dd95a1959b245fadc9939aa6b36e. machine # [ 597.029991] systemd[1]: tmp-ovl\x2didmapped914918244.mount: Deactivated successfully. machine: (finished: must succeed: sleep 5.0, in 5.02 seconds) machine # [ 597.699157] k3s[896]: E0927 15:09:43.354713 896 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:54304: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 598.090939] k3s[896]: I0927 15:09:43.746152 896 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-2vw57" podStartSLOduration=4.387581176 podStartE2EDuration="5.746112497s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.358531321s" isStatefulPod=false podCreationTimestamp="2026-09-27 15:09:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 15:09:42.339312191 +0000 UTC m=+578.914770946" watchObservedRunningTime="2026-09-27 15:09:43.746112497 +0000 UTC m=+580.321570972" machine # [ 599.098195] dhcpcd[682]: veth19314695: probing for an IPv4LL address machine # [ 603.941162] dhcpcd[682]: veth19314695: using IPv4LL address 169.254.204.16 machine # [ 603.943748] dhcpcd[682]: veth19314695: adding route to 169.254.0.0/16 machine # [ 607.471924] dhcpcd[682]: veth19314695: no IPv6 Routers available machine # [ 610.287644] postgres[756]: [756] LOG: checkpoint starting: time machine # [ 611.744880] niks3-server[1193]: 2026/09/27 15:09:57 INFO Received push request method=POST path=/api/pushes machine # [ 611.759645] niks3-server[1193]: 2026/09/27 15:09:57 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 611.764697] niks3-server[1193]: 2026/09/27 15:09:57 INFO Signed narinfos id=30 count=1 machine # [ 611.768387] niks3-server[1193]: 2026/09/27 15:09:57 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 611.770821] niks3-server[1193]: 2026/09/27 15:09:57 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 611.779137] niks3-server[1193]: 2026/09/27 15:09:57 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 611.785120] niks3-server[1193]: 2026/09/27 15:09:57 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 612.858446] systemd[1]: slow.service: Deactivated successfully. machine # [ 612.861339] systemd[1]: slow.service: Consumed 167ms CPU time over 46.059s wall clock time, 38.3M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.5K outgoing IP traffic. machine # [ 613.140923] systemd[1]: cri-containerd-8c5bd6cb655bae8359d42c5ea9d2e49466b3aef8b8e3a1552e29f99391b4331f.scope: Deactivated successfully. machine # [ 613.146233] systemd[1]: cri-containerd-8c5bd6cb655bae8359d42c5ea9d2e49466b3aef8b8e3a1552e29f99391b4331f.scope: Consumed 3.290s CPU time over 9min 18.503s wall clock time, 104M memory peak, 60.6M read from disk, 8K written to disk, 283.3K incoming IP traffic, 362K outgoing IP traffic. machine # [ 613.219152] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8c5bd6cb655bae8359d42c5ea9d2e49466b3aef8b8e3a1552e29f99391b4331f-rootfs.mount: Deactivated successfully. machine # [ 613.244481] postgres[756]: [756] LOG: checkpoint complete: wrote 29 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.914 s, sync=0.023 s, total=2.957 s; sync files=23, longest=0.005 s, average=0.001 s; distance=243 kB, estimate=4505 kB; lsn=0/1C8AF10, redo lsn=0/1C7F8F0 machine: (finished: waiting for success: ! systemctl is-active slow, in 15.62 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.13 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.78 seconds) (finished: run the VM test script, in 614.53 seconds) test script finished in 614.56s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-27T15:09:59Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-27T15:09:59Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-27T15:09:59Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.05 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh