tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.zz3AXCKsUT', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: e2b29169-1150-433a-9bfc-49beebde8837 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:08.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c72w1h0ri0iwgrrl7nb79bxcwvzgmnfv-nixos-system-machine-test/init regInfo=/nix/store/i1jr67zin52r2xl1p36n9w8nvvfhk6qf-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000001] kvm-clock: using sched offset of 503015007 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000804] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000878] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002731] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002741] Using GB pages for direct mapping machine # [ 0.002830] RAMDISK: [mem 0x7e367000-0x7ffcffff] machine # [ 0.002843] ACPI: Early table checksum verification disabled machine # [ 0.002846] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002850] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002854] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002861] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002863] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002864] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002866] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002867] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002869] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002870] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002872] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002872] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002873] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002873] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002874] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002874] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003110] No NUMA configuration found machine # [ 0.003111] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003113] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005819] Zone ranges: machine # [ 0.005820] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005821] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005823] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005824] Device empty machine # [ 0.005825] Movable zone start for each node machine # [ 0.005825] Early memory node ranges machine # [ 0.005826] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005827] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005827] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005828] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005854] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.006128] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.080952] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.081430] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.081445] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.081480] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.081483] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.081485] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.081487] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.081488] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.081488] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.081491] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.081492] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.081497] TSC deadline timer available machine # [ 0.081502] CPU topo: Max. logical packages: 1 machine # [ 0.081503] CPU topo: Max. logical dies: 1 machine # [ 0.081503] CPU topo: Max. dies per package: 1 machine # [ 0.081506] CPU topo: Max. threads per core: 1 machine # [ 0.081507] CPU topo: Num. cores per package: 4 machine # [ 0.081508] CPU topo: Num. threads per package: 4 machine # [ 0.081508] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.081534] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.081551] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.081554] kvm-guest: setup PV sched yield machine # [ 0.081564] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.081565] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.081566] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.081568] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.081570] Booting paravirtualized kernel on KVM machine # [ 0.081574] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.086040] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.088304] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.088356] kvm-guest: PV spinlocks enabled machine # [ 0.088357] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.088360] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c72w1h0ri0iwgrrl7nb79bxcwvzgmnfv-nixos-system-machine-test/init regInfo=/nix/store/i1jr67zin52r2xl1p36n9w8nvvfhk6qf-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.088459] Unknown kernel command line parameters "regInfo=/nix/store/i1jr67zin52r2xl1p36n9w8nvvfhk6qf-closure-info/registration", will be passed to user space. machine # [ 0.088472] random: crng init done machine # [ 0.088473] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.092952] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.095451] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.095524] software IO TLB: area num 4. machine # [ 0.172973] Fallback order for Node 0: 0 machine # [ 0.172982] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.172984] Policy zone: Normal machine # [ 0.175623] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.183004] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.192471] allocated 8388608 bytes of page_ext machine # [ 0.202563] ftrace: allocating 48731 entries in 192 pages machine # [ 0.202566] ftrace: allocated 192 pages with 2 groups machine # [ 0.203460] Dynamic Preempt: lazy machine # [ 0.203942] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.203943] rcu: RCU event tracing is enabled. machine # [ 0.203943] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.203945] Trampoline variant of Tasks RCU enabled. machine # [ 0.203945] Rude variant of Tasks RCU enabled. machine # [ 0.203946] Tracing variant of Tasks RCU enabled. machine # [ 0.203946] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.203947] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.203973] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.203976] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.203977] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.208420] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.208748] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.208758] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.208877] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.212457] Console: colour VGA+ 80x25 machine # [ 0.212460] printk: legacy console [tty0] enabled machine # [ 0.244204] printk: legacy console [ttyS0] enabled machine # [ 0.356341] ACPI: Core revision 20250807 machine # [ 0.357266] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.358863] APIC: Switch to symmetric I/O mode setup machine # [ 0.359944] x2apic enabled machine # [ 0.360699] APIC: Switched APIC routing to: physical x2apic machine # [ 0.361638] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.362918] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.364417] kvm-guest: setup PV IPIs machine # [ 0.366060] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.367120] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.371440] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.372526] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.373576] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.374438] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.375441] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.376437] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.377437] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.379232] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.380188] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.381254] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.382445] Spectre V2 : Enabling IBPB for BPF machine # [ 0.383438] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.384438] active return thunk: srso_alias_return_thunk machine # [ 0.385458] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.387437] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.388437] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.389437] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.390437] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.391437] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.392437] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.393438] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.395233] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.396236] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.397247] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.398437] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.399437] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.429159] Freeing SMP alternatives memory: 44K machine # [ 0.429441] pid_max: default: 32768 minimum: 301 machine # [ 0.430550] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.431543] landlock: Up and running. machine # [ 0.432438] Yama: becoming mindful. machine # [ 0.433643] LSM support for eBPF active machine # [ 0.434575] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.435518] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.438569] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.440033] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.440446] ... version: 2 machine # [ 0.441222] ... bit width: 48 machine # [ 0.441440] ... generic counters: 6 machine # [ 0.442174] ... generic bitmap: 000000000000003f machine # [ 0.442439] ... fixed-purpose counters: 0 machine # [ 0.443229] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.444204] ... value mask: 0000ffffffffffff machine # [ 0.444440] ... max period: 00007fffffffffff machine # [ 0.445421] ... global_ctrl mask: 000000000000003f machine # [ 0.446329] signal: max sigframe size: 3376 machine # [ 0.447100] rcu: Hierarchical SRCU implementation. machine # [ 0.447443] rcu: Max phase no-delay instances is 400. machine # [ 0.448543] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.454068] smp: Bringing up secondary CPUs ... machine # [ 0.454857] smpboot: x86: Booting SMP configuration: machine # [ 0.455442] .... node #0, CPUs: #1 #2 #3 machine # [ 0.458542] smp: Brought up 1 node, 4 CPUs machine # [ 0.460194] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.460949] Memory: 3957568K/4193752K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 220888K reserved, 0K cma-reserved) machine # [ 0.462440] devtmpfs: initialized machine # [ 0.463572] x86/mm: Memory block size: 128MB machine # [ 0.466614] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.468520] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.469536] pinctrl core: initialized pinctrl subsystem machine # [ 0.470779] PM: RTC time: 16:47:48, date: 2026-09-21 machine # [ 0.474426] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.476108] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.476479] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.478032] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.478451] audit: initializing netlink subsys (disabled) machine # [ 0.479460] audit: type=2000 audit(1790009269.557:1): state=initialized audit_enabled=0 res=1 machine # [ 0.479683] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.481441] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.482440] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.483439] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.484439] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.485452] cpuidle: using governor menu machine # [ 0.487659] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.488748] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.489443] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.490453] PCI: Using configuration type 1 for base access machine # [ 0.491551] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.494486] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.495441] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.496440] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.497439] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.502283] ACPI: Added _OSI(Module Device) machine # [ 0.504449] ACPI: Added _OSI(Processor Device) machine # [ 0.506446] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.515180] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.521707] ACPI: Interpreter enabled machine # [ 0.522459] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.523205] ACPI: Using IOAPIC for interrupt routing machine # [ 0.523542] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.524441] PCI: Using E820 reservations for host bridge windows machine # [ 0.525590] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.536747] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.539458] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.542701] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.546828] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.550626] PCI host bridge to bus 0000:00 machine # [ 0.552458] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.555446] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.557445] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.560445] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.563444] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.566444] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.568444] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.570673] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.574455] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.589526] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.591452] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.592461] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.593612] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.598067] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.609608] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.612461] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.614500] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.617460] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.621951] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.631465] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.633461] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.636528] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.640819] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.648673] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.651457] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.653487] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.656884] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.665474] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] machine # [ 0.667441] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.668462] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.670415] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.675474] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] machine # [ 0.676402] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.677207] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.679030] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.685028] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.686168] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.687463] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.690560] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.708475] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] machine # [ 0.709423] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.710275] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.711439] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.713036] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.716441] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.718462] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.720032] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.723480] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] machine # [ 0.724407] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.725276] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.728689] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.734467] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] machine # [ 0.736457] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.739488] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.742670] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.747498] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] machine # [ 0.749868] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.753512] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] machine # [ 0.755918] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.760198] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] machine # [ 0.762898] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.766469] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.768935] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.773003] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.775921] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.779494] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] machine # [ 0.780447] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.781801] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.784160] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.788700] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.789548] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.790553] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.791554] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.792549] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.794541] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.795955] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.798704] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.801536] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.803486] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.806476] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.808485] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.811476] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.813478] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.816483] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.818482] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.824794] iommu: Default domain type: Translated machine # [ 0.826446] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.829973] ACPI: bus type USB registered machine # [ 0.830575] usbcore: registered new interface driver usbfs machine # [ 0.832478] usbcore: registered new interface driver hub machine # [ 0.834508] usbcore: registered new device driver usb machine # [ 0.839604] NetLabel: Initializing machine # [ 0.841446] NetLabel: domain hash size = 128 machine # [ 0.842444] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.845646] NetLabel: unlabeled traffic allowed by default machine # [ 0.847473] PCI: Using ACPI for IRQ routing machine # [ 0.912630] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.913436] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.913436] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.915446] vgaarb: loaded machine # [ 0.916324] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.918102] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.923554] clocksource: Switched to clocksource kvm-clock machine # [ 0.925435] VFS: Disk quotas dquot_6.6.0 machine # [ 0.926226] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.927779] pnp: PnP ACPI init machine # [ 0.928721] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.929761] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.931509] pnp: PnP ACPI: found 6 devices machine # [ 0.941059] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.942789] clocksource: Switched to clocksource acpi_pm machine # [ 0.943889] NET: Registered PF_INET protocol family machine # [ 0.945549] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.963378] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.964944] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.966370] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.967876] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.969226] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.970603] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.972125] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.973431] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.974822] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.975827] NET: Registered PF_XDP protocol family machine # [ 0.976699] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.977779] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.978824] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.979982] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.981145] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.982314] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.984274] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.986487] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.988582] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.990628] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.992412] PCI: CLS 0 bytes, default 64 machine # [ 0.993289] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.993983] Trying to unpack rootfs image as initramfs... machine # [ 0.994411] software IO TLB: mapped [mem 0x000000007a367000-0x000000007e367000] (64MB) machine # [ 0.997229] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 1.018070] Initialise system trusted keyrings machine # [ 1.019310] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.030864] Key type asymmetric registered machine # [ 1.031601] Asymmetric key parser 'x509' registered machine # [ 1.032558] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.034278] io scheduler mq-deadline registered machine # [ 1.035123] io scheduler kyber registered machine # [ 1.040338] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.041726] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.044191] Linux agpgart interface v0.103 machine # [ 1.045019] ACPI: bus type drm_connector registered machine # [ 1.047362] usbcore: registered new interface driver usbserial_generic machine # [ 1.048497] usbserial: USB Serial support registered for generic machine # [ 1.049515] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.049515] Please enable it if your BIOS has the CPPC option. machine # [ 1.051869] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.053330] drop_monitor: Initializing network drop monitor service machine # [ 1.054610] NET: Registered PF_INET6 protocol family machine # [ 1.056429] Segment Routing with IPv6 machine # [ 1.057194] In-situ OAM (IOAM) with IPv6 machine # [ 1.059197] IPI shorthand broadcast: enabled machine # [ 1.063658] sched_clock: Marking stable (909010708, 153678487)->(1086868686, -24179491) machine # [ 1.065522] registered taskstats version 1 machine # [ 1.066590] Loading compiled-in X.509 certificates machine # [ 1.076572] Demotion targets for Node 0: null machine # [ 1.077615] Key type .fscrypt registered machine # [ 1.078334] Key type fscrypt-provisioning registered machine # [ 1.079359] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.080331] ima: Allocated hash algorithm: sha1 machine # [ 1.081206] ima: No architecture policies found machine # [ 1.082311] PM: Magic number: 10:530:793 machine # [ 1.084024] RAS: Correctable Errors collector initialized. machine # [ 1.088520] clk: Disabling unused clocks machine # [ 1.089248] PM: genpd: Disabling unused power domains machine # [ 1.282157] Freeing initrd memory: 29092K machine # [ 1.289615] Freeing unused decrypted memory: 2028K machine # [ 1.296103] Freeing unused kernel image (initmem) memory: 3644K machine # [ 1.298825] Write protecting the kernel read-only data: 32768k machine # [ 1.303754] Freeing unused kernel image (text/rodata gap) memory: 1208K machine # [ 1.307759] Freeing unused kernel image (rodata/data gap) memory: 752K machine # [ 1.375056] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.376220] Run /init as init process machine # [ 1.387989] systemd[1]: Inserted module 'autofs4' machine # [ 1.412383] fuse: init (API version 7.45) machine # [ 1.419553] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.422360] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.425725] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.428108] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.471598] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.808286] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.820768] systemd[1]: Detected virtualization kvm. machine # [ 1.822954] systemd[1]: Detected architecture x86-64. machine # [ 1.825155] systemd[1]: Running in initrd. machine # [ 1.827615] systemd[1]: Initializing machine ID from random generator. machine # [ 1.830608] systemd[1]: Hostname set to . machine # [ 1.951086] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.011816] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.022274] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.023523] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.025916] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.028052] systemd[1]: Reached target Path Units. machine # [ 2.029777] systemd[1]: Reached target Slice Units. machine # [ 2.031459] systemd[1]: Reached target Swaps. machine # [ 2.033050] systemd[1]: Reached target Timer Units. machine # [ 2.034978] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.037302] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.039533] systemd[1]: Listening on Journal Sockets. machine # [ 2.041327] systemd[1]: Listening on udev Control Socket. machine # [ 2.042389] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.043416] systemd[1]: Reached target Socket Units. machine # [ 2.045557] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.047729] systemd[1]: Starting Load Kernel Module 9pnet_virtio... machine # [ 2.049720] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.052962] systemd[1]: Starting Journal Service... machine # [ 2.062763] systemd[1]: Starting Load Kernel Modules... machine # [ 2.063792] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.071379] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.079461] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.085146] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.093135] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.093384] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.094705] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.095240] systemd-journald[91]: Collecting audit messages is disabled. machine # [ 2.100513] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.112845] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.119591] netfs: FS-Cache loaded machine # [ 2.121986] systemd[1]: Finished Load Kernel Modules. machine # [ 2.126791] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.129992] 9pnet: Installing 9P2000 support machine # [ 2.135787] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.137891] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. machine # [ 2.139597] systemd[1]: Finished Load Kernel Module 9pnet_virtio. machine # [ 2.141382] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.143567] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.990732] systemd-modules-l[ 2.144869] systemd[1]: Started Journal Service. machine # oad[93]: Using 4 probe threads machine # [ 1.992916] systemd-modules-load[93]: Inserted module 'virtio_balloon' machine # [ 1.994056] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 1.995044] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 2.005538] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.006659] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.007788] systemd[1]: Reached target Local File Systems. machine # [ 2.008577] systemd[1]: Starting Create System Files and Directories... machine # [ 2.009562] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.019574] systemd[1]: Finished Create System Files and Directories. machine # [ 2.031876] systemd-udevd[113]: Using default interface naming scheme 'v261'. machine # [ 2.043299] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.059406] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.060274] systemd[1]: Reached target System Initialization. machine # [ 2.061111] systemd[1]: Reached target Basic System. machine # [ 2.317188] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.318711] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.320035] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.322456] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 machine # [ 2.323973] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.325562] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.327038] usb usb1: Product: UHCI Host Controller machine # [ 2.328329] usb usb1: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.329193] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.330927] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.332927] hub 1-0:1.0: USB hub found machine # [ 2.333564] virtio_blk virtio5: 4/0/0 default/read/poll queues machine # [ 2.334022] hub 1-0:1.0: 2 ports detected machine # [ 2.334780] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.336413] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.337278] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.337285] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.339323] virtio_blk virtio5: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.340138] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.349834] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.351121] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.353034] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.354694] usb usb2: Product: EHCI Host Controller machine # [ 2.355432] usb usb2: Manufacturer: Linux 6.18.50 ehci_hcd machine # [ 2.356347] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.362408] hub 2-0:1.0: USB hub found machine # [ 2.363626] hub 2-0:1.0: 6 ports detected machine # [ 2.210421] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.212575] (udev-worker)[117]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.215058] (udev-worker)[117]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.216960] systemd[1]: Starting Virtual Console Setup... machine # [ 2.385886] hub 1-0:1.0: USB hub found machine # [ 2.386498] hub 1-0:1.0: 2 ports detected machine # [ 2.387358] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.388189] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.389305] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.389422] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 machine # [ 2.389786] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.389789] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.389791] usb usb3: Product: UHCI Host Controller machine # [ 2.389792] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.389793] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.390002] hub 3-0:1.0: USB hub found machine # [ 2.390011] hub 3-0:1.0: 2 ports detected machine # [ 2.391624] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.391634] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.391655] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.391781] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 machine # [ 2.394307] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.396905] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.407631] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.254818] systemd[1]: Found device /dev/disk/by-label/nixos.[ 2.407634] usb usb4: Product: UHCI Host Controller machine # machine # [ 2.407640] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.257333] systemd[1]: Reached target Initrd Root Device.[ 2.407641] usb usb4: SerialNumber: 0000:00:1d.2 machine # machine # [ 2.408000] hub 4-0:1.0: USB hub found machine # [ 2.259522] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...[ 2.413261] hub 4-0:1.0: 2 ports detected machine # machine # [ 2.418818] SCSI subsystem initialized machine # [ 2.269333] systemd-vconsole-setup[146]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.272046] systemd[1]: Finished Virtual Console Setup. machine # [ 2.281145] systemd-fsck[151]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.284914] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.449852] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.451100] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.452249] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.455640] scsi host0: ahci machine # [ 2.456552] scsi host1: ahci machine # [ 2.457719] scsi host2: ahci machine # [ 2.458454] scsi host3: ahci machine # [ 2.459759] scsi host4: ahci machine # [ 2.460473] scsi host5: ahci machine # [ 2.461094] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 machine # [ 2.462300] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 machine # [ 2.463591] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 machine # [ 2.464840] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 machine # [ 2.466026] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 machine # [ 2.467315] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 machine # [ 2.602872] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.732896] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.735919] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.738567] usb 2-1: Product: QEMU USB Tablet machine # [ 2.740242] usb 2-1: Manufacturer: QEMU machine # [ 2.741759] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.773130] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.785520] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.787937] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.790155] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.792414] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.794746] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.797252] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.799412] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.801464] ata3.00: applying bridge limits machine # [ 2.803334] ata3.00: configured for UDMA/100 machine # [ 2.805809] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.842866] usbcore: registered new interface driver usbhid machine # [ 2.844901] usbhid: USB HID core driver machine # [ 2.854528] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.858659] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.882220] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.912107] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.927247] systemd[1]: Mounting /sysroot... machine # [ 3.233286] EXT4-fs (vda): mounted filesystem e2b29169-1150-433a-9bfc-49beebde8837 r/w with ordered data mode. Quota mode: none. machine # [ 3.113455] systemd[1]: Mounted /sysroot. machine # [ 3.114539] systemd[1]: Reached target Initrd Root File System. machine # [ 3.118274] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.120115] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.130332] systemd[1]: Mounting /sysroot/run... machine # [ 3.134157] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.290659] 9p: Installing v9fs 9p2000 file system support machine # [ 3.140330] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.142137] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.145086] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.146306] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.147560] systemd[1]: Mounted /sysroot/run. machine # [ 3.152274] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.154259] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.156948] systemd-sysroot-fstab-check[193]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.159133] systemd[1]: Reload requested from client PID 193 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.161315] systemd[1]: Reloading... machine # [ 3.217417] systemd[1]: Reloading finished in 59 ms. machine # [ 3.242777] systemd-sysroot-fstab-check[193]: Requesting initrd-fs.target/start/replace... machine # [ 3.244509] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.245679] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.247208] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.248433] systemd-sysroot-fstab-check[193]: Requesting swap.target/start/replace... machine # [ 3.249957] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.251293] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.252695] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.254095] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.274363] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.275526] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.928459] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.961258] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.962085] systemd[1]: Reached target Initrd File Systems. machine # [ 3.963379] systemd[1]: Starting Find NixOS closure... machine # [ 3.964338] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.986901] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.988450] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 4.009842] systemd[1]: Finished Find NixOS closure. machine # [ 4.010734] systemd[1]: Reached target Initrd Default Target. machine # [ 4.011554] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.047309] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.049434] systemd[1]: Stopped target Basic System. machine # [ 4.051305] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.053245] systemd[1]: Stopped target Path Units. machine # [ 4.054989] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.058631] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.062280] systemd[1]: Stopped target Slice Units. machine # [ 4.065266] systemd[1]: Stopped target Socket Units. machine # [ 4.067286] systemd[1]: Stopped target System Initialization. machine # [ 4.070293] systemd[1]: Stopped target Swaps. machine # [ 4.072352] systemd[1]: Stopped target Timer Units. machine # [ 4.074294] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.076418] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.078164] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.080228] systemd[1]: Stopped Find NixOS closure. machine # [ 4.081614] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 4.084531] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.086329] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.088163] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.089630] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.091549] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.093039] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.094808] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.095852] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.096824] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.097703] systemd[1]: Stopped target Local File Systems. machine # [ 4.098530] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.099529] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.100595] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.101445] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.102463] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.103537] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.104360] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.105471] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.106418] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.107418] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.108269] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.109206] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.110173] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.111129] systemd[1]: Closed udev Control Socket. machine # [ 4.111830] systemd[1]: Starting Cleanup udev Database... machine # [ 4.112615] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.114098] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.114958] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.116109] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.117065] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.117985] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.126668] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.127779] systemd[1]: Finished Cleanup udev Database. machine # [ 4.129136] systemd[1]: Reached target Switch Root. machine # [ 4.131285] systemd[1]: Starting NixOS Activation... machine # [ 4.345328] initrd-nixos-activation-start[242]: booting system configuration /nix/store/c72w1h0ri0iwgrrl7nb79bxcwvzgmnfv-nixos-system-machine-test machine # [ 4.421984] initrd-nixos-activation-start[242]: running activation script... machine # [ 4.906897] initrd-nixos-activation-start[265]: setting up /etc... machine # [ 5.203938] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 5.205151] systemd[1]: Finished NixOS Activation. machine # [ 5.205804] systemd[1]: Starting Switch Root... machine # [ 5.236942] systemd[1]: Switching root. machine # [ 5.450530] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). machine # [ 5.623724] NET: Registered PF_VSOCK protocol family machine # [ 6.025483] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 6.035510] systemd[1]: Detected virtualization kvm. machine # [ 6.037371] systemd[1]: Detected architecture x86-64. machine # [ 6.039362] systemd[1]: Detected first boot. machine # [ 6.047280] systemd[1]: Initializing machine ID from random generator. machine # [ 6.237163] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 6.368027] systemd[1]: Applying preset policy. machine # [ 6.821612] systemd[1]: Populated /etc with preset unit settings. machine # [ 7.328608] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 7.332178] systemd[1]: Stopped initrd-switch-root.service. machine # [ 7.338252] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 7.343948] systemd[1]: Created slice Slice /system/getty. machine # [ 7.347578] systemd[1]: Created slice User and Session Slice. machine # [ 7.349960] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 7.353034] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 7.355860] systemd[1]: Expecting device /dev/hvc0... machine # [ 7.357735] systemd[1]: Expecting device /dev/ttyS0... machine # [ 7.359720] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 7.361989] systemd[1]: Stopped target initrd-fs.target. machine # [ 7.363987] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 7.366120] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 7.367934] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 7.369823] systemd[1]: Reached target Path Units. machine # [ 7.371314] systemd[1]: Reached target Remote File Systems. machine # [ 7.373109] systemd[1]: Reached target Slice Units. machine # [ 7.374606] systemd[1]: Reached target Swaps. machine # [ 7.380435] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 7.386592] systemd[1]: Listening on Process Core Dump Socket. machine # [ 7.389822] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 7.392918] systemd[1]: Listening on Factory Reset Management. machine # [ 7.393939] systemd[1]: Listening on Hostname Service Socket. machine # [ 7.398409] systemd[1]: Starting Journal Log Access Socket... machine # [ 7.400118] systemd[1]: Listening on Journal Audit Socket. machine # [ 7.403482] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 7.404932] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 7.407114] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.408493] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 7.419825] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 7.421016] systemd[1]: Listening on udev Control Socket. machine # [ 7.421993] systemd[1]: Listening on udev Varlink Socket. machine # [ 7.428066] systemd[1]: Mounting Huge Pages File System... machine # [ 7.431314] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 7.434920] systemd[1]: Mounting Kernel Debug File System... machine # [ 7.456432] systemd[1]: Mounting Kernel Trace File System... machine # [ 7.462914] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 7.465850] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 7.474294] systemd[1]: Starting Load Kernel Module configfs... machine # [ 7.477111] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 7.480987] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 7.485224] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 7.492146] systemd[1]: Mounting FUSE Control File System... machine # [ 7.494340] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 7.519726] systemd[1]: Starting Journal Service... machine # [ 7.524374] systemd[1]: Starting Load Kernel Modules... machine # [ 7.534924] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 7.541640] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 7.544192] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.548586] systemd[1]: Starting Coldplug All udev Devices... machine # [ 7.553701] systemd[1]: Listening on Journal Log Access Socket. machine # [ 7.556395] systemd[1]: Mounted Huge Pages File System. machine # [ 7.558583] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 7.561299] systemd[1]: Mounted Kernel Debug File System. machine # [ 7.562908] systemd[1]: Mounted Kernel Trace File System. machine # [ 7.565162] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 7.567749] systemd[1]: Mounted FUSE Control File System. machine # [ 7.572516] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 7.575454] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 7.576903] systemd[1]: Finished Load Kernel Module configfs. machine # [ 7.580402] systemd[1]: Mounting Kernel Configuration File System... machine # [ 7.581741] systemd-journald[335]: Collecting audit messages is enabled. machine # [ 7.593189] loop: module loaded machine # [ 7.594716] EXT4-fs (vda): re-mounted e2b29169-1150-433a-9bfc-49beebde8837. machine # [ 7.598365] systemd[1]: Finished Load Kernel Modules. machine # [ 7.600366] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 7.601705] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 7.449512] systemd[1]: Queue[ 7.602898] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # d start job for default target Multi-User System. machine # [ 7.607128] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 7.453668] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 7.456544] systemd-modules-load[336]: Using 2 probe threads machine # [ 7.458144] systemd-modules-load[336]: Inserted module 'loop' machine # [ 7.613597] systemd[1]: Starting Apply Kernel Variables... machine # [ 7.460684] systemd-oomd[338]: No swa[ 7.614740] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # p; memory pressure usage will be degraded machine # [ 7.617693] systemd[1]: Started Journal Service. machine # [ 7.466759] systemd[1]: Mounted Kernel Configuration File System. machine # [ 7.468389] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 7.475548] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 7.496444] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 7.497960] systemd[1]: Reached target First Boot Complete. machine # [ 7.660364] systemd-journald[335]: Received client request to flush runtime journal. machine # [ 7.556869] systemd[1]: Finished Apply Kernel Variables. machine # [ 7.558206] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 7.559751] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 7.561101] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 7.566481] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 7.567523] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 7.569254] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 7.602075] systemd[1]: Finished Coldplug All udev Devices. machine # [ 7.633864] systemd-udevd[366]: Using default interface naming scheme 'v261'. machine # [ 7.731305] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 7.820434] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 7.833727] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 7.861807] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 7.867099] (udev-worker)[371]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 7.870164] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. machine # [ 7.872205] (udev-worker)[370]: Network interface NamePolicy= disabled on kernel command line. machine # [ 8.057886] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 7.908577] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 7.910819] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 7.913207] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 7.915364] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 7.916960] systemd[1]: Early TPM SRK Setup skipped, unmet condition check Co[ 8.070865] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # nditionSecurity=measured-os machine # [ 7.919060] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 8.072387] ACPI: button: Power Button [PWRF] machine # [ 8.089214] Console: switching to colour dummy device 80x25 machine # [ 8.090570] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 8.090692] rtc_cmos 00:04: RTC can wake from S4 machine # [ 8.091680] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 8.096092] mousedev: PS/2 mouse device common for all mice machine # [ 8.098731] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 8.099780] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 8.100143] rtc_cmos 00:04: registered as rtc0 machine # [ 8.102330] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 8.103479] rtc_cmos 00:04: setting system clock to 2026-09-21T16:47:56 UTC (1790009276) machine # [ 8.106335] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 8.107765] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 8.116423] systemd-journald[335]: Time jumped backwards, rotating. machine # [ 8.116455] Console: switching to colour frame buffer device 160x50 machine # [ 8.119057] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 8.120924] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 machine # [ 8.121866] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 8.163384] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 8.164851] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 8.041719] systemd[1]: Starting Virtual Console Setup... machine # [ 8.211406] ppdev: user-space parallel port driver machine # [ 8.057838] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 8.215084] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 8.061571] systemd[1]: Stopped Virtual Console Setup. machine # [ 8.218531] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 8.068713] systemd[1]: Starting Virtual Console Setup... machine # [ 8.086494] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 8.093514] systemd[1]: Stopped Virtual Console Setup. machine # [ 8.098230] systemd[1]: Starting Virtual Console Setup... machine # [ 8.291977] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 8.294150] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 8.315359] kvm_amd: TSC scaling supported machine # [ 8.316006] kvm_amd: Nested Virtualization enabled machine # [ 8.316488] kvm_amd: Nested Paging enabled machine # [ 8.317006] kvm_amd: LBR virtualization supported machine # [ 8.317532] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 8.318149] kvm_amd: Virtual GIF supported machine # [ 8.318566] kvm_amd: Virtual NMI enabled machine # [ 8.178498] systemd[1]: Mounting /run/wrappers... machine # [ 8.361562] EDAC MC: Ver: 3.0.0 machine # [ 8.217762] systemd[1]: Mounted /run/wrappers. machine # [ 8.218717] systemd[1]: Reached target Local File Systems. machine # [ 8.222152] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 8.224536] systemd[1]: Starting register-nix-paths.service... machine # [ 8.226569] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 8.228096] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 8.230353] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 8.231968] systemd[1]: Starting Create System Files and Directories... machine # [ 8.270278] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 8.272101] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 8.296680] systemd[1]: Finished Create System Files and Directories. machine # [ 8.300105] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 8.303339] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 8.332946] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 8.357530] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 8.360069] systemd[1]: Starting Update is Completed... machine # [ 8.389831] systemd[1]: Finished Update is Completed. machine # [ 8.555932] systemd-vconsole-setup[408]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 8.559689] systemd[1]: Finished Virtual Console Setup. machine # [ 8.571929] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 8.573053] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 9.254195] systemd[1]: Finished register-nix-paths.service. machine # [ 9.256546] systemd[1]: Reached target System Initialization. machine # [ 9.258747] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 9.261332] systemd[1]: Started niks3 garbage collection timer. machine # [ 9.263625] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 9.266130] systemd[1]: Reached target Timer Units. machine # [ 9.268521] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 9.272137] systemd[1]: Listening on niks3 server socket. machine # [ 9.275254] systemd[1]: Listening on Nix Daemon Socket. machine # [ 9.277801] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 9.280804] systemd[1]: Reached target Socket Units. machine # [ 9.285200] systemd[1]: Reached target Basic System. machine # [ 9.289228] systemd[1]: Started backdoor.service. machine # [ 9.295928] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 9.305134] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 9.313319] systemd[1]: Starting Post-Boot Actions... machine # [ 9.322251] systemd[1]: Started Reset console on configuration changes. machine # [ 9.330668] systemd[1]: Starting resolvconf update... machine # [ 9.337398] systemd[1]: Started rustfs.service. machine # [ 9.343527] systemd[1]: Starting rustfs-bucket.service... machine # [ 9.352136] systemd[1]: Starting D-Bus System Message Bus... machine # [ 9.362634] systemd[1]: Finished Post-Boot Actions. machine # [ 9.365373] nsncd[492]: Sep 21 16:47:57.912 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 9.369671] systemd[1]: Finished Import lastlog data into lastlog2 database. machine # connecting to host... machine # [ 9.370474] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 9.372785] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 9.373988] systemd[1]: Reached target User and Group Name Lookups. machine # [ 9.383213] systemd[1]: Starting User Login Management... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 10.06 seconds) machine: (finished: waiting for the VM to finish booting, in 10.30 seconds) machine # [ 9.418721] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 9.433524] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync' machine # [ 9.434501] dbus-broker-launch[499]: Invalid user-name in /nix/store/sjdn8ydiry7lgasbr6jfz0ilm5vcd4dl-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 9.436057] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 9.436809] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 9.437778] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 9.438739] systemd[1]: Stopping User and Group Name Lookups... machine # [ 9.439370] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 9.446446] systemd[1]: nscd.service: Deactivated successfully. machine # [ 9.446945] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 9.449352] systemd-logind[525]: New seat seat0. machine # [ 9.451748] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 9.455453] systemd-logind[525]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 9.456297] systemd-logind[525]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 9.456712] systemd-logind[525]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 9.475463] systemd[1]: Started User Login Management. machine # [ 9.476664] systemd[1]: Started D-Bus System Message Bus. machine # [ 9.479184] systemd[1]: Starting linger-users.service... machine # [ 9.490425] dbus-broker-launch[499]: Ready machine # [ 9.492810] nsncd[578]: Sep 21 16:47:58.042 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 9.496077] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 9.497502] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 9.499262] systemd[1]: Reached target User and Group Name Lookups. machine # [ 9.510751] systemd[1]: Finished resolvconf update. machine # [ 9.511941] systemd[1]: Reached target Preparation for Network. machine # [ 9.514277] systemd[1]: Starting DHCP Client... machine # [ 9.517110] systemd[1]: Starting Address configuration of eth1... machine # [ 9.519261] systemd[1]: Starting Extra networking commands.... machine # [ 9.526275] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 9.531223] systemd[1]: Finished linger-users.service. machine # [ 9.596512] network-addresses-eth1-start[611]: adding address 192.168.1.1/24... done machine # [ 9.608314] network-addresses-eth1-start[611]: adding address 2001:db8:1::1/64... done machine # [ 9.622251] systemd[1]: Finished Address configuration of eth1. machine # [ 9.625108] dhcpcd[621]: dhcpcd-10.3.2 starting machine # [ 9.633182] dhcpcd[677]: dev: loaded udev machine # [ 9.637322] systemd[1]: Finished Extra networking commands.. machine # [ 9.638381] systemd[1]: Reached target Network. machine # [ 9.641095] systemd[1]: Starting PostgreSQL Server... machine # [ 9.643420] systemd[1]: Starting Permit User Sessions... machine # [ 9.808892] 8021q: 802.1Q VLAN Support v1.8 machine # [ 9.809482] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 9.675570] systemd[1]: Finished Permit User Sessions. machine # [ 9.676304] systemd[1]: Started Getty on tty1. machine # [ 9.676946] systemd[1]: Reached target Login Prompts. machine # [ 9.682488] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 9.916904] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 9.943175] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 9.944170] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 9.946815] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 9.948525] cfg80211: failed to load regulatory.db machine # [ 9.826474] postgresql-pre-start[698]: The files belonging to this database system will be owned by user "postgres". machine # [ 9.827163] postgresql-pre-start[698]: This user must also own the server process. machine # [ 9.835238] postgresql-pre-start[698]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 9.835904] postgresql-pre-start[698]: The default database encoding has accordingly been set to "UTF8". machine # [ 9.836368] postgresql-pre-start[698]: The default text search configuration will be set to "english". machine # [ 9.836804] postgresql-pre-start[698]: Data page checksums are enabled. machine # [ 9.837328] postgresql-pre-start[698]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 9.837687] postgresql-pre-start[698]: creating subdirectories ... ok machine # [ 9.838617] postgresql-pre-start[698]: selecting dynamic shared memory implementation ... posix machine # [ 10.012244] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 9.859955] dhcpcd[677]: eth0: waiting for carrier machine # [ 9.861077] dhcpcd[677]: eth0: carrier acquired machine # [ 9.870487] dhcpcd[677]: DUID 00:01:00:01:32:44:1c:3e:52:54:00:12:34:56 machine # [ 9.871252] dhcpcd[677]: eth0: IAID 00:12:34:56 machine # [ 9.871765] dhcpcd[677]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 9.931771] postgresql-pre-start[698]: selecting default "max_connections" ... 100 machine # [ 10.013903] postgresql-pre-start[698]: selecting default "shared_buffers" ... 128MB machine # [ 11.102264] dhcpcd[677]: eth0: soliciting a DHCP lease machine # [ 11.275046] NET: Registered PF_PACKET protocol family machine # [ 11.128029] dhcpcd[677]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 11.138349] dhcpcd[677]: eth0: probing address 10.0.2.15/24 machine # [ 11.863847] dhcpcd[677]: eth0: soliciting an IPv6 router machine # [ 11.864785] dhcpcd[677]: eth0: Router Advertisement from fe80::2 machine # [ 11.867169] dhcpcd[677]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 11.867820] dhcpcd[677]: eth0: adding route to fec0::/64 machine # [ 11.868984] dhcpcd[677]: eth0: adding default route via fe80::2 machine # [ 12.792407] postgresql-pre-start[698]: selecting default time zone ... UTC machine # [ 12.797709] postgresql-pre-start[698]: creating configuration files ... ok machine # [ 13.097072] postgresql-pre-start[698]: running bootstrap script ... ok machine # [ 13.852837] postgresql-pre-start[698]: performing post-bootstrap initialization ... ok machine # [ 14.013828] postgresql-pre-start[698]: syncing data to disk ... ok machine # [ 14.015407] postgresql-pre-start[698]: initdb: warning: enabling "trust" authentication for local connections machine # [ 14.016520] postgresql-pre-start[698]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 14.017969] postgresql-pre-start[698]: Success. You can now start the database server using: machine # [ 14.019502] postgresql-pre-start[698]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 14.236276] postgres[779]: [779] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 14.243713] postgres[779]: [779] LOG: listening on IPv6 address "::1", port 5432 machine # [ 14.244546] postgres[779]: [779] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 14.248820] postgres[779]: [779] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 14.263941] postgres[788]: [788] LOG: database system was shut down at 2026-09-21 16:48:02 GMT machine # [ 14.271484] postgres[779]: [779] LOG: database system is ready to accept connections machine # [ 14.277666] systemd[1]: Started PostgreSQL Server. machine # [ 14.282175] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 14.611643] postgresql-setup-start[799]: CREATE DATABASE machine # [ 14.674141] postgresql-setup-start[804]: CREATE ROLE machine # [ 14.711401] postgresql-setup-start[806]: ALTER DATABASE machine # [ 14.716381] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 14.718968] systemd[1]: Reached target PostgreSQL. machine # [ 15.770502] dhcpcd[677]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 15.772078] dhcpcd[677]: eth0: adding route to 10.0.2.0/24 machine # [ 15.773345] dhcpcd[677]: eth0: adding default route via 10.0.2.2 machine # [ 15.949220] systemd[1]: Started DHCP Client. machine # [ 15.951908] systemd[1]: Reached target Network is Online. machine # [ 15.957539] systemd[1]: Starting k3s service... machine # [ 16.140872] k3s[873]: time="2026-09-21T16:48:04Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 16.142586] k3s[873]: time="2026-09-21T16:48:04Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/76c98da5fd74d9a243cba8d533ae287fc547ab08ccd8c5ea4811608ce7075724" machine # [ 20.672791] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 20.683033] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 20.685091] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 20.686795] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 20.699979] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Database tables and indexes are up to date" machine # [ 20.701409] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 20.705416] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Startup VACUUM completed successfully" machine # [ 20.707422] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Kine available at unix://kine.sock" machine # [ 20.708660] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 20.710407] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 20.712176] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:09.260941961 +0000 UTC notAfter=2036-09-18 15:48:09.260941961 +0000 UTC" machine # [ 20.714614] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.717110] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.719704] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.722141] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.724421] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.726961] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.729437] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790009289: notBefore=2026-09-21 15:48:09.264173936 +0000 UTC notAfter=2036-09-18 15:48:09.264173936 +0000 UTC" machine # [ 20.731826] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.734119] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.736379] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.738737] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790009289: notBefore=2026-09-21 15:48:09.265781683 +0000 UTC notAfter=2036-09-18 15:48:09.265781683 +0000 UTC" machine # [ 20.741295] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.743699] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790009289: notBefore=2026-09-21 15:48:09.266475067 +0000 UTC notAfter=2036-09-18 15:48:09.266475067 +0000 UTC" machine # [ 20.746120] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.748331] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790009289: notBefore=2026-09-21 15:48:09.267149734 +0000 UTC notAfter=2036-09-18 15:48:09.267149734 +0000 UTC" machine # [ 20.750772] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.752996] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.761410] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790009289: notBefore=2026-09-21 15:48:09 +0000 UTC notAfter=2027-09-21 15:48:09 +0000 UTC" machine # [ 20.764440] k3s[873]: time="2026-09-21T16:48:09Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 20.767607] k3s[873]: time="2026-09-21T16:48:09Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__aaae_843d_37f2_b77e-a607c2:fec0::aaae:843d:37f2:b77e listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=78FD6E6AA1528C7DD5F98236D9E5ADB1097D019A]" machine # [ 21.727400] k3s[873]: time="2026-09-21T16:48:10Z" level=info msg="Password verified locally for node machine" machine # [ 21.729812] k3s[873]: time="2026-09-21T16:48:10Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790009289: notBefore=2026-09-21 15:48:10 +0000 UTC notAfter=2027-09-21 15:48:10 +0000 UTC" machine # [ 21.905285] rustfs-bucket-start[916]: mb s3://farm machine # [ 21.911728] systemd[1]: Finished rustfs-bucket.service. machine # [ 21.989364] k3s[873]: time="2026-09-21T16:48:10Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:10 +0000 UTC notAfter=2027-09-21 15:48:10 +0000 UTC" machine # [ 22.062682] k3s[873]: time="2026-09-21T16:48:10Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:10 +0000 UTC notAfter=2027-09-21 15:48:10 +0000 UTC" machine # [ 22.165171] k3s[873]: time="2026-09-21T16:48:10Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790009289: notBefore=2026-09-21 15:48:10 +0000 UTC notAfter=2027-09-21 15:48:10 +0000 UTC" machine # [ 22.268477] k3s[873]: time="2026-09-21T16:48:10Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:37146: runtime core not ready" machine # [ 22.351609] k3s[873]: time="2026-09-21T16:48:10Z" level=info msg="Module overlay was already loaded" machine # [ 22.612034] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 22.618034] Bridge firewalling registered machine # [ 22.486348] k3s[873]: time="2026-09-21T16:48:11Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 22.510560] k3s[873]: time="2026-09-21T16:48:11Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 22.529507] k3s[873]: time="2026-09-21T16:48:11Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 22.628770] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 22.630420] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 22.636171] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 22.639490] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 22.645935] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 22.646769] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 22.648221] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 22.648938] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 22.659531] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Connection to etcd is ready" machine # [ 22.659843] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="ETCD server is now running" machine # [ 22.663656] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 22.667784] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Handling backend connection request [machine]" machine # [ 22.670691] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 22.671638] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 22.679542] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 22.680956] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 22.681221] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 22.686194] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 22.694569] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 22.696308] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 22.698266] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 22.699986] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 22.751536] k3s[873]: I0921 16:48:11.232300 873 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 22.752496] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 22.753142] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Run: k3s kubectl" machine # [ 22.753684] k3s[873]: I0921 16:48:11.235863 873 server.go:158] Version: v1.35.8+k3s1 machine # [ 22.753939] k3s[873]: I0921 16:48:11.235913 873 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 22.754792] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 22.755581] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 22.798156] k3s[873]: I0921 16:48:11.348132 873 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 22.802307] k3s[873]: I0921 16:48:11.352420 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.803732] k3s[873]: I0921 16:48:11.353851 873 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 22.804492] k3s[873]: I0921 16:48:11.353878 873 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 22.804988] k3s[873]: I0921 16:48:11.354150 873 instance.go:240] Using reconciler: lease machine # [ 22.822076] k3s[873]: I0921 16:48:11.370357 873 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 22.822723] k3s[873]: W0921 16:48:11.370382 873 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 22.826321] k3s[873]: I0921 16:48:11.376463 873 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 22.855517] k3s[873]: time="2026-09-21T16:48:11Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:37212: runtime core not ready" machine # [ 22.871369] k3s[873]: I0921 16:48:11.421463 873 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 22.872754] k3s[873]: I0921 16:48:11.422899 873 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 22.909044] k3s[873]: I0921 16:48:11.459081 873 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 22.935425] k3s[873]: I0921 16:48:11.485523 873 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 22.936388] k3s[873]: W0921 16:48:11.485555 873 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 22.937056] k3s[873]: W0921 16:48:11.485566 873 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 22.937527] k3s[873]: I0921 16:48:11.485807 873 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 22.938100] k3s[873]: W0921 16:48:11.485820 873 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 22.938727] k3s[873]: I0921 16:48:11.486282 873 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 22.939476] k3s[873]: I0921 16:48:11.486641 873 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 22.940316] k3s[873]: W0921 16:48:11.486656 873 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 22.941217] k3s[873]: W0921 16:48:11.486666 873 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 22.942098] k3s[873]: I0921 16:48:11.487297 873 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 22.942845] k3s[873]: W0921 16:48:11.487312 873 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 22.943555] k3s[873]: I0921 16:48:11.487725 873 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 22.944155] k3s[873]: W0921 16:48:11.487740 873 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 22.944659] k3s[873]: W0921 16:48:11.487751 873 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 22.945336] k3s[873]: I0921 16:48:11.488037 873 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 22.945928] k3s[873]: W0921 16:48:11.488050 873 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 22.946913] k3s[873]: W0921 16:48:11.488060 873 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 22.947572] k3s[873]: I0921 16:48:11.488345 873 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 22.948314] k3s[873]: W0921 16:48:11.488359 873 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 22.949154] k3s[873]: I0921 16:48:11.489514 873 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 22.949845] k3s[873]: W0921 16:48:11.489530 873 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 22.950581] k3s[873]: I0921 16:48:11.489751 873 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 22.951333] k3s[873]: W0921 16:48:11.489764 873 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 22.952143] k3s[873]: W0921 16:48:11.489774 873 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 22.952691] k3s[873]: I0921 16:48:11.490149 873 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 22.953411] k3s[873]: W0921 16:48:11.490171 873 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 22.954075] k3s[873]: I0921 16:48:11.490868 873 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 22.954791] k3s[873]: W0921 16:48:11.490883 873 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 22.955884] k3s[873]: W0921 16:48:11.490894 873 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 22.956754] k3s[873]: I0921 16:48:11.491110 873 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 22.957454] k3s[873]: W0921 16:48:11.491127 873 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 22.958231] k3s[873]: W0921 16:48:11.491137 873 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 22.958643] k3s[873]: I0921 16:48:11.492252 873 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 22.959552] k3s[873]: W0921 16:48:11.492267 873 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 22.960161] k3s[873]: W0921 16:48:11.492278 873 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 22.960822] k3s[873]: I0921 16:48:11.492768 873 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 22.961615] k3s[873]: W0921 16:48:11.492783 873 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 22.962298] k3s[873]: W0921 16:48:11.492793 873 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 22.962704] k3s[873]: W0921 16:48:11.492802 873 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 22.963186] k3s[873]: I0921 16:48:11.494492 873 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 22.963867] k3s[873]: W0921 16:48:11.494508 873 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 22.964588] k3s[873]: W0921 16:48:11.494518 873 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 22.964957] k3s[873]: I0921 16:48:11.495337 873 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 22.965698] k3s[873]: W0921 16:48:11.495353 873 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 22.966538] k3s[873]: W0921 16:48:11.495364 873 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 22.967161] k3s[873]: I0921 16:48:11.495632 873 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 22.967847] k3s[873]: W0921 16:48:11.495646 873 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 22.968578] k3s[873]: I0921 16:48:11.496486 873 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 22.969227] k3s[873]: W0921 16:48:11.496501 873 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 22.970026] k3s[873]: W0921 16:48:11.496512 873 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 22.971075] k3s[873]: W0921 16:48:11.496523 873 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 22.972716] k3s[873]: I0921 16:48:11.498574 873 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 23.024221] k3s[873]: W0921 16:48:11.498591 873 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 23.025212] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 23.290967] k3s[873]: I0921 16:48:11.840809 873 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 23.292059] k3s[873]: I0921 16:48:11.840808 873 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 23.292220] k3s[873]: I0921 16:48:11.841142 873 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 23.302109] k3s[873]: I0921 16:48:11.841233 873 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 23.302758] k3s[873]: I0921 16:48:11.841423 873 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.303448] k3s[873]: I0921 16:48:11.849327 873 aggregator.go:185] waiting for initial CRD sync... machine # [ 23.303890] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 23.304909] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 23.306127] k3s[873]: I0921 16:48:11.849359 873 controller.go:78] Starting OpenAPI AggregationController machine # [ 23.306631] k3s[873]: I0921 16:48:11.849417 873 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 23.307224] k3s[873]: I0921 16:48:11.849693 873 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 23.307653] k3s[873]: I0921 16:48:11.849706 873 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 23.308174] k3s[873]: I0921 16:48:11.849743 873 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 23.308618] k3s[873]: I0921 16:48:11.849753 873 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 23.309172] k3s[873]: I0921 16:48:11.849824 873 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 23.309661] k3s[873]: I0921 16:48:11.850248 873 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 23.310191] k3s[873]: I0921 16:48:11.850351 873 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 23.310620] k3s[873]: I0921 16:48:11.850471 873 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 23.311166] k3s[873]: I0921 16:48:11.850482 873 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 23.311707] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 23.312488] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 23.313230] k3s[873]: I0921 16:48:11.850710 873 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 23.313944] k3s[873]: I0921 16:48:11.850770 873 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 23.314784] k3s[873]: I0921 16:48:11.850925 873 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 23.315233] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 23.315757] k3s[873]: I0921 16:48:11.851081 873 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 23.316480] k3s[873]: I0921 16:48:11.851097 873 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 23.317274] k3s[873]: I0921 16:48:11.851217 873 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 23.317907] k3s[873]: I0921 16:48:11.851230 873 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 23.318614] k3s[873]: I0921 16:48:11.851303 873 repairip.go:210] Starting ipallocator-repair-controller machine # [ 23.319218] k3s[873]: I0921 16:48:11.851320 873 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 23.319904] k3s[873]: I0921 16:48:11.851795 873 controller.go:142] Starting OpenAPI controller machine # [ 23.320800] k3s[873]: I0921 16:48:11.851862 873 controller.go:90] Starting OpenAPI V3 controller machine # [ 23.321225] k3s[873]: I0921 16:48:11.851894 873 naming_controller.go:305] Starting NamingConditionController machine # [ 23.321932] k3s[873]: I0921 16:48:11.851970 873 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 23.322844] k3s[873]: I0921 16:48:11.852008 873 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 23.323720] k3s[873]: I0921 16:48:11.852041 873 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 23.324869] k3s[873]: I0921 16:48:11.852108 873 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 23.325563] k3s[873]: I0921 16:48:11.852231 873 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 23.400094] k3s[873]: I0921 16:48:11.949880 873 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 23.400893] k3s[873]: I0921 16:48:11.950015 873 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 23.401700] k3s[873]: I0921 16:48:11.950318 873 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 23.401828] k3s[873]: I0921 16:48:11.950335 873 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 23.404746] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Caches are synced" logger=k3s machine # [ 23.405506] k3s[873]: I0921 16:48:11.954737 873 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 23.405970] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Caches are synced" logger=k3s machine # [ 23.406591] k3s[873]: I0921 16:48:11.955158 873 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 23.407158] k3s[873]: I0921 16:48:11.955398 873 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 23.407621] k3s[873]: I0921 16:48:11.955427 873 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 23.414384] k3s[873]: I0921 16:48:11.964508 873 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 23.415169] k3s[873]: I0921 16:48:11.965263 873 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 23.416363] k3s[873]: I0921 16:48:11.965695 873 aggregator.go:187] initial CRD sync complete... machine # [ 23.418306] k3s[873]: I0921 16:48:11.965709 873 autoregister_controller.go:144] Starting autoregister controller machine # [ 23.419304] k3s[873]: I0921 16:48:11.965721 873 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 23.420136] k3s[873]: I0921 16:48:11.965732 873 cache.go:39] Caches are synced for autoregister controller machine # [ 23.423101] k3s[873]: I0921 16:48:11.971130 873 shared_informer.go:377] "Caches are synced" machine # [ 23.423589] k3s[873]: I0921 16:48:11.971173 873 policy_source.go:248] refreshing policies machine # [ 23.424576] k3s[873]: I0921 16:48:11.971279 873 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 23.425419] k3s[873]: time="2026-09-21T16:48:11Z" level=info msg="Caches are synced" logger=k3s machine # [ 23.429097] k3s[873]: I0921 16:48:11.976447 873 controller.go:667] quota admission added evaluator for: namespaces machine # [ 23.429672] k3s[873]: I0921 16:48:11.977428 873 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 23.432055] k3s[873]: I0921 16:48:11.982133 873 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 23.442995] k3s[873]: I0921 16:48:11.992943 873 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 23.450025] k3s[873]: I0921 16:48:11.999977 873 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 23.466301] k3s[873]: E0921 16:48:12.016396 873 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 23.753580] k3s[873]: time="2026-09-21T16:48:12Z" level=info msg="containerd is now running" machine # [ 23.764478] k3s[873]: time="2026-09-21T16:48:12Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 24.310091] k3s[873]: I0921 16:48:12.860068 873 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 24.315258] k3s[873]: I0921 16:48:12.865352 873 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 24.319620] k3s[873]: I0921 16:48:12.865387 873 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 24.645513] k3s[873]: time="2026-09-21T16:48:13Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 25.272851] k3s[873]: I0921 16:48:13.822594 873 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 25.312536] k3s[873]: I0921 16:48:13.862617 873 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 25.378133] k3s[873]: I0921 16:48:13.928149 873 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 25.384885] k3s[873]: W0921 16:48:13.934969 873 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 25.386994] k3s[873]: I0921 16:48:13.936261 873 controller.go:667] quota admission added evaluator for: endpoints machine # [ 25.390286] k3s[873]: I0921 16:48:13.940419 873 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 26.646101] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Kube API server is now running" machine # [ 26.646749] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="k3s is up and running" machine # [ 26.647258] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Waiting for untainted node" machine # [ 26.648027] systemd[1]: Started k3s service. machine # [ 26.650630] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 26.651270] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 26.655646] systemd[1]: Starting niks3 server... machine # [ 26.663826] k3s[873]: I0921 16:48:15.213695 873 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 26.664656] k3s[873]: I0921 16:48:15.213719 873 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 26.667467] k3s[873]: I0921 16:48:15.217600 873 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 26.668535] k3s[873]: I0921 16:48:15.217615 873 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.670163] k3s[873]: I0921 16:48:15.217638 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.670739] k3s[873]: I0921 16:48:15.217960 873 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 26.671710] k3s[873]: I0921 16:48:15.218043 873 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.673336] k3s[873]: I0921 16:48:15.223331 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.674620] k3s[873]: I0921 16:48:15.223358 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.684078] k3s[873]: I0921 16:48:15.217676 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.684770] k3s[873]: I0921 16:48:15.234232 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.692928] k3s[873]: I0921 16:48:15.243053 873 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 26.696984] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 26.700880] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 26.706152] k3s[873]: I0921 16:48:15.256269 873 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 26.708968] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 26.721078] k3s[873]: I0921 16:48:15.270404 873 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 26.730728] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 26.733987] k3s[873]: W0921 16:48:15.284106 873 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 26.734780] k3s[873]: I0921 16:48:15.284733 873 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 26.735512] k3s[873]: I0921 16:48:15.284769 873 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 26.737320] k3s[873]: I0921 16:48:15.287464 873 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 26.747572] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 26.765786] k3s[873]: I0921 16:48:15.315872 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 26.766871] k3s[873]: I0921 16:48:15.317020 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 26.767945] k3s[873]: I0921 16:48:15.317822 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 26.768439] k3s[873]: I0921 16:48:15.317894 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 26.769556] k3s[873]: I0921 16:48:15.317944 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 26.770063] k3s[873]: I0921 16:48:15.317973 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 26.770587] k3s[873]: I0921 16:48:15.318013 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 26.771221] k3s[873]: I0921 16:48:15.319327 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 26.771682] k3s[873]: I0921 16:48:15.319372 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 26.772183] k3s[873]: I0921 16:48:15.319426 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 26.772633] k3s[873]: I0921 16:48:15.319490 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 26.773206] k3s[873]: I0921 16:48:15.319568 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 26.773645] k3s[873]: I0921 16:48:15.319597 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 26.774143] k3s[873]: I0921 16:48:15.319639 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 26.774684] k3s[873]: I0921 16:48:15.319685 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 26.775270] k3s[873]: I0921 16:48:15.321289 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 26.775888] k3s[873]: I0921 16:48:15.321323 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 26.776727] k3s[873]: I0921 16:48:15.321439 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 26.777202] k3s[873]: I0921 16:48:15.321477 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 26.777629] k3s[873]: I0921 16:48:15.321505 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 26.778257] k3s[873]: I0921 16:48:15.321534 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 26.779091] k3s[873]: I0921 16:48:15.321573 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 26.780416] k3s[873]: I0921 16:48:15.323628 873 shared_informer.go:377] "Caches are synced" machine # [ 26.781629] k3s[873]: I0921 16:48:15.326674 873 shared_informer.go:377] "Caches are synced" machine # [ 26.785521] k3s[873]: I0921 16:48:15.335600 873 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 26.786447] k3s[873]: I0921 16:48:15.336523 873 shared_informer.go:377] "Caches are synced" machine # [ 26.791196] k3s[873]: I0921 16:48:15.341332 873 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 26.811774] k3s[873]: I0921 16:48:15.361875 873 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 26.812690] k3s[873]: I0921 16:48:15.361900 873 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 26.813237] k3s[873]: I0921 16:48:15.361912 873 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 26.891662] k3s[873]: I0921 16:48:15.441727 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.992152] k3s[873]: I0921 16:48:15.542144 873 shared_informer.go:377] "Caches are synced" machine # [ 27.259692] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 27.260122] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 27.263426] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 27.264795] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 27.266143] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 27.267027] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 27.267669] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 27.268075] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 27.269337] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 27.270448] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 27.271293] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 27.390895] k3s[873]: I0921 16:48:15.939798 873 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 27.392846] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::aaae:843d:37f2:b77e 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 27.393440] k3s[873]: time="2026-09-21T16:48:15Z" level=info msg="Tunnel server egress proxy mode: agent" machine: (finished: waiting for unit k3s.service, in 28.56 seconds) machine: waiting for success: kubectl get ns farm machine # [ 27.762187] k3s[873]: time="2026-09-21T16:48:16Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__aaae_843d_37f2_b77e-a607c2:fec0::aaae:843d:37f2:b77e listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=78FD6E6AA1528C7DD5F98236D9E5ADB1097D019A]" machine # [ 27.781509] k3s[873]: time="2026-09-21T16:48:16Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=233) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__aaae_843d_37f2_b77e-a607c2:fec0::aaae:843d:37f2:b77e listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=78FD6E6AA1528C7DD5F98236D9E5ADB1097D019A]" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 28.042567] k3s[873]: I0921 16:48:16.592601 873 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 28.341678] k3s[873]: I0921 16:48:16.891689 873 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 28.600070] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 28.602123] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Creating deploy event broadcaster" machine # [ 28.603720] k3s[873]: I0921 16:48:17.153764 873 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 28.608063] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 28.608745] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 28.612063] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 28.613844] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.619035] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 28.846356] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 28.862120] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 29.143365] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine: (finished: waiting for success: kubectl get ns farm, in 1.48 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key machine # [ 29.153858] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 29.238866] k3s[873]: I0921 16:48:17.788885 873 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 29.239631] k3s[873]: I0921 16:48:17.788921 873 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key, in 0.23 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key machine # [ 29.382458] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 29.386703] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 29.388064] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 29.397904] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 29.398560] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 29.404520] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 29.405381] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 29.406799] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 29.407094] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 29.408895] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 29.409462] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 29.410953] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 29.411789] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 29.413539] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 29.414685] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 29.415949] k3s[873]: time="2026-09-21T16:48:17Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 29.599142] k3s[873]: I0921 16:48:18.146120 873 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 29.600066] k3s[873]: I0921 16:48:18.146183 873 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 29.600689] k3s[873]: I0921 16:48:18.146224 873 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 29.601491] k3s[873]: I0921 16:48:18.146240 873 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key, in 0.23 seconds) machine # [ 29.610904] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine # [ 29.690531] k3s[873]: I0921 16:48:18.240560 873 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 29.710134] k3s[873]: I0921 16:48:18.260222 873 serving.go:392] Generated self-signed cert in-memory machine # [ 29.720464] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 29.727060] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 29.727653] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 29.731365] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 29.731990] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 29.736630] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 29.736928] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 29.743848] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 5.980463159s" machine # [ 29.745449] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 29.795545] k3s[873]: I0921 16:48:18.345598 873 serving.go:392] Generated self-signed cert in-memory machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.21 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 29.861845] k3s[873]: I0921 16:48:18.411649 873 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 29.866957] k3s[873]: I0921 16:48:18.416836 873 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 29.868758] k3s[873]: I0921 16:48:18.416874 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.870091] k3s[873]: I0921 16:48:18.416916 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 29.872624] k3s[873]: I0921 16:48:18.416933 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.874651] k3s[873]: I0921 16:48:18.416958 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 29.877993] k3s[873]: I0921 16:48:18.416975 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.879416] k3s[873]: I0921 16:48:18.417230 873 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 29.881140] k3s[873]: I0921 16:48:18.417427 873 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 29.882681] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 29.994443] k3s[873]: I0921 16:48:18.544223 873 controller.go:667] quota admission added evaluator for: deployments.apps machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.068032] k3s[873]: I0921 16:48:18.617843 873 shared_informer.go:377] "Caches are synced" machine # [ 30.069626] k3s[873]: I0921 16:48:18.617889 873 shared_informer.go:377] "Caches are synced" machine # [ 30.071134] k3s[873]: I0921 16:48:18.617892 873 shared_informer.go:377] "Caches are synced" machine # [ 30.148045] k3s[873]: I0921 16:48:18.697770 873 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 30.149055] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 30.199609] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 30.204338] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 30.208573] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 30.214159] k3s[873]: I0921 16:48:18.764235 873 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 30.214885] k3s[873]: I0921 16:48:18.764571 873 controllermanager.go:329] Started "service-lb-controller" machine # [ 30.215558] k3s[873]: W0921 16:48:18.764584 873 controllermanager.go:306] "node-route-controller" is disabled machine # [ 30.216089] k3s[873]: I0921 16:48:18.764746 873 controllermanager.go:329] Started "cloud-node-controller" machine # [ 30.216568] k3s[873]: time="2026-09-21T16:48:18Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 30.217104] k3s[873]: I0921 16:48:18.765429 873 node_lifecycle_controller.go:112] Sending events to api server machine # [ 30.217854] k3s[873]: I0921 16:48:18.765553 873 node_controller.go:176] Sending events to api server. machine # [ 30.218843] k3s[873]: I0921 16:48:18.765685 873 controller.go:235] Starting service controller machine # [ 30.219622] k3s[873]: I0921 16:48:18.765703 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.220707] k3s[873]: I0921 16:48:18.765765 873 node_controller.go:185] Waiting for informer caches to sync machine # [ 30.516440] k3s[873]: I0921 16:48:19.066540 873 shared_informer.go:377] "Caches are synced" machine # [ 30.610113] k3s[873]: time="2026-09-21T16:48:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.940341] k3s[873]: time="2026-09-21T16:48:19Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 30.948123] k3s[873]: time="2026-09-21T16:48:19Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 31.092411] k3s[873]: I0921 16:48:19.642499 873 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 31.094478] k3s[873]: time="2026-09-21T16:48:19Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 31.106502] k3s[873]: time="2026-09-21T16:48:19Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 31.243704] k3s[873]: time="2026-09-21T16:48:19Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 31.251593] k3s[873]: I0921 16:48:19.801712 873 job_controller.go:254] "Starting job controller" machine # [ 31.252480] k3s[873]: I0921 16:48:19.801742 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.254918] k3s[873]: I0921 16:48:19.805022 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.255580] k3s[873]: I0921 16:48:19.805121 873 stateful_set.go:180] "Starting stateful set controller" machine # [ 31.257553] k3s[873]: I0921 16:48:19.807515 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.258398] k3s[873]: I0921 16:48:19.807586 873 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 31.258880] k3s[873]: I0921 16:48:19.807630 873 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 31.262356] k3s[873]: I0921 16:48:19.807640 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.263299] k3s[873]: I0921 16:48:19.807722 873 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 31.263790] k3s[873]: I0921 16:48:19.807737 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.264449] k3s[873]: I0921 16:48:19.812317 873 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 31.264894] k3s[873]: I0921 16:48:19.812332 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.265900] k3s[873]: I0921 16:48:19.812376 873 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 31.267105] k3s[873]: I0921 16:48:19.812391 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.267875] k3s[873]: I0921 16:48:19.812446 873 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 31.268653] k3s[873]: I0921 16:48:19.812458 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.269304] k3s[873]: I0921 16:48:19.812489 873 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 31.269835] k3s[873]: I0921 16:48:19.812501 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.270577] k3s[873]: I0921 16:48:19.812539 873 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 31.271167] k3s[873]: I0921 16:48:19.812551 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.281276] k3s[873]: I0921 16:48:19.831375 873 controller.go:174] "Starting ephemeral volume controller" machine # [ 31.282237] k3s[873]: I0921 16:48:19.831403 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.284065] k3s[873]: I0921 16:48:19.833927 873 controller.go:423] "Starting resource claim controller" machine # [ 31.284660] k3s[873]: I0921 16:48:19.833950 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.285183] k3s[873]: I0921 16:48:19.833989 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.285743] k3s[873]: I0921 16:48:19.834042 873 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 31.286299] k3s[873]: I0921 16:48:19.834100 873 taint_eviction.go:288] "Sending events to API server" machine # [ 31.288597] k3s[873]: I0921 16:48:19.834110 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.290190] k3s[873]: I0921 16:48:19.834142 873 ttl_controller.go:127] "Starting TTL controller" machine # [ 31.291488] k3s[873]: I0921 16:48:19.834156 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.292389] k3s[873]: I0921 16:48:19.834214 873 namespace_controller.go:202] "Starting namespace controller" machine # [ 31.293084] k3s[873]: I0921 16:48:19.834227 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.294250] k3s[873]: I0921 16:48:19.842703 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmchartconfigs.helm.cattle.io" machine # [ 31.294928] k3s[873]: I0921 16:48:19.842739 873 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmcharts.helm.cattle.io" machine # [ 31.296082] k3s[873]: I0921 16:48:19.842801 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.297088] k3s[873]: I0921 16:48:19.844397 873 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 31.297291] k3s[873]: I0921 16:48:19.844416 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.297947] k3s[873]: I0921 16:48:19.844492 873 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 31.299038] k3s[873]: I0921 16:48:19.844506 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.300052] k3s[873]: I0921 16:48:19.844573 873 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 31.301416] k3s[873]: I0921 16:48:19.844585 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.301880] k3s[873]: I0921 16:48:19.844675 873 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 31.302623] k3s[873]: I0921 16:48:19.844688 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.303520] k3s[873]: I0921 16:48:19.844727 873 expand_controller.go:328] "Starting expand controller" machine # [ 31.305076] k3s[873]: I0921 16:48:19.844738 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.306210] k3s[873]: I0921 16:48:19.844772 873 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 31.306661] k3s[873]: I0921 16:48:19.844813 873 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 31.307737] k3s[873]: I0921 16:48:19.844825 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.308616] k3s[873]: I0921 16:48:19.844885 873 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 31.309609] k3s[873]: I0921 16:48:19.844898 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.310773] k3s[873]: I0921 16:48:19.844930 873 disruption.go:458] "Sending events to api server." machine # [ 31.311516] k3s[873]: I0921 16:48:19.844967 873 disruption.go:465] "Starting disruption controller" machine # [ 31.311888] k3s[873]: I0921 16:48:19.845005 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.312303] k3s[873]: I0921 16:48:19.845052 873 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 31.313207] k3s[873]: I0921 16:48:19.845068 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.313750] k3s[873]: I0921 16:48:19.845157 873 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 31.314341] k3s[873]: I0921 16:48:19.845177 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.315178] k3s[873]: I0921 16:48:19.845233 873 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 31.316309] k3s[873]: I0921 16:48:19.845246 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.317434] k3s[873]: I0921 16:48:19.845312 873 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 31.318658] k3s[873]: I0921 16:48:19.845324 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.319898] k3s[873]: I0921 16:48:19.845398 873 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 31.321155] k3s[873]: I0921 16:48:19.845410 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.322151] k3s[873]: I0921 16:48:19.845469 873 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 31.322939] k3s[873]: I0921 16:48:19.845481 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.323823] k3s[873]: I0921 16:48:19.845514 873 gc_controller.go:98] "Starting GC controller" machine # [ 31.324755] k3s[873]: I0921 16:48:19.845526 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.325766] k3s[873]: I0921 16:48:19.845554 873 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 31.326602] k3s[873]: I0921 16:48:19.845972 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.327544] k3s[873]: I0921 16:48:19.846023 873 horizontal.go:204] "Starting HPA controller" machine # [ 31.328505] k3s[873]: I0921 16:48:19.846043 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.329466] k3s[873]: I0921 16:48:19.846073 873 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 31.330422] k3s[873]: I0921 16:48:19.846086 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.331233] k3s[873]: I0921 16:48:19.846116 873 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 31.331977] k3s[873]: I0921 16:48:19.846128 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.332775] k3s[873]: I0921 16:48:19.846240 873 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 31.333552] k3s[873]: I0921 16:48:19.846253 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.334558] k3s[873]: I0921 16:48:19.846380 873 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 31.336098] k3s[873]: I0921 16:48:19.846395 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.336735] k3s[873]: I0921 16:48:19.846662 873 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 31.338391] k3s[873]: I0921 16:48:19.846675 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.338896] k3s[873]: I0921 16:48:19.846708 873 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 31.339451] k3s[873]: I0921 16:48:19.846721 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.340550] k3s[873]: I0921 16:48:19.846751 873 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 31.340957] k3s[873]: I0921 16:48:19.846763 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.341811] k3s[873]: I0921 16:48:19.846798 873 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 31.343028] k3s[873]: I0921 16:48:19.847026 873 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 31.343547] k3s[873]: I0921 16:48:19.847087 873 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 31.344088] k3s[873]: I0921 16:48:19.847153 873 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.344774] k3s[873]: I0921 16:48:19.849876 873 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 31.346677] k3s[873]: I0921 16:48:19.849895 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.346983] k3s[873]: I0921 16:48:19.849960 873 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 31.347646] k3s[873]: I0921 16:48:19.852476 873 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 31.348200] k3s[873]: I0921 16:48:19.852510 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.348356] k3s[873]: I0921 16:48:19.852554 873 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 31.362571] k3s[873]: I0921 16:48:19.912680 873 shared_informer.go:377] "Caches are synced" machine # [ 31.391800] k3s[873]: I0921 16:48:19.941876 873 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 31.394443] k3s[873]: I0921 16:48:19.944579 873 shared_informer.go:377] "Caches are synced" machine # [ 31.395741] k3s[873]: I0921 16:48:19.944735 873 shared_informer.go:377] "Caches are synced" machine # [ 31.396882] k3s[873]: I0921 16:48:19.944778 873 shared_informer.go:377] "Caches are synced" machine # [ 31.397968] k3s[873]: I0921 16:48:19.945104 873 shared_informer.go:377] "Caches are synced" machine # [ 31.399161] k3s[873]: I0921 16:48:19.945241 873 shared_informer.go:377] "Caches are synced" machine # [ 31.400274] k3s[873]: I0921 16:48:19.945459 873 shared_informer.go:377] "Caches are synced" machine # [ 31.401370] k3s[873]: I0921 16:48:19.945559 873 shared_informer.go:377] "Caches are synced" machine # [ 31.402574] k3s[873]: I0921 16:48:19.946043 873 shared_informer.go:377] "Caches are synced" machine # [ 31.403705] k3s[873]: I0921 16:48:19.946080 873 shared_informer.go:377] "Caches are synced" machine # [ 31.404790] k3s[873]: I0921 16:48:19.946173 873 shared_informer.go:377] "Caches are synced" machine # [ 31.405896] k3s[873]: I0921 16:48:19.946255 873 range_allocator.go:177] "Sending events to api server" machine # [ 31.407758] k3s[873]: I0921 16:48:19.946303 873 shared_informer.go:377] "Caches are synced" machine # [ 31.408991] k3s[873]: I0921 16:48:19.946477 873 shared_informer.go:377] "Caches are synced" machine # [ 31.410203] k3s[873]: I0921 16:48:19.947368 873 shared_informer.go:377] "Caches are synced" machine # [ 31.411443] k3s[873]: I0921 16:48:19.947468 873 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 31.412857] k3s[873]: I0921 16:48:19.947481 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.414295] k3s[873]: I0921 16:48:19.947492 873 shared_informer.go:377] "Caches are synced" machine # [ 31.415505] k3s[873]: I0921 16:48:19.947488 873 shared_informer.go:377] "Caches are synced" machine # [ 31.416943] k3s[873]: I0921 16:48:19.947551 873 shared_informer.go:377] "Caches are synced" machine # [ 31.418173] k3s[873]: time="2026-09-21T16:48:19Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 31.422021] k3s[873]: time="2026-09-21T16:48:19Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 31.425239] k3s[873]: I0921 16:48:19.971569 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.452184] k3s[873]: I0921 16:48:20.002216 873 shared_informer.go:377] "Caches are synced" machine # [ 31.455452] k3s[873]: I0921 16:48:20.005550 873 shared_informer.go:377] "Caches are synced" machine # [ 31.457502] k3s[873]: I0921 16:48:20.007578 873 shared_informer.go:377] "Caches are synced" machine # [ 31.458223] k3s[873]: I0921 16:48:20.007736 873 shared_informer.go:377] "Caches are synced" machine # [ 31.458610] k3s[873]: I0921 16:48:20.007873 873 shared_informer.go:377] "Caches are synced" machine # [ 31.462814] k3s[873]: I0921 16:48:20.012940 873 shared_informer.go:377] "Caches are synced" machine # [ 31.464162] k3s[873]: I0921 16:48:20.012966 873 shared_informer.go:377] "Caches are synced" machine # [ 31.464593] k3s[873]: I0921 16:48:20.012971 873 shared_informer.go:377] "Caches are synced" machine # [ 31.465325] k3s[873]: I0921 16:48:20.012983 873 shared_informer.go:377] "Caches are synced" machine # [ 31.481555] k3s[873]: I0921 16:48:20.031601 873 shared_informer.go:377] "Caches are synced" machine # [ 31.483899] k3s[873]: I0921 16:48:20.034027 873 shared_informer.go:377] "Caches are synced" machine # [ 31.484488] k3s[873]: I0921 16:48:20.034070 873 shared_informer.go:377] "Caches are synced" machine # [ 31.485307] k3s[873]: I0921 16:48:20.034329 873 shared_informer.go:377] "Caches are synced" machine # [ 31.485892] k3s[873]: I0921 16:48:20.034389 873 shared_informer.go:377] "Caches are synced" machine # [ 31.486522] k3s[873]: I0921 16:48:20.034432 873 shared_informer.go:377] "Caches are synced" machine # [ 31.493278] k3s[873]: I0921 16:48:20.043400 873 shared_informer.go:377] "Caches are synced" machine # [ 31.494736] k3s[873]: I0921 16:48:20.044727 873 shared_informer.go:377] "Caches are synced" machine # [ 31.495508] k3s[873]: I0921 16:48:20.044735 873 shared_informer.go:377] "Caches are synced" machine # [ 31.495978] k3s[873]: I0921 16:48:20.045290 873 shared_informer.go:377] "Caches are synced" machine # [ 31.496566] k3s[873]: I0921 16:48:20.045319 873 shared_informer.go:377] "Caches are synced" machine # [ 31.497045] k3s[873]: I0921 16:48:20.045323 873 shared_informer.go:377] "Caches are synced" machine # [ 31.497486] k3s[873]: I0921 16:48:20.045375 873 shared_informer.go:377] "Caches are synced" machine # [ 31.497934] k3s[873]: I0921 16:48:20.045521 873 shared_informer.go:377] "Caches are synced" machine # [ 31.498574] k3s[873]: I0921 16:48:20.047024 873 shared_informer.go:377] "Caches are synced" machine # [ 31.499185] k3s[873]: I0921 16:48:20.047031 873 shared_informer.go:377] "Caches are synced" machine # [ 31.500642] k3s[873]: I0921 16:48:20.050785 873 shared_informer.go:377] "Caches are synced" machine # [ 31.576338] k3s[873]: time="2026-09-21T16:48:20Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 31.609313] k3s[873]: time="2026-09-21T16:48:20Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.693485] k3s[873]: time="2026-09-21T16:48:20Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 31.804541] k3s[873]: time="2026-09-21T16:48:20Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 32.026738] k3s[873]: time="2026-09-21T16:48:20Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 32.044306] k3s[873]: I0921 16:48:20.594358 873 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 32.157671] k3s[873]: I0921 16:48:20.707697 873 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 32.163163] k3s[873]: I0921 16:48:20.713286 873 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 32.610615] k3s[873]: time="2026-09-21T16:48:21Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.721836] k3s[873]: I0921 16:48:21.271859 873 shared_informer.go:377] "Caches are synced" machine # [ 32.802563] k3s[873]: I0921 16:48:21.352626 873 shared_informer.go:377] "Caches are synced" machine # [ 32.803788] k3s[873]: I0921 16:48:21.352659 873 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 32.804484] k3s[873]: I0921 16:48:21.352669 873 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 33.612420] k3s[873]: time="2026-09-21T16:48:22Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.079253] postgres[1203]: [1203] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 34.079805] postgres[1203]: [1203] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 34.514196] niks3-server[1195]: 2026/09/21 16:48:23 OK 20241026095416_initial_model.sql (27.01ms) machine # [ 34.535594] niks3-server[1195]: 2026/09/21 16:48:23 OK 20251210153512_drop_unused_gin_index.sql (13.24ms) machine # [ 34.548488] niks3-server[1195]: 2026/09/21 16:48:23 OK 20251218171726_add_pins.sql (12.8ms) machine # [ 34.559831] niks3-server[1195]: 2026/09/21 16:48:23 OK 20260628120000_add_object_size_and_stats.sql (11.07ms) machine # [ 34.568589] niks3-server[1195]: 2026/09/21 16:48:23 OK 20260905000000_add_claims.sql (8.39ms) machine # [ 34.575849] niks3-server[1195]: 2026/09/21 16:48:23 OK 20260920000000_drop_claims.sql (7.16ms) machine # [ 34.577500] niks3-server[1195]: 2026/09/21 16:48:23 goose: successfully migrated database to version: 20260920000000 machine # [ 34.585329] niks3-server[1195]: 2026/09/21 16:48:23 OK 1_commit_pending_closure.sql (9.28ms) machine # [ 34.589769] niks3-server[1195]: 2026/09/21 16:48:23 OK 2_object_stats_trigger.sql (4.28ms) machine # [ 34.590989] niks3-server[1195]: 2026/09/21 16:48:23 goose: up to current file version: 2 machine # [ 34.611251] k3s[873]: time="2026-09-21T16:48:23Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.621882] niks3-server[1195]: 2026/09/21 16:48:23 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 34.623037] niks3-server[1195]: 2026/09/21 16:48:23 INFO OIDC authentication enabled config=/nix/store/2xcn0lgmca14rg9xzcfqj65j9hs85hn6-niks3-oidc.json machine # [ 34.627885] niks3-server[1195]: 2026/09/21 16:48:23 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key machine # [ 34.702599] niks3-server[1195]: 2026/09/21 16:48:23 INFO Read proxy enabled — serving cache objects from S3 machine # [ 34.705213] niks3-server[1195]: 2026/09/21 16:48:23 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 34.706930] niks3-server[1195]: 2026/09/21 16:48:23 INFO systemd watchdog enabled interval=15s machine # [ 34.708349] systemd[1]: Started niks3 server. machine # [ 34.709102] systemd[1]: Reached target Multi-User System. machine # [ 34.709849] niks3-server[1195]: 2026/09/21 16:48:23 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 34.711262] systemd[1]: Startup finished in 1.226s (kernel) + 4.175s (initrd) + 29.306s (userspace) = 34.708s. machine # [ 34.749956] k3s[873]: time="2026-09-21T16:48:23Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 34.751458] k3s[873]: time="2026-09-21T16:48:23Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 34.752842] k3s[873]: time="2026-09-21T16:48:23Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 34.754923] k3s[873]: time="2026-09-21T16:48:23Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 34.756797] k3s[873]: time="2026-09-21T16:48:23Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 34.759163] k3s[873]: time="2026-09-21T16:48:23Z" level=info msg="Handling backend connection request [machine]" machine # [ 34.760798] k3s[873]: time="2026-09-21T16:48:23Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 34.762706] k3s[873]: time="2026-09-21T16:48:23Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.610110] k3s[873]: time="2026-09-21T16:48:24Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.612303] k3s[873]: time="2026-09-21T16:48:25Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.610219] k3s[873]: time="2026-09-21T16:48:26Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 38.610714] k3s[873]: time="2026-09-21T16:48:27Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.610181] k3s[873]: time="2026-09-21T16:48:28Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 40.610891] k3s[873]: time="2026-09-21T16:48:29Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 41.610219] k3s[873]: time="2026-09-21T16:48:30Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 42.611113] k3s[873]: time="2026-09-21T16:48:31Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 43.610552] k3s[873]: time="2026-09-21T16:48:32Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 44.612104] k3s[873]: time="2026-09-21T16:48:33Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 45.302205] k3s[873]: time="2026-09-21T16:48:33Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.1" machine # [ 45.305321] k3s[873]: time="2026-09-21T16:48:33Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:9221520475d9d498427355eb42be6e455c4ab65437b3b120383e41061b204dbb" machine # [ 45.614713] k3s[873]: time="2026-09-21T16:48:34Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 45.698639] k3s[873]: time="2026-09-21T16:48:34Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 15.953940513s" machine # [ 45.700660] k3s[873]: time="2026-09-21T16:48:34Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.611648] k3s[873]: time="2026-09-21T16:48:35Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.612343] k3s[873]: time="2026-09-21T16:48:36Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 48.611059] k3s[873]: time="2026-09-21T16:48:37Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.612499] k3s[873]: time="2026-09-21T16:48:38Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.183755] k3s[873]: time="2026-09-21T16:48:38Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.1" machine # [ 50.189495] k3s[873]: time="2026-09-21T16:48:38Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:a3fb275e15335967c368c203214cabcce2886a8867fcd31c07e4effd2ad9a5ec" machine # [ 50.237405] k3s[873]: time="2026-09-21T16:48:38Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 4.537529769s" machine # [ 50.239561] k3s[873]: time="2026-09-21T16:48:38Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 50.301311] k3s[873]: time="2026-09-21T16:48:38Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::aaae:843d:37f2:b77e --node-labels= --read-only-port=0" machine # [ 50.303254] k3s[873]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 50.320494] k3s[873]: I0921 16:48:38.870579 873 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 50.322434] k3s[873]: I0921 16:48:38.870610 873 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 50.323306] k3s[873]: I0921 16:48:38.870640 873 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 50.324395] k3s[873]: I0921 16:48:38.870652 873 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 50.326055] k3s[873]: I0921 16:48:38.872055 873 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 50.327232] k3s[873]: I0921 16:48:38.876421 873 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 50.332069] k3s[873]: I0921 16:48:38.882132 873 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 50.333404] k3s[873]: I0921 16:48:38.882172 873 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 50.348127] k3s[873]: I0921 16:48:38.882418 873 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 50.349325] k3s[873]: I0921 16:48:38.882443 873 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 50.350031] k3s[873]: I0921 16:48:38.882610 873 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 50.350588] k3s[873]: I0921 16:48:38.882625 873 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 50.351087] k3s[873]: I0921 16:48:38.882694 873 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 50.352459] k3s[873]: I0921 16:48:38.902576 873 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 50.353250] k3s[873]: I0921 16:48:38.902857 873 kubelet.go:482] "Attempting to sync node with API server" machine # [ 50.353656] k3s[873]: I0921 16:48:38.902879 873 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 50.354233] k3s[873]: I0921 16:48:38.902911 873 kubelet.go:394] "Adding apiserver pod source" machine # [ 50.354685] k3s[873]: I0921 16:48:38.902927 873 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 50.356798] k3s[873]: I0921 16:48:38.906766 873 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 50.357946] k3s[873]: I0921 16:48:38.908069 873 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 50.358656] k3s[873]: I0921 16:48:38.908125 873 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 50.361914] k3s[873]: I0921 16:48:38.912057 873 server.go:1252] "Started kubelet" machine # [ 50.365122] k3s[873]: I0921 16:48:38.913955 873 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 50.365709] k3s[873]: I0921 16:48:38.914019 873 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 50.366279] k3s[873]: I0921 16:48:38.914260 873 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 50.366705] k3s[873]: I0921 16:48:38.914313 873 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 50.367066] k3s[873]: I0921 16:48:38.915180 873 server.go:317] "Adding debug handlers to kubelet server" machine # [ 50.367636] k3s[873]: E0921 16:48:38.917138 873 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 50.371116] k3s[873]: I0921 16:48:38.917435 873 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 50.371865] k3s[873]: I0921 16:48:38.919317 873 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 50.372377] k3s[873]: I0921 16:48:38.920747 873 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 50.372885] k3s[873]: I0921 16:48:38.921128 873 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 50.374164] k3s[873]: I0921 16:48:38.921330 873 reconciler.go:29] "Reconciler: start to sync state" machine # [ 50.374593] k3s[873]: I0921 16:48:38.922303 873 factory.go:223] Registration of the systemd container factory successfully machine # [ 50.375512] k3s[873]: I0921 16:48:38.922438 873 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 50.376931] k3s[873]: E0921 16:48:38.927013 873 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 50.381321] k3s[873]: I0921 16:48:38.931447 873 factory.go:223] Registration of the containerd container factory successfully machine # [ 50.382031] k3s[873]: E0921 16:48:38.932062 873 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 50.393369] k3s[873]: I0921 16:48:38.943488 873 cpu_manager.go:225] "Starting" policy="none" machine # [ 50.394178] k3s[873]: I0921 16:48:38.943509 873 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 50.394902] k3s[873]: I0921 16:48:38.943536 873 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 50.400406] k3s[873]: I0921 16:48:38.950538 873 policy_none.go:50] "Start" machine # [ 50.401797] k3s[873]: I0921 16:48:38.950568 873 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 50.402389] k3s[873]: I0921 16:48:38.950613 873 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 50.404921] k3s[873]: I0921 16:48:38.955058 873 policy_none.go:44] "Start" machine # [ 50.411273] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 50.442099] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 50.446277] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 50.455326] k3s[873]: E0921 16:48:39.005441 873 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 50.455955] k3s[873]: I0921 16:48:39.005585 873 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 50.456737] k3s[873]: I0921 16:48:39.005620 873 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 50.457702] k3s[873]: I0921 16:48:39.006344 873 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 50.458796] k3s[873]: E0921 16:48:39.008150 873 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 50.459073] k3s[873]: E0921 16:48:39.008226 873 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 50.557875] k3s[873]: I0921 16:48:39.107962 873 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 50.565110] k3s[873]: I0921 16:48:39.113543 873 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 50.565715] k3s[873]: E0921 16:48:39.113579 873 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 50.566688] k3s[873]: I0921 16:48:39.116828 873 node_controller.go:429] Initializing node machine with cloud provider machine # [ 50.567327] k3s[873]: I0921 16:48:39.117480 873 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 50.567916] k3s[873]: E0921 16:48:39.118057 873 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 50.569344] k3s[873]: time="2026-09-21T16:48:39Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 50.571582] k3s[873]: I0921 16:48:39.121709 873 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 50.574161] k3s[873]: I0921 16:48:39.122545 873 node_controller.go:429] Initializing node machine with cloud provider machine # [ 50.576022] k3s[873]: I0921 16:48:39.122569 873 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 50.577545] k3s[873]: I0921 16:48:39.122592 873 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 50.578294] k3s[873]: E0921 16:48:39.122610 873 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 50.578744] k3s[873]: I0921 16:48:39.123575 873 node_controller.go:429] Initializing node machine with cloud provider machine # [ 50.579856] k3s[873]: I0921 16:48:39.123613 873 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 50.581727] k3s[873]: E0921 16:48:39.123630 873 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 50.583637] k3s[873]: I0921 16:48:39.133214 873 node_controller.go:429] Initializing node machine with cloud provider machine # [ 50.584150] k3s[873]: I0921 16:48:39.133268 873 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 50.584613] k3s[873]: E0921 16:48:39.133295 873 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 50.585371] k3s[873]: time="2026-09-21T16:48:39Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 50.585959] k3s[873]: time="2026-09-21T16:48:39Z" level=info msg="Starting flannel with backend vxlan" machine # [ 50.588055] k3s[873]: I0921 16:48:39.137069 873 node_controller.go:429] Initializing node machine with cloud provider machine # [ 50.595118] k3s[873]: time="2026-09-21T16:48:39Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 50.601521] k3s[873]: I0921 16:48:39.151664 873 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 50.603348] k3s[873]: I0921 16:48:39.153467 873 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 50.612155] k3s[873]: I0921 16:48:39.161114 873 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 50.615816] k3s[873]: I0921 16:48:39.165642 873 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 50.619381] k3s[873]: time="2026-09-21T16:48:39Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 50.620067] k3s[873]: I0921 16:48:39.170148 873 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 50.620701] k3s[873]: I0921 16:48:39.170177 873 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 50.623915] k3s[873]: I0921 16:48:39.174060 873 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 50.625564] k3s[873]: I0921 16:48:39.175450 873 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 50.627024] k3s[873]: I0921 16:48:39.175469 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 50.628100] k3s[873]: I0921 16:48:39.175506 873 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 50.628336] k3s[873]: I0921 16:48:39.175593 873 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 50.631231] k3s[873]: I0921 16:48:39.181337 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 50.636909] k3s[873]: I0921 16:48:39.181385 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 50.638045] k3s[873]: I0921 16:48:39.186639 873 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 50.638212] k3s[873]: I0921 16:48:39.186663 873 shared_informer.go:370] "Waiting for caches to sync" machine # [ 50.647775] k3s[873]: time="2026-09-21T16:48:39Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 50.648572] k3s[873]: time="2026-09-21T16:48:39Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 50.649251] k3s[873]: I0921 16:48:39.199038 873 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 50.649847] k3s[873]: I0921 16:48:39.199155 873 kube.go:537] Starting kube subnet manager machine # [ 50.666882] k3s[873]: I0921 16:48:39.216925 873 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 50.678830] k3s[873]: I0921 16:48:39.228964 873 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 50.680167] k3s[873]: I0921 16:48:39.229912 873 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 50.681092] k3s[873]: I0921 16:48:39.229970 873 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 50.685615] k3s[873]: E0921 16:48:39.230032 873 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 50.725878] k3s[873]: I0921 16:48:39.275874 873 shared_informer.go:377] "Caches are synced" machine # [ 50.737411] k3s[873]: I0921 16:48:39.287513 873 shared_informer.go:377] "Caches are synced" machine # [ 50.738073] k3s[873]: I0921 16:48:39.287604 873 shared_informer.go:377] "Caches are synced" machine # [ 50.825808] k3s[873]: I0921 16:48:39.375849 873 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 50.992622] k3s[873]: I0921 16:48:39.542555 873 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::aaae:843d:37f2:b77e"] machine # [ 50.993071] k3s[873]: E0921 16:48:39.542706 873 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 51.039133] k3s[873]: I0921 16:48:39.589155 873 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 51.039554] k3s[873]: I0921 16:48:39.589263 873 server_linux.go:136] "Using iptables Proxier" machine # [ 51.083233] k3s[873]: I0921 16:48:39.633311 873 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 51.105514] k3s[873]: I0921 16:48:39.655612 873 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 51.106789] k3s[873]: I0921 16:48:39.655648 873 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 51.107790] k3s[873]: I0921 16:48:39.657803 873 config.go:309] "Starting node config controller" machine # [ 51.108319] k3s[873]: I0921 16:48:39.657821 873 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 51.109203] k3s[873]: I0921 16:48:39.657834 873 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 51.109510] k3s[873]: I0921 16:48:39.657822 873 config.go:200] "Starting service config controller" machine # [ 51.110758] k3s[873]: I0921 16:48:39.657855 873 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 51.111791] k3s[873]: I0921 16:48:39.657900 873 config.go:106] "Starting endpoint slice config controller" machine # [ 51.113174] k3s[873]: I0921 16:48:39.657915 873 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 51.114056] k3s[873]: I0921 16:48:39.657948 873 config.go:403] "Starting serviceCIDR config controller" machine # [ 51.114825] k3s[873]: I0921 16:48:39.657963 873 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.353538] k3s[873]: I0921 16:48:39.903542 873 apiserver.go:52] "Watching apiserver" machine # [ 51.461368] k3s[873]: I0921 16:48:40.011351 873 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 51.461828] k3s[873]: I0921 16:48:40.011552 873 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 51.462427] k3s[873]: I0921 16:48:40.011690 873 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 51.488210] systemd[1]: Created slice libcontainer container kubepods-burstable-podb70217d0_8117_45df_920c_9fa5538d05ac.slice. machine # [ 51.507121] systemd[1]: Created slice libcontainer container kubepods-burstable-podef227acd_fdb0_4356_87a5_4936edcf5215.slice. machine # [ 51.508720] k3s[873]: I0921 16:48:40.058427 873 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 51.510374] k3s[873]: I0921 16:48:40.058393 873 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 51.510848] k3s[873]: I0921 16:48:40.058502 873 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 51.571402] k3s[873]: I0921 16:48:40.121475 873 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 51.575491] k3s[873]: I0921 16:48:40.125614 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b70217d0-8117-45df-920c-9fa5538d05ac-config-volume\") pod \"coredns-c5fdd76cf-rbwgv\" (UID: \"b70217d0-8117-45df-920c-9fa5538d05ac\") " pod="kube-system/coredns-c5fdd76cf-rbwgv" machine # [ 51.576361] k3s[873]: I0921 16:48:40.125671 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/b70217d0-8117-45df-920c-9fa5538d05ac-custom-config-volume\") pod \"coredns-c5fdd76cf-rbwgv\" (UID: \"b70217d0-8117-45df-920c-9fa5538d05ac\") " pod="kube-system/coredns-c5fdd76cf-rbwgv" machine # [ 51.576946] k3s[873]: I0921 16:48:40.125710 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-helm\") pod \"helm-install-nix-grpc-farm-s7dhb\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " pod="kube-system/helm-install-nix-grpc-farm-s7dhb" machine # [ 51.577875] k3s[873]: I0921 16:48:40.125787 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-config\") pod \"helm-install-nix-grpc-farm-s7dhb\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " pod="kube-system/helm-install-nix-grpc-farm-s7dhb" machine # [ 51.578446] k3s[873]: I0921 16:48:40.125826 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-tmp\") pod \"helm-install-nix-grpc-farm-s7dhb\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " pod="kube-system/helm-install-nix-grpc-farm-s7dhb" machine # [ 51.579188] k3s[873]: I0921 16:48:40.125854 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnj9l\" (UniqueName: \"kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-kube-api-access-qnj9l\") pod \"helm-install-nix-grpc-farm-s7dhb\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " pod="kube-system/helm-install-nix-grpc-farm-s7dhb" machine # [ 51.579709] k3s[873]: I0921 16:48:40.125968 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvzjl\" (UniqueName: \"kubernetes.io/projected/b70217d0-8117-45df-920c-9fa5538d05ac-kube-api-access-bvzjl\") pod \"coredns-c5fdd76cf-rbwgv\" (UID: \"b70217d0-8117-45df-920c-9fa5538d05ac\") " pod="kube-system/coredns-c5fdd76cf-rbwgv" machine # [ 51.580217] k3s[873]: I0921 16:48:40.126021 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-cache\") pod \"helm-install-nix-grpc-farm-s7dhb\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " pod="kube-system/helm-install-nix-grpc-farm-s7dhb" machine # [ 51.580661] k3s[873]: I0921 16:48:40.126061 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-values\") pod \"helm-install-nix-grpc-farm-s7dhb\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " pod="kube-system/helm-install-nix-grpc-farm-s7dhb" machine # [ 51.581209] k3s[873]: I0921 16:48:40.126096 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/ef227acd-fdb0-4356-87a5-4936edcf5215-content\") pod \"helm-install-nix-grpc-farm-s7dhb\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " pod="kube-system/helm-install-nix-grpc-farm-s7dhb" machine # [ 51.650341] k3s[873]: I0921 16:48:40.199860 873 kube.go:163] Node controller sync successful machine # [ 51.650892] k3s[873]: I0921 16:48:40.199957 873 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 51.653479] k3s[873]: time="2026-09-21T16:48:40Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 51.658952] k3s[873]: I0921 16:48:40.209013 873 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::aaae:843d:37f2:b77e", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::aaae:843d:37f2:b77e", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 51.700192] (udev-worker)[1466]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.708377] k3s[873]: I0921 16:48:40.258489 873 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 51.712399] k3s[873]: I0921 16:48:40.262408 873 iptables.go:50] Starting flannel in iptables mode... machine # [ 51.716560] k3s[873]: time="2026-09-21T16:48:40Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 51.722359] k3s[873]: time="2026-09-21T16:48:40Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 51.727257] k3s[873]: time="2026-09-21T16:48:40Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 51.727915] k3s[873]: time="2026-09-21T16:48:40Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 51.729620] k3s[873]: I0921 16:48:40.262504 873 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 51.754316] dhcpcd[677]: flannel.1: IAID 14:fa:f2:da machine # [ 51.755390] dhcpcd[677]: flannel.1: adding address fe80::a49d:14ff:fefa:f2da machine # [ 51.811063] k3s[873]: I0921 16:48:40.361009 873 iptables.go:111] Setting up masking rules machine # [ 51.837798] k3s[873]: I0921 16:48:40.387874 873 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 51.856488] k3s[873]: time="2026-09-21T16:48:40Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 51.856807] k3s[873]: time="2026-09-21T16:48:40Z" level=info msg="Running flannel backend" machine # [ 51.857091] k3s[873]: I0921 16:48:40.406647 873 vxlan_network.go:68] watching for new subnet leases machine # [ 51.857367] k3s[873]: I0921 16:48:40.406681 873 vxlan_network.go:115] starting vxlan device watcher machine # [ 51.945914] (udev-worker)[1467]: Network interface NamePolicy= disabled on kernel command line. machine # [ 52.101647] cni0: port 1(veth14609cb8) entered blocking state machine # [ 52.102400] cni0: port 1(veth14609cb8) entered disabled state machine # [ 52.103883] veth14609cb8: entered allmulticast mode machine # [ 52.105191] veth14609cb8: entered promiscuous mode machine # [ 52.106569] cni0: port 2(veth7893f599) entered blocking state machine # [ 52.107937] cni0: port 2(veth7893f599) entered disabled state machine # [ 52.109247] veth7893f599: entered allmulticast mode machine # [ 52.110294] veth7893f599: entered promiscuous mode machine # [ 51.962608] k3s[873]: I0921 16:48:40.512707 873 iptables.go:358] bootstrap done machine # [ 52.130855] cni0: port 1(veth14609cb8) entered blocking state machine # [ 52.131644] cni0: port 1(veth14609cb8) entered forwarding state machine # [ 52.134877] cni0: port 2(veth7893f599) entered blocking state machine # [ 52.135895] cni0: port 2(veth7893f599) entered forwarding state machine # [ 52.023022] dhcpcd[677]: veth7893f599: waiting for carrier machine # [ 52.043439] dhcpcd[677]: veth14609cb8: IAID a5:3c:73:cc machine # [ 52.044241] dhcpcd[677]: veth14609cb8: adding address fe80::6457:a5ff:fe3c:73cc machine # [ 52.044557] dhcpcd[677]: veth7893f599: carrier acquired machine # [ 52.054911] dhcpcd[677]: veth7893f599: IAID 34:d7:2a:86 machine # [ 52.055662] dhcpcd[677]: veth7893f599: adding address fe80::88ee:34ff:fed7:2a86 machine # [ 52.078242] k3s[873]: I0921 16:48:40.628357 873 iptables.go:358] bootstrap done machine # [ 52.186567] dhcpcd[677]: veth7893f599: soliciting a DHCP lease machine # [ 52.225569] systemd[1]: Started libcontainer container 46b9f7b96b99df76501cb3855a1b5d6fc4fa161d352ea29b7bdeec00a373d208. machine # [ 52.230086] systemd[1]: Started libcontainer container 4b9e5a68fdc8d7da96e807cd771f853f3a1d657499d0ec1a4723d6f93c6e6519. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 52.538991] dhcpcd[677]: veth14609cb8: soliciting a DHCP lease machine # [ 52.598448] dhcpcd[677]: flannel.1: soliciting a DHCP lease machine # [ 52.830483] k3s[873]: time="2026-09-21T16:48:41Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 52.831300] k3s[873]: I0921 16:48:41.380014 873 network_policy_controller.go:164] Starting network policy controller machine # [ 53.215578] systemd[1]: Started libcontainer container a2d844260542f76cb3ceb50f6b771c4d2038d021b9f38a6ac8bc7a51f9e2f684. machine # [ 53.309820] k3s[873]: I0921 16:48:41.859888 873 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 53.393355] systemd[1]: Started libcontainer container eca781c81a76d8c56546f10d83ece06524f0aa0ca5b3f0a77160c21cdb3115dd. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 53.734560] k3s[873]: I0921 16:48:42.284497 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-s7dhb" podStartSLOduration=22.284468132 podStartE2EDuration="22.284468132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 16:48:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 16:48:42.279079458 +0000 UTC m=+33.205281394" watchObservedRunningTime="2026-09-21 16:48:42.284468132 +0000 UTC m=+33.210670068" machine # [ 53.744073] k3s[873]: I0921 16:48:42.293228 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-rbwgv" podStartSLOduration=22.293211422 podStartE2EDuration="22.293211422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 16:48:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 16:48:42.290937949 +0000 UTC m=+33.217139885" watchObservedRunningTime="2026-09-21 16:48:42.293211422 +0000 UTC m=+33.219413637" machine # [ 53.852265] dhcpcd[677]: flannel.1: soliciting an IPv6 router machine # [ 54.346563] dhcpcd[677]: veth7893f599: soliciting an IPv6 router machine # [ 54.379788] dhcpcd[677]: veth14609cb8: soliciting an IPv6 router machine # [ 54.702041] k3s[873]: I0921 16:48:43.251788 873 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.36.233"} machine # [ 54.743758] systemd[1]: cri-containerd-eca781c81a76d8c56546f10d83ece06524f0aa0ca5b3f0a77160c21cdb3115dd.scope: Deactivated successfully. machine # [ 54.745553] systemd[1]: cri-containerd-eca781c81a76d8c56546f10d83ece06524f0aa0ca5b3f0a77160c21cdb3115dd.scope: Consumed 646ms CPU time over 1.350s wall clock time, 31.7M memory peak, 2.4M incoming IP traffic, 141.4K outgoing IP traffic. machine # [ 54.821700] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-eca781c81a76d8c56546f10d83ece06524f0aa0ca5b3f0a77160c21cdb3115dd-rootfs.mount: Deactivated successfully. machine # [ 55.405324] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod91544363_f2ed_4324_8fe3_fa57022621dd.slice. machine # [ 55.429324] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod82ec1127_d4ad_4ff1_a848_2ffafa9ab87e.slice. machine # [ 55.445898] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod0e7148ab_4ce3_437a_8393_2bbdd223db3f.slice. machine # [ 55.462640] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod9f709e6d_6a8a_4cb2_9dbe_ed1bcab4a2f5.slice. machine # [ 55.499245] k3s[873]: I0921 16:48:44.049322 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-mzvgr\" (UID: \"91544363-f2ed-4324-8fe3-fa57022621dd\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-mzvgr" machine # [ 55.504933] k3s[873]: I0921 16:48:44.049367 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0e7148ab-4ce3-437a-8393-2bbdd223db3f-ca\") pod \"nix-grpc-farm-scheduler-5844ddf54b-8rh7p\" (UID: \"0e7148ab-4ce3-437a-8393-2bbdd223db3f\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-8rh7p" machine # [ 55.510524] k3s[873]: I0921 16:48:44.049397 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/82ec1127-d4ad-4ff1-a848-2ffafa9ab87e-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp\" (UID: \"82ec1127-d4ad-4ff1-a848-2ffafa9ab87e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" machine # [ 55.516993] k3s[873]: I0921 16:48:44.049423 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/91544363-f2ed-4324-8fe3-fa57022621dd-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-mzvgr\" (UID: \"91544363-f2ed-4324-8fe3-fa57022621dd\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-mzvgr" machine # [ 55.523164] k3s[873]: I0921 16:48:44.049550 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-mzvgr\" (UID: \"91544363-f2ed-4324-8fe3-fa57022621dd\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-mzvgr" machine # [ 55.529311] k3s[873]: I0921 16:48:44.049599 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0e7148ab-4ce3-437a-8393-2bbdd223db3f-oidc\") pod \"nix-grpc-farm-scheduler-5844ddf54b-8rh7p\" (UID: \"0e7148ab-4ce3-437a-8393-2bbdd223db3f\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-8rh7p" machine # [ 55.535570] k3s[873]: I0921 16:48:44.049711 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/82ec1127-d4ad-4ff1-a848-2ffafa9ab87e-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp\" (UID: \"82ec1127-d4ad-4ff1-a848-2ffafa9ab87e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" machine # [ 55.542049] k3s[873]: I0921 16:48:44.049816 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/82ec1127-d4ad-4ff1-a848-2ffafa9ab87e-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp\" (UID: \"82ec1127-d4ad-4ff1-a848-2ffafa9ab87e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" machine # [ 55.547780] k3s[873]: I0921 16:48:44.049915 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv\" (UID: \"9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" machine # [ 55.554046] k3s[873]: I0921 16:48:44.049999 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv\" (UID: \"9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" machine # [ 55.560703] k3s[873]: I0921 16:48:44.050038 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/82ec1127-d4ad-4ff1-a848-2ffafa9ab87e-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp\" (UID: \"82ec1127-d4ad-4ff1-a848-2ffafa9ab87e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" machine # [ 55.566882] k3s[873]: I0921 16:48:44.050086 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfggl\" (UniqueName: \"kubernetes.io/projected/82ec1127-d4ad-4ff1-a848-2ffafa9ab87e-kube-api-access-wfggl\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp\" (UID: \"82ec1127-d4ad-4ff1-a848-2ffafa9ab87e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" machine # [ 55.573442] k3s[873]: I0921 16:48:44.050148 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv\" (UID: \"9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" machine # [ 55.579516] k3s[873]: I0921 16:48:44.050244 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv\" (UID: \"9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" machine # [ 55.584957] k3s[873]: I0921 16:48:44.050333 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0e7148ab-4ce3-437a-8393-2bbdd223db3f-niks3-token\") pod \"nix-grpc-farm-scheduler-5844ddf54b-8rh7p\" (UID: \"0e7148ab-4ce3-437a-8393-2bbdd223db3f\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-8rh7p" machine # [ 55.590957] k3s[873]: I0921 16:48:44.050364 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/82ec1127-d4ad-4ff1-a848-2ffafa9ab87e-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp\" (UID: \"82ec1127-d4ad-4ff1-a848-2ffafa9ab87e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" machine # [ 55.597155] k3s[873]: I0921 16:48:44.050396 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/82ec1127-d4ad-4ff1-a848-2ffafa9ab87e-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp\" (UID: \"82ec1127-d4ad-4ff1-a848-2ffafa9ab87e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" machine # [ 55.603476] k3s[873]: I0921 16:48:44.050436 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv\" (UID: \"9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" machine # [ 55.609672] k3s[873]: I0921 16:48:44.050547 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91544363-f2ed-4324-8fe3-fa57022621dd-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-mzvgr\" (UID: \"91544363-f2ed-4324-8fe3-fa57022621dd\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-mzvgr" machine # [ 55.617189] k3s[873]: I0921 16:48:44.050676 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0e7148ab-4ce3-437a-8393-2bbdd223db3f-tls\") pod \"nix-grpc-farm-scheduler-5844ddf54b-8rh7p\" (UID: \"0e7148ab-4ce3-437a-8393-2bbdd223db3f\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-8rh7p" machine # [ 55.623226] k3s[873]: I0921 16:48:44.050764 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv\" (UID: \"9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" machine # [ 55.631181] k3s[873]: I0921 16:48:44.050795 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv\" (UID: \"9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" machine # [ 55.632112] k3s[873]: I0921 16:48:44.050831 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dbjp\" (UniqueName: \"kubernetes.io/projected/0e7148ab-4ce3-437a-8393-2bbdd223db3f-kube-api-access-5dbjp\") pod \"nix-grpc-farm-scheduler-5844ddf54b-8rh7p\" (UID: \"0e7148ab-4ce3-437a-8393-2bbdd223db3f\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-8rh7p" machine # [ 55.632644] k3s[873]: I0921 16:48:44.050866 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/82ec1127-d4ad-4ff1-a848-2ffafa9ab87e-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp\" (UID: \"82ec1127-d4ad-4ff1-a848-2ffafa9ab87e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" machine # [ 55.633216] k3s[873]: I0921 16:48:44.050908 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdfn4\" (UniqueName: \"kubernetes.io/projected/9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5-kube-api-access-gdfn4\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv\" (UID: \"9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" machine # [ 55.789596] (udev-worker)[2062]: Network interface NamePolicy= disabled on kernel command line. machine # [ 55.947815] cni0: port 3(veth6d19ab59) entered blocking state machine # [ 55.948973] cni0: port 3(veth6d19ab59) entered disabled state machine # [ 55.950313] veth6d19ab59: entered allmulticast mode machine # [ 55.951505] veth6d19ab59: entered promiscuous mode machine # [ 55.815698] (udev-worker)[2224]: Network interface NamePolicy= disabled on kernel command line. machine # [ 55.971680] cni0: port 4(vethfbc38cb5) entered blocking state machine # [ 55.973975] cni0: port 4(vethfbc38cb5) entered disabled state machine # [ 55.977154] vethfbc38cb5: entered allmulticast mode machine # [ 55.978838] vethfbc38cb5: entered promiscuous mode machine # [ 55.981463] cni0: port 3(veth6d19ab59) entered blocking state machine # [ 55.982402] cni0: port 3(veth6d19ab59) entered forwarding state machine # [ 55.843119] (udev-worker)[2234]: Network interface NamePolicy= disabled on kernel command line. machine # [ 55.998557] cni0: port 5(vethd3057af2) entered blocking state machine # [ 55.999749] cni0: port 5(vethd3057af2) entered disabled state machine # [ 56.001487] vethd3057af2: entered allmulticast mode machine # [ 56.002376] vethd3057af2: entered promiscuous mode machine # [ 56.005218] cni0: port 4(vethfbc38cb5) entered blocking state machine # [ 56.006534] cni0: port 4(vethfbc38cb5) entered forwarding state machine # [ 56.019228] cni0: port 5(vethd3057af2) entered blocking state machine # [ 56.020090] cni0: port 5(vethd3057af2) entered forwarding state machine # [ 55.895699] dhcpcd[677]: veth6d19ab59: waiting for carrier machine # [ 55.919514] dhcpcd[677]: vethfbc38cb5: IAID b7:15:72:7a machine # [ 55.920081] dhcpcd[677]: vethfbc38cb5: adding address fe80::815:b7ff:fe15:727a machine # [ 55.939655] dhcpcd[677]: vethd3057af2: IAID 9f:63:ca:78 machine # [ 55.940808] dhcpcd[677]: vethd3057af2: adding address fe80::1ce7:9fff:fe63:ca78 machine # [ 55.941660] dhcpcd[677]: vethfbc38cb5: carrier lost machine # [ 55.986872] dhcpcd[677]: vethfbc38cb5: deleting address fe80::815:b7ff:fe15:727a machine # [ 55.988882] dhcpcd[677]: veth6d19ab59: carrier acquired machine # [ 56.000083] dhcpcd[677]: veth6d19ab59: IAID 44:39:fc:ae machine # [ 56.001412] dhcpcd[677]: veth6d19ab59: adding address fe80::70f0:44ff:fe39:fcae machine # [ 56.002874] dhcpcd[677]: vethd3057af2: old hardware address: 1e:e7:9f:63:ca:78 machine # [ 56.005067] systemd[1]: Started libcontainer container 58314da3d07583e452ca4b1f2bd17a91e1f21a2f451e58f7afdf2132dc36b9fb. machine # [ 56.007111] dhcpcd[677]: vethd3057af2: new hardware address: 62:34:6f:1e:2e:07 machine # [ 56.008757] dhcpcd[677]: vethd3057af2: carrier lost machine # [ 56.024439] systemd[1]: Started libcontainer container 47c09102eebccf21fdd2d55043cbc32cecaadbe2470aef9d307541ea60bc3c5b. machine # [ 56.039514] systemd[1]: Started libcontainer container 7c89f8eaa341d60fa06dbb14e211ad0c953750a7cd0cfec7c8c2f740c115ead1. machine # [ 56.059464] dhcpcd[677]: vethd3057af2: deleting address fe80::1ce7:9fff:fe63:ca78 machine # [ 56.060885] dhcpcd[677]: vethd3057af2: old hardware address: 62:34:6f:1e:2e:07 machine # [ 56.062793] dhcpcd[677]: vethd3057af2: new hardware address: 1e:e7:9f:63:ca:78 machine # [ 56.064346] dhcpcd[677]: vethfbc38cb5: carrier acquired machine # [ 56.080379] dhcpcd[677]: vethfbc38cb5: IAID b7:15:72:7a machine # [ 56.081235] dhcpcd[677]: vethfbc38cb5: adding address fe80::815:b7ff:fe15:727a machine # [ 56.084517] dhcpcd[677]: vethd3057af2: carrier acquired machine # [ 56.249731] cni0: port 6(veth3a231a08) entered blocking state machine # [ 56.251386] cni0: port 6(veth3a231a08) entered disabled state machine # [ 56.099137] dhcpcd[677]: vethd3057af2: IAID 9[ 56.253126] veth3a231a08: entered allmulticast mode machine # f:63:ca:78 machine # [ 56.099767] dhcpcd[677]: veth[ 56.254165] veth3a231a08: entered promiscuous mode machine # d3057af2: adding address fe80::1ce7:9fff:fe63:ca78 machine # [ 56.279489] cni0: port 6(veth3a231a08) entered blocking state machine # [ 56.280687] cni0: port 6(veth3a231a08) entered forwarding state machine # [ 56.150322] k3s[873]: E0921 16:48:44.700083 873 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 56.152628] k3s[873]: E0921 16:48:44.702440 873 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 56.153675] k3s[873]: E0921 16:48:44.702707 873 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp_farm(82ec1127-d4ad-4ff1-a848-2ffafa9ab87e): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 56.154692] k3s[873]: E0921 16:48:44.702779 873 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" podUID="82ec1127-d4ad-4ff1-a848-2ffafa9ab87e" machine # [ 56.184574] k3s[873]: E0921 16:48:44.734661 873 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 56.186240] k3s[873]: E0921 16:48:44.734731 873 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 56.189228] k3s[873]: E0921 16:48:44.739341 873 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 56.190069] k3s[873]: E0921 16:48:44.739388 873 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 56.211784] k3s[873]: E0921 16:48:44.761870 873 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-5844ddf54b-8rh7p_farm(0e7148ab-4ce3-437a-8393-2bbdd223db3f): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 56.213092] k3s[873]: E0921 16:48:44.761952 873 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-8rh7p" podUID="0e7148ab-4ce3-437a-8393-2bbdd223db3f" machine # [ 56.214054] k3s[873]: E0921 16:48:44.762103 873 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv_farm(9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 56.214706] k3s[873]: E0921 16:48:44.763392 873 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" podUID="9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5" machine # [ 56.233717] dhcpcd[677]: veth3a231a08: waiting for carrier machine # [ 56.234805] dhcpcd[677]: veth3a231a08: carrier acquired machine # [ 56.251985] dhcpcd[677]: veth3a231a08: IAID 61:52:57:ab machine # [ 56.252821] dhcpcd[677]: veth3a231a08: adding address fe80::7c0d:61ff:fe52:57ab machine # [ 56.321414] systemd[1]: Started libcontainer container 3c796da8642e538d9ce2d1a51724cc0c6202112e079a85568ede6eac1fdc2536. machine # [ 56.741928] k3s[873]: E0921 16:48:45.292005 873 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" podUID="9f709e6d-6a8a-4cb2-9dbe-ed1bcab4a2f5" machine # [ 56.744699] k3s[873]: E0921 16:48:45.294676 873 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-8rh7p" podUID="0e7148ab-4ce3-437a-8393-2bbdd223db3f" machine # [ 56.752075] k3s[873]: E0921 16:48:45.301613 873 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" podUID="82ec1127-d4ad-4ff1-a848-2ffafa9ab87e" machine # [ 56.776672] systemd[1]: cri-containerd-4b9e5a68fdc8d7da96e807cd771f853f3a1d657499d0ec1a4723d6f93c6e6519.scope: Deactivated successfully. machine # [ 56.826308] systemd[1]: Started libcontainer container 41ea40f2a11835ce035a7e4862b8b68b847a980f53f3ff0de9ebe0539149e29b. machine # [ 56.856832] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4b9e5a68fdc8d7da96e807cd771f853f3a1d657499d0ec1a4723d6f93c6e6519-rootfs.mount: Deactivated successfully. machine # [ 56.895197] dhcpcd[677]: vethfbc38cb5: soliciting a DHCP lease machine # [ 57.000472] dhcpcd[677]: vethd3057af2: soliciting a DHCP lease machine # [ 57.016604] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-4b9e5a68fdc8d7da96e807cd771f853f3a1d657499d0ec1a4723d6f93c6e6519-shm.mount: Deactivated successfully. machine # [ 57.224233] cni0: port 1(veth14609cb8) entered disabled state machine # [ 57.071018] dhcpcd[677]: veth14609cb8: carrier lost machine # [ 57.226528] veth14609cb8 (unregistering): left allmulticast mode machine # [ 57.227615] veth14609cb8 (unregistering): left promiscuous mode machine # [ 57.228715] cni0: port 1(veth14609cb8) entered disabled state machine # [ 57.098230] systemd[1]: run-netns-cni\x2df6b07843\x2ddb1a\x2db31e\x2dee09\x2d337bdb161a95.mount: Deactivated successfully. machine # [ 57.125331] dhcpcd[677]: veth14609cb8: deleting address fe80::6457:a5ff:fe3c:73cc machine # [ 57.190241] dhcpcd[677]: veth7893f599: probing for an IPv4LL address machine # [ 57.195453] dhcpcd[677]: veth14609cb8: removing interface machine # [ 57.218286] k3s[873]: I0921 16:48:45.767999 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-helm\") pod \"ef227acd-fdb0-4356-87a5-4936edcf5215\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " machine # [ 57.219222] k3s[873]: I0921 16:48:45.768048 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-tmp\") pod \"ef227acd-fdb0-4356-87a5-4936edcf5215\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " machine # [ 57.219586] k3s[873]: I0921 16:48:45.768075 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-config\") pod \"ef227acd-fdb0-4356-87a5-4936edcf5215\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " machine # [ 57.220900] k3s[873]: I0921 16:48:45.768105 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef227acd-fdb0-4356-87a5-4936edcf5215-content\" (UniqueName: \"kubernetes.io/configmap/ef227acd-fdb0-4356-87a5-4936edcf5215-content\") pod \"ef227acd-fdb0-4356-87a5-4936edcf5215\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " machine # [ 57.221394] k3s[873]: I0921 16:48:45.768133 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-cache\") pod \"ef227acd-fdb0-4356-87a5-4936edcf5215\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " machine # [ 57.222373] k3s[873]: I0921 16:48:45.768179 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-kube-api-access-qnj9l\" (UniqueName: \"kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-kube-api-access-qnj9l\") pod \"ef227acd-fdb0-4356-87a5-4936edcf5215\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " machine # [ 57.222847] k3s[873]: I0921 16:48:45.768234 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-values\" (UniqueName: \"kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-values\") pod \"ef227acd-fdb0-4356-87a5-4936edcf5215\" (UID: \"ef227acd-fdb0-4356-87a5-4936edcf5215\") " machine # [ 57.223794] k3s[873]: I0921 16:48:45.769173 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef227acd-fdb0-4356-87a5-4936edcf5215-content" pod "ef227acd-fdb0-4356-87a5-4936edcf5215" (UID: "ef227acd-fdb0-4356-87a5-4936edcf5215"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 57.226444] systemd[1]: var-lib-kubelet-pods-ef227acd\x2dfdb0\x2d4356\x2d87a5\x2d4936edcf5215-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 57.269624] k3s[873]: I0921 16:48:45.819596 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-config" pod "ef227acd-fdb0-4356-87a5-4936edcf5215" (UID: "ef227acd-fdb0-4356-87a5-4936edcf5215"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 57.270739] k3s[873]: I0921 16:48:45.819751 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-tmp" pod "ef227acd-fdb0-4356-87a5-4936edcf5215" (UID: "ef227acd-fdb0-4356-87a5-4936edcf5215"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 57.271325] k3s[873]: I0921 16:48:45.819856 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-cache" pod "ef227acd-fdb0-4356-87a5-4936edcf5215" (UID: "ef227acd-fdb0-4356-87a5-4936edcf5215"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 57.272112] k3s[873]: I0921 16:48:45.820382 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-kube-api-access-qnj9l" pod "ef227acd-fdb0-4356-87a5-4936edcf5215" (UID: "ef227acd-fdb0-4356-87a5-4936edcf5215"). InnerVolumeSpecName "kube-api-access-qnj9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 57.272703] k3s[873]: I0921 16:48:45.820580 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-helm" pod "ef227acd-fdb0-4356-87a5-4936edcf5215" (UID: "ef227acd-fdb0-4356-87a5-4936edcf5215"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 57.294656] k3s[873]: I0921 16:48:45.844760 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-values" pod "ef227acd-fdb0-4356-87a5-4936edcf5215" (UID: "ef227acd-fdb0-4356-87a5-4936edcf5215"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 57.319469] k3s[873]: I0921 16:48:45.869558 873 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnj9l\" (UniqueName: \"kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-kube-api-access-qnj9l\") on node \"machine\" DevicePath \"\"" machine # [ 57.320080] k3s[873]: I0921 16:48:45.869603 873 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/ef227acd-fdb0-4356-87a5-4936edcf5215-values\") on node \"machine\" DevicePath \"\"" machine # [ 57.320187] k3s[873]: I0921 16:48:45.869620 873 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 57.320378] k3s[873]: I0921 16:48:45.869633 873 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 57.320857] k3s[873]: I0921 16:48:45.869646 873 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 57.321529] k3s[873]: I0921 16:48:45.869658 873 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/ef227acd-fdb0-4356-87a5-4936edcf5215-content\") on node \"machine\" DevicePath \"\"" machine # [ 57.322239] k3s[873]: I0921 16:48:45.869671 873 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef227acd-fdb0-4356-87a5-4936edcf5215-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 57.470700] dhcpcd[677]: veth6d19ab59: soliciting an IPv6 router machine # [ 57.536027] dhcpcd[677]: veth6d19ab59: soliciting a DHCP lease machine # [ 57.599386] dhcpcd[677]: flannel.1: probing for an IPv4LL address machine # [ 57.755305] k3s[873]: I0921 16:48:46.305373 873 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b9e5a68fdc8d7da96e807cd771f853f3a1d657499d0ec1a4723d6f93c6e6519" machine # [ 57.766558] systemd[1]: Removed slice libcontainer container kubepods-burstable-podef227acd_fdb0_4356_87a5_4936edcf5215.slice. machine # [ 57.768419] systemd[1]: kubepods-burstable-podef227acd_fdb0_4356_87a5_4936edcf5215.slice: Consumed 680ms CPU time over 6.256s wall clock time, 32.1M memory peak, 2.4M incoming IP traffic, 141.4K outgoing IP traffic. machine # [ 57.816581] dhcpcd[677]: vethfbc38cb5: soliciting an IPv6 router machine # [ 57.825697] systemd[1]: var-lib-kubelet-pods-ef227acd\x2dfdb0\x2d4356\x2d87a5\x2d4936edcf5215-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 57.828628] systemd[1]: var-lib-kubelet-pods-ef227acd\x2dfdb0\x2d4356\x2d87a5\x2d4936edcf5215-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dqnj9l.mount: Deactivated successfully. machine # [ 57.829617] systemd[1]: var-lib-kubelet-pods-ef227acd\x2dfdb0\x2d4356\x2d87a5\x2d4936edcf5215-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 57.830183] systemd[1]: var-lib-kubelet-pods-ef227acd\x2dfdb0\x2d4356\x2d87a5\x2d4936edcf5215-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 57.830802] systemd[1]: var-lib-kubelet-pods-ef227acd\x2dfdb0\x2d4356\x2d87a5\x2d4936edcf5215-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 57.956995] dhcpcd[677]: veth3a231a08: soliciting a DHCP lease machine # [ 58.141742] k3s[873]: I0921 16:48:46.691802 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-mzvgr" podStartSLOduration=3.691774647 podStartE2EDuration="3.691774647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 16:48:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 16:48:46.316085558 +0000 UTC m=+37.242287773" watchObservedRunningTime="2026-09-21 16:48:46.691774647 +0000 UTC m=+37.617976862" machine # [ 58.523558] dhcpcd[677]: veth3a231a08: soliciting an IPv6 router machine # [ 59.115523] dhcpcd[677]: vethd3057af2: soliciting an IPv6 router machine # [ 60.656614] k3s[873]: time="2026-09-21T16:48:49Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.1" machine # [ 60.660926] k3s[873]: time="2026-09-21T16:48:49Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:1224421f1da3fcd57127c3e52c4acf6e78ad366a6ceee6e6f9379b8e414830fa" machine # [ 60.950077] k3s[873]: time="2026-09-21T16:48:49Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 10.71156753s" machine # [ 61.564098] dhcpcd[677]: veth7893f599: using IPv4LL address 169.254.237.222 machine # [ 61.566732] dhcpcd[677]: veth7893f599: adding route to 169.254.0.0/16 machine # [ 61.896588] dhcpcd[677]: vethfbc38cb5: probing for an IPv4LL address machine # [ 62.000921] dhcpcd[677]: vethd3057af2: probing for an IPv4LL address machine # [ 62.531047] dhcpcd[677]: flannel.1: using IPv4LL address 169.254.200.110 machine # [ 62.533767] dhcpcd[677]: flannel.1: adding route to 169.254.0.0/16 machine # [ 62.615638] dhcpcd[677]: veth6d19ab59: probing for an IPv4LL address machine # [ 62.958372] dhcpcd[677]: veth3a231a08: probing for an IPv4LL address machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 35.06 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 65.854312] dhcpcd[677]: flannel.1: no IPv6 Routers available machine # [ 66.349550] dhcpcd[677]: veth7893f599: no IPv6 Routers available machine # [ 66.729532] dhcpcd[677]: vethd3057af2: using IPv4LL address 169.254.12.118 machine # [ 66.732082] dhcpcd[677]: vethd3057af2: adding route to 169.254.0.0/16 machine # [ 66.945910] dhcpcd[677]: veth6d19ab59: using IPv4LL address 169.254.32.5 machine # [ 66.949328] dhcpcd[677]: veth6d19ab59: adding route to 169.254.0.0/16 machine # [ 67.030276] dhcpcd[677]: vethfbc38cb5: using IPv4LL address 169.254.20.103 machine # [ 67.033884] dhcpcd[677]: vethfbc38cb5: adding route to 169.254.0.0/16 machine # [ 67.973174] dhcpcd[677]: veth3a231a08: using IPv4LL address 169.254.7.156 machine # [ 67.976360] dhcpcd[677]: veth3a231a08: adding route to 169.254.0.0/16 machine # [ 69.474932] dhcpcd[677]: veth6d19ab59: no IPv6 Routers available machine # [ 69.741652] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2529496476.mount: Deactivated successfully. machine # [ 69.819633] dhcpcd[677]: vethfbc38cb5: no IPv6 Routers available machine # [ 70.527991] dhcpcd[677]: veth3a231a08: no IPv6 Routers available machine # [ 70.765917] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2786366298.mount: Deactivated successfully. machine # [ 71.118733] dhcpcd[677]: vethd3057af2: no IPv6 Routers available machine # [ 73.673912] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3602551607.mount: Deactivated successfully. machine # [ 73.679667] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount711182745.mount: Deactivated successfully. machine # [ 73.775307] systemd[1]: Started libcontainer container d666f0c61eed71f4524d13150d32c9c9245215b158c08562d073642e1838bff4. machine # [ 74.429451] systemd[1]: Started libcontainer container 8b3091865c1f09aeb011fa1451f101f91f2e679d3719e631c9e45916d3d7ed28. machine # [ 74.539475] systemd[1]: Started libcontainer container b90ced9cbd0a3e9e3c295254999948b52195436b5b9eeb7b04667d6eef2a370e. machine # [ 74.624437] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1364289136.mount: Deactivated successfully. machine # [ 74.703322] niks3-server[1195]: 2026/09/21 16:49:03 INFO lead: acquired remote=10.42.0.5:46936 machine # [ 74.850316] k3s[873]: I0921 16:49:03.400060 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-8rh7p" podStartSLOduration=5.880915166 podStartE2EDuration="20.400038125s" totalImagesPullingTime="14.519122959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 16:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 16:49:03.399754849 +0000 UTC m=+54.325957064" watchObservedRunningTime="2026-09-21 16:49:03.400038125 +0000 UTC m=+54.326240341" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 10.01 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 75.464277] systemd[1]: cri-containerd-d666f0c61eed71f4524d13150d32c9c9245215b158c08562d073642e1838bff4.scope: Deactivated successfully. machine # [ 75.466030] systemd[1]: cri-containerd-d666f0c61eed71f4524d13150d32c9c9245215b158c08562d073642e1838bff4.scope: Consumed 685ms CPU time over 1.688s wall clock time, 429.6M memory peak, 201.9M read from disk, 224.3M written to disk. machine # [ 75.468750] systemd[1]: cri-containerd-b90ced9cbd0a3e9e3c295254999948b52195436b5b9eeb7b04667d6eef2a370e.scope: Deactivated successfully. machine # [ 75.470806] systemd[1]: cri-containerd-b90ced9cbd0a3e9e3c295254999948b52195436b5b9eeb7b04667d6eef2a370e.scope: Consumed 532ms CPU time over 926ms wall clock time, 335.9M memory peak, 23.1M read from disk, 220.1M written to disk. machine # [ 75.531135] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d666f0c61eed71f4524d13150d32c9c9245215b158c08562d073642e1838bff4-rootfs.mount: Deactivated successfully. machine # [ 75.535561] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b90ced9cbd0a3e9e3c295254999948b52195436b5b9eeb7b04667d6eef2a370e-rootfs.mount: Deactivated successfully. machine # [ 75.911132] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2806636792.mount: Deactivated successfully. machine # [ 76.058296] systemd[1]: Started libcontainer container 1bfab70136ce33ed9a7cd20c3e08471a4a4fbd3240da62b62bed1bc4a8e77743. machine # [ 76.061721] systemd[1]: Started libcontainer container afc6b627ab127e267785f5fcad447685224b181dbc1865a7c4267f5965810de3. machine # [ 76.233352] systemd[1]: Started libcontainer container a77b9e5d79aa8a9fb6b520a0140f1dcf0236a7e3420074a18b6c37e6b63f5ee0. machine # [ 76.236957] systemd[1]: Started libcontainer container 8f58d4e798e1ad592ef4a261fcf12906434acd0342ab1a9374dfb23962855166. machine # [ 76.472577] systemd[1]: Started libcontainer container a528b9da1f223eb787ff4d491edef1e79041ce06987fc480acbec594e5e2ab1b. machine # [ 76.476076] systemd[1]: Started libcontainer container 1d927d7af814f59b229e61c0249f03cac1f762579ac063fdbfb54cc354a0af4e. machine # [ 76.892102] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3834302221.mount: Deactivated successfully. machine # [ 76.895331] k3s[873]: I0921 16:49:05.441944 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp" podStartSLOduration=7.23425728 podStartE2EDuration="22.441898752s" totalImagesPullingTime="13.54791796s" totalInitContainerRuntime="1.659723512s" isStatefulPod=false podCreationTimestamp="2026-09-21 16:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 16:49:05.441364886 +0000 UTC m=+56.367571850" watchObservedRunningTime="2026-09-21 16:49:05.441898752 +0000 UTC m=+56.368105438" machine # [ 76.897421] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped532415137.mount: Deactivated successfully. machine # [ 76.939671] k3s[873]: I0921 16:49:05.489680 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv" podStartSLOduration=7.072765805 podStartE2EDuration="22.489647279s" totalImagesPullingTime="14.521065106s" totalInitContainerRuntime="895.816368ms" isStatefulPod=false podCreationTimestamp="2026-09-21 16:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 16:49:05.487849565 +0000 UTC m=+56.414055132" watchObservedRunningTime="2026-09-21 16:49:05.489647279 +0000 UTC m=+56.415852568" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 6.09 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.10 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.33 seconds) machine: waiting for success: test $(curl -sf 10.42.0.7:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.7:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 1.24 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.33 seconds) machine: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.09 seconds) (finished: subtest: chart deploys and workers become Ready, in 53.24 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.27 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.26 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1 machine # [ 113.944554] niks3-server[1195]: 2026/09/21 16:49:42 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 113.984058] niks3-server[1195]: 2026/09/21 16:49:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 113.992030] niks3-server[1195]: 2026/09/21 16:49:42 INFO Signed narinfos id=1 count=1 machine # [ 113.997655] niks3-server[1195]: 2026/09/21 16:49:42 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 113.999790] niks3-server[1195]: 2026/09/21 16:49:42 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 114.001730] niks3-server[1195]: 2026/09/21 16:49:42 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 114.004607] niks3-server[1195]: 2026/09/21 16:49:42 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 114.007320] niks3-server[1195]: 2026/09/21 16:49:42 INFO Completed upload id=1 machine # [ 122.489355] niks3-server[1195]: 2026/09/21 16:49:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 122.518602] niks3-server[1195]: 2026/09/21 16:49:51 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 122.521232] niks3-server[1195]: 2026/09/21 16:49:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 122.523883] niks3-server[1195]: 2026/09/21 16:49:51 INFO Signed narinfos id=2 count=1 machine # [ 122.526657] niks3-server[1195]: 2026/09/21 16:49:51 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 122.535699] niks3-server[1195]: 2026/09/21 16:49:51 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 122.537695] niks3-server[1195]: 2026/09/21 16:49:51 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 122.540088] niks3-server[1195]: 2026/09/21 16:49:51 INFO Completed upload id=2 machine # [ 122.541657] niks3-server[1195]: 2026/09/21 16:49:51 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 122.631093] niks3-server[1195]: 2026/09/21 16:49:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 122.643845] niks3-server[1195]: 2026/09/21 16:49:51 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 122.647379] niks3-server[1195]: 2026/09/21 16:49:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 122.649276] niks3-server[1195]: 2026/09/21 16:49:51 INFO Signed narinfos id=3 count=1 machine # [ 122.650494] niks3-server[1195]: 2026/09/21 16:49:51 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 122.652388] niks3-server[1195]: 2026/09/21 16:49:51 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 122.654291] niks3-server[1195]: 2026/09/21 16:49:51 INFO Completed upload id=3 machine # [ 122.655415] niks3-server[1195]: 2026/09/21 16:49:51 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 131.732801] niks3-server[1195]: 2026/09/21 16:50:00 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 131.758401] niks3-server[1195]: 2026/09/21 16:50:00 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 131.762624] niks3-server[1195]: 2026/09/21 16:50:00 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 131.766992] niks3-server[1195]: 2026/09/21 16:50:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 131.768352] niks3-server[1195]: 2026/09/21 16:50:00 INFO Signed narinfos id=4 count=1 machine # [ 131.775423] niks3-server[1195]: 2026/09/21 16:50:00 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 131.779524] niks3-server[1195]: 2026/09/21 16:50:00 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 131.783164] niks3-server[1195]: 2026/09/21 16:50:00 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 131.785715] niks3-server[1195]: 2026/09/21 16:50:00 INFO Completed upload id=4 machine # [ 131.871067] niks3-server[1195]: 2026/09/21 16:50:00 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 131.883052] niks3-server[1195]: 2026/09/21 16:50:00 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 131.887284] niks3-server[1195]: 2026/09/21 16:50:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 131.889307] niks3-server[1195]: 2026/09/21 16:50:00 INFO Signed narinfos id=5 count=1 machine # [ 131.891677] niks3-server[1195]: 2026/09/21 16:50:00 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 131.895292] niks3-server[1195]: 2026/09/21 16:50:00 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 131.897407] niks3-server[1195]: 2026/09/21 16:50:00 INFO Completed upload id=5 machine # [ 131.899546] niks3-server[1195]: 2026/09/21 16:50:00 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 140.372048] niks3-server[1195]: 2026/09/21 16:50:08 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 140.397148] niks3-server[1195]: 2026/09/21 16:50:08 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 140.399314] niks3-server[1195]: 2026/09/21 16:50:08 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 140.401643] niks3-server[1195]: 2026/09/21 16:50:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 140.402619] niks3-server[1195]: 2026/09/21 16:50:08 INFO Signed narinfos id=6 count=1 machine # [ 140.410810] niks3-server[1195]: 2026/09/21 16:50:08 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 140.413542] niks3-server[1195]: 2026/09/21 16:50:08 INFO Completed upload id=6 machine # [ 140.415454] niks3-server[1195]: 2026/09/21 16:50:08 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 140.423448] niks3-server[1195]: 2026/09/21 16:50:08 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1, in 57.92 seconds) machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath, in 0.29 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.03 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.36 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1 machine # [ 142.619867] niks3-server[1195]: 2026/09/21 16:50:11 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 142.647950] niks3-server[1195]: 2026/09/21 16:50:11 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 142.651468] niks3-server[1195]: 2026/09/21 16:50:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 142.654283] niks3-server[1195]: 2026/09/21 16:50:11 INFO Signed narinfos id=7 count=1 machine # [ 142.656266] niks3-server[1195]: 2026/09/21 16:50:11 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 142.663938] niks3-server[1195]: 2026/09/21 16:50:11 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 142.668169] niks3-server[1195]: 2026/09/21 16:50:11 INFO Completed upload id=7 machine # [ 142.670469] niks3-server[1195]: 2026/09/21 16:50:11 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 151.731785] niks3-server[1195]: 2026/09/21 16:50:20 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 151.752759] niks3-server[1195]: 2026/09/21 16:50:20 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 151.754418] niks3-server[1195]: 2026/09/21 16:50:20 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 151.763143] niks3-server[1195]: 2026/09/21 16:50:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 151.765128] niks3-server[1195]: 2026/09/21 16:50:20 INFO Signed narinfos id=8 count=1 machine # [ 151.771702] niks3-server[1195]: 2026/09/21 16:50:20 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 151.774790] niks3-server[1195]: 2026/09/21 16:50:20 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 151.778548] niks3-server[1195]: 2026/09/21 16:50:20 INFO Completed upload id=8 machine # [ 151.780144] niks3-server[1195]: 2026/09/21 16:50:20 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 151.876524] niks3-server[1195]: 2026/09/21 16:50:20 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 151.890585] niks3-server[1195]: 2026/09/21 16:50:20 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 151.894451] niks3-server[1195]: 2026/09/21 16:50:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 151.897619] niks3-server[1195]: 2026/09/21 16:50:20 INFO Signed narinfos id=9 count=1 machine # [ 151.899694] niks3-server[1195]: 2026/09/21 16:50:20 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 151.902877] niks3-server[1195]: 2026/09/21 16:50:20 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 151.905825] niks3-server[1195]: 2026/09/21 16:50:20 INFO Completed upload id=9 machine # [ 151.906814] niks3-server[1195]: 2026/09/21 16:50:20 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 160.581228] niks3-server[1195]: 2026/09/21 16:50:29 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 160.595792] niks3-server[1195]: 2026/09/21 16:50:29 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 160.598574] niks3-server[1195]: 2026/09/21 16:50:29 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 160.601703] niks3-server[1195]: 2026/09/21 16:50:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 160.602686] niks3-server[1195]: 2026/09/21 16:50:29 INFO Signed narinfos id=10 count=1 machine # [ 160.609388] niks3-server[1195]: 2026/09/21 16:50:29 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 160.611109] niks3-server[1195]: 2026/09/21 16:50:29 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 160.612209] niks3-server[1195]: 2026/09/21 16:50:29 INFO Completed upload id=10 machine # [ 160.709358] niks3-server[1195]: 2026/09/21 16:50:29 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 160.725711] niks3-server[1195]: 2026/09/21 16:50:29 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 160.727634] niks3-server[1195]: 2026/09/21 16:50:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 160.729356] niks3-server[1195]: 2026/09/21 16:50:29 INFO Signed narinfos id=11 count=1 machine # [ 160.730492] niks3-server[1195]: 2026/09/21 16:50:29 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 160.732039] niks3-server[1195]: 2026/09/21 16:50:29 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 160.733876] niks3-server[1195]: 2026/09/21 16:50:29 INFO Completed upload id=11 machine # [ 160.734956] niks3-server[1195]: 2026/09/21 16:50:29 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 169.015592] niks3-server[1195]: 2026/09/21 16:50:37 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 169.035895] niks3-server[1195]: 2026/09/21 16:50:37 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 169.038246] niks3-server[1195]: 2026/09/21 16:50:37 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 169.040094] niks3-server[1195]: 2026/09/21 16:50:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 169.042293] niks3-server[1195]: 2026/09/21 16:50:37 INFO Signed narinfos id=12 count=1 machine # [ 169.044954] niks3-server[1195]: 2026/09/21 16:50:37 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 169.050127] niks3-server[1195]: 2026/09/21 16:50:37 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 169.052840] niks3-server[1195]: 2026/09/21 16:50:37 INFO Completed upload id=12 machine # [ 169.057112] niks3-server[1195]: 2026/09/21 16:50:37 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1, in 26.93 seconds) (finished: subtest: build through the balancer lands in the cache, in 85.52 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.23 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix, in 0.23 seconds) machine: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json, in 0.32 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 170.780603] systemd[1]: Created slice libcontainer container kubepods-besteffort-podfbbb6a37_fd85_4403_a1d1_fa4f11f81390.slice. machine # [ 170.895055] k3s[873]: I0921 16:50:39.444729 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-nix-grpc-farm\") pod \"ci-qtwfc\" (UID: \"fbbb6a37-fd85-4403-a1d1-fa4f11f81390\") " pod="ci/ci-qtwfc" machine # [ 170.900365] k3s[873]: I0921 16:50:39.444780 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-job\") pod \"ci-qtwfc\" (UID: \"fbbb6a37-fd85-4403-a1d1-fa4f11f81390\") " pod="ci/ci-qtwfc" machine # [ 170.905499] k3s[873]: I0921 16:50:39.444822 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qlk\" (UniqueName: \"kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-kube-api-access-n7qlk\") pod \"ci-qtwfc\" (UID: \"fbbb6a37-fd85-4403-a1d1-fa4f11f81390\") " pod="ci/ci-qtwfc" machine # [ 172.194192] cni0: port 1(vetha1e48bcc) entered blocking state machine # [ 172.196210] cni0: port 1(vetha1e48bcc) entered disabled state machine # [ 172.199340] vetha1e48bcc: entered allmulticast mode machine # [ 172.202095] vetha1e48bcc: entered promiscuous mode machine # [ 172.224330] cni0: port 1(vetha1e48bcc) entered blocking state machine # [ 172.226587] cni0: port 1(vetha1e48bcc) entered forwarding state machine # [ 172.153067] (udev-worker)[4524]: Network interface NamePolicy= disabled on kernel command line. machine # [ 172.203253] dhcpcd[677]: vetha1e48bcc: IAID 42:5b:7b:a3 machine # [ 172.204078] dhcpcd[677]: vetha1e48bcc: adding address fe80::849a:42ff:fe5b:7ba3 machine # [ 172.206462] systemd[1]: Started libcontainer container 96c000fc17e0dc2e6bc96fa5fa30bd6e0d7c18812b5415c87c2a7b07e8cad33c. machine # [ 172.768590] dhcpcd[677]: vetha1e48bcc: soliciting a DHCP lease machine # [ 174.062084] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4108925033.mount: Deactivated successfully. machine # [ 174.124926] dhcpcd[677]: vetha1e48bcc: soliciting an IPv6 router machine # [ 174.129558] systemd[1]: Started libcontainer container 7334f5889d79a969573e5fbe8d512c81668e2818c87b256c52d841b235c24703. machine # [ 174.284087] k3s[873]: I0921 16:50:42.833539 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-qtwfc" podStartSLOduration=3.833503261 podStartE2EDuration="3.833503261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 16:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 16:50:42.833298207 +0000 UTC m=+153.759503216" watchObservedRunningTime="2026-09-21 16:50:42.833503261 +0000 UTC m=+153.759707991" machine # [ 175.668533] niks3-server[1195]: 2026/09/21 16:50:44 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 175.685370] niks3-server[1195]: 2026/09/21 16:50:44 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 175.687959] niks3-server[1195]: 2026/09/21 16:50:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 175.688934] niks3-server[1195]: 2026/09/21 16:50:44 INFO Signed narinfos id=13 count=1 machine # [ 175.690044] niks3-server[1195]: 2026/09/21 16:50:44 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 175.692836] niks3-server[1195]: 2026/09/21 16:50:44 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 175.694726] niks3-server[1195]: 2026/09/21 16:50:44 INFO Completed upload id=13 machine # [ 175.696643] niks3-server[1195]: 2026/09/21 16:50:44 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 177.770392] dhcpcd[677]: vetha1e48bcc: probing for an IPv4LL address machine # [ 182.493271] dhcpcd[677]: vetha1e48bcc: using IPv4LL address 169.254.110.141 machine # [ 182.495921] dhcpcd[677]: vetha1e48bcc: adding route to 169.254.0.0/16 machine # [ 184.780600] niks3-server[1195]: 2026/09/21 16:50:53 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 184.806397] niks3-server[1195]: 2026/09/21 16:50:53 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 184.809430] niks3-server[1195]: 2026/09/21 16:50:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 184.810605] niks3-server[1195]: 2026/09/21 16:50:53 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 184.811529] niks3-server[1195]: 2026/09/21 16:50:53 INFO Signed narinfos id=14 count=1 machine # [ 184.817050] niks3-server[1195]: 2026/09/21 16:50:53 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 184.818665] niks3-server[1195]: 2026/09/21 16:50:53 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 184.821162] niks3-server[1195]: 2026/09/21 16:50:53 INFO Completed upload id=14 machine # [ 184.823239] niks3-server[1195]: 2026/09/21 16:50:53 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 184.914819] niks3-server[1195]: 2026/09/21 16:50:53 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 184.929407] niks3-server[1195]: 2026/09/21 16:50:53 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 184.931933] niks3-server[1195]: 2026/09/21 16:50:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 184.933094] niks3-server[1195]: 2026/09/21 16:50:53 INFO Signed narinfos id=15 count=1 machine # [ 184.937246] niks3-server[1195]: 2026/09/21 16:50:53 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 184.941231] niks3-server[1195]: 2026/09/21 16:50:53 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 184.943083] niks3-server[1195]: 2026/09/21 16:50:53 INFO Completed upload id=15 machine # [ 184.946276] niks3-server[1195]: 2026/09/21 16:50:53 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 186.129311] dhcpcd[677]: vetha1e48bcc: no IPv6 Routers available machine # [ 194.005680] niks3-server[1195]: 2026/09/21 16:51:02 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 194.025168] niks3-server[1195]: 2026/09/21 16:51:02 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 194.026886] niks3-server[1195]: 2026/09/21 16:51:02 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 194.029676] niks3-server[1195]: 2026/09/21 16:51:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 194.031736] niks3-server[1195]: 2026/09/21 16:51:02 INFO Signed narinfos id=16 count=1 machine # [ 194.035395] niks3-server[1195]: 2026/09/21 16:51:02 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 194.039438] niks3-server[1195]: 2026/09/21 16:51:02 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 194.042387] niks3-server[1195]: 2026/09/21 16:51:02 INFO Completed upload id=16 machine # [ 194.045344] niks3-server[1195]: 2026/09/21 16:51:02 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 194.139956] niks3-server[1195]: 2026/09/21 16:51:02 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 194.151968] niks3-server[1195]: 2026/09/21 16:51:02 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 194.154262] niks3-server[1195]: 2026/09/21 16:51:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 194.155913] niks3-server[1195]: 2026/09/21 16:51:02 INFO Signed narinfos id=17 count=1 machine # [ 194.157118] niks3-server[1195]: 2026/09/21 16:51:02 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 194.162621] niks3-server[1195]: 2026/09/21 16:51:02 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 194.164652] niks3-server[1195]: 2026/09/21 16:51:02 INFO Completed upload id=17 machine # [ 194.167899] niks3-server[1195]: 2026/09/21 16:51:02 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 202.848737] niks3-server[1195]: 2026/09/21 16:51:11 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 202.867467] niks3-server[1195]: 2026/09/21 16:51:11 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 202.869043] niks3-server[1195]: 2026/09/21 16:51:11 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 202.871743] niks3-server[1195]: 2026/09/21 16:51:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 202.873284] niks3-server[1195]: 2026/09/21 16:51:11 INFO Signed narinfos id=18 count=1 machine # [ 202.875739] niks3-server[1195]: 2026/09/21 16:51:11 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 202.884795] niks3-server[1195]: 2026/09/21 16:51:11 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 202.886610] niks3-server[1195]: 2026/09/21 16:51:11 INFO Completed upload id=18 machine # [ 202.891155] niks3-server[1195]: 2026/09/21 16:51:11 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 204.536630] niks3-server[1195]: 2026/09/21 16:51:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 204.554775] niks3-server[1195]: 2026/09/21 16:51:13 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 204.557686] niks3-server[1195]: 2026/09/21 16:51:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 204.559312] niks3-server[1195]: 2026/09/21 16:51:13 INFO Signed narinfos id=19 count=1 machine # [ 204.561214] niks3-server[1195]: 2026/09/21 16:51:13 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 204.572754] niks3-server[1195]: 2026/09/21 16:51:13 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 204.575592] niks3-server[1195]: 2026/09/21 16:51:13 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 204.580586] niks3-server[1195]: 2026/09/21 16:51:13 INFO Completed upload id=19 machine # [ 213.465078] niks3-server[1195]: 2026/09/21 16:51:22 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 213.483899] niks3-server[1195]: 2026/09/21 16:51:22 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 213.485388] niks3-server[1195]: 2026/09/21 16:51:22 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 213.494816] niks3-server[1195]: 2026/09/21 16:51:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 213.495643] niks3-server[1195]: 2026/09/21 16:51:22 INFO Signed narinfos id=20 count=1 machine # [ 213.501356] niks3-server[1195]: 2026/09/21 16:51:22 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 213.501648] niks3-server[1195]: 2026/09/21 16:51:22 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 213.504644] niks3-server[1195]: 2026/09/21 16:51:22 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 213.507428] niks3-server[1195]: 2026/09/21 16:51:22 INFO Completed upload id=20 machine # [ 214.708159] systemd[1]: cri-containerd-7334f5889d79a969573e5fbe8d512c81668e2818c87b256c52d841b235c24703.scope: Deactivated successfully. machine # [ 214.711343] systemd[1]: cri-containerd-7334f5889d79a969573e5fbe8d512c81668e2818c87b256c52d841b235c24703.scope: Consumed 958ms CPU time over 40.580s wall clock time, 117.1M memory peak, 64.1M read from disk, 460K written to disk, 16.5K incoming IP traffic, 44.1K outgoing IP traffic. machine # [ 214.770145] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7334f5889d79a969573e5fbe8d512c81668e2818c87b256c52d841b235c24703-rootfs.mount: Deactivated successfully. machine # [ 216.463239] systemd[1]: cri-containerd-96c000fc17e0dc2e6bc96fa5fa30bd6e0d7c18812b5415c87c2a7b07e8cad33c.scope: Deactivated successfully. machine # [ 216.517935] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-96c000fc17e0dc2e6bc96fa5fa30bd6e0d7c18812b5415c87c2a7b07e8cad33c-rootfs.mount: Deactivated successfully. machine # [ 216.559316] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-96c000fc17e0dc2e6bc96fa5fa30bd6e0d7c18812b5415c87c2a7b07e8cad33c-shm.mount: Deactivated successfully. machine # [ 216.767840] cni0: port 1(vetha1e48bcc) entered disabled state machine # [ 216.616316] dhcpcd[677]: vetha1e48bcc: carrier lost machine # [ 216.772301] vetha1e48bcc (unregistering): left allmulticast mode machine # [ 216.773902] vetha1e48bcc (unregistering): left promiscuous mode machine # [ 216.775052] cni0: port 1(vetha1e48bcc) entered disabled state machine # [ 216.644498] systemd[1]: run-netns-cni\x2daa48f16d\x2dd483\x2d80e8\x2d4b81\x2d594a234b43a8.mount: Deactivated successfully. machine # [ 216.671424] dhcpcd[677]: vetha1e48bcc: deleting address fe80::849a:42ff:fe5b:7ba3 machine # [ 216.676174] dhcpcd[677]: vetha1e48bcc: deleting route to 169.254.0.0/16 machine # [ 216.751346] k3s[873]: I0921 16:51:25.301084 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-job\" (UniqueName: \"kubernetes.io/configmap/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-job\") pod \"fbbb6a37-fd85-4403-a1d1-fa4f11f81390\" (UID: \"fbbb6a37-fd85-4403-a1d1-fa4f11f81390\") " machine # [ 216.752167] k3s[873]: I0921 16:51:25.301133 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-kube-api-access-n7qlk\" (UniqueName: \"kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-kube-api-access-n7qlk\") pod \"fbbb6a37-fd85-4403-a1d1-fa4f11f81390\" (UID: \"fbbb6a37-fd85-4403-a1d1-fa4f11f81390\") " machine # [ 216.754260] k3s[873]: I0921 16:51:25.301174 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-nix-grpc-farm\") pod \"fbbb6a37-fd85-4403-a1d1-fa4f11f81390\" (UID: \"fbbb6a37-fd85-4403-a1d1-fa4f11f81390\") " machine # [ 216.754999] k3s[873]: I0921 16:51:25.301542 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-job" pod "fbbb6a37-fd85-4403-a1d1-fa4f11f81390" (UID: "fbbb6a37-fd85-4403-a1d1-fa4f11f81390"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 216.758066] systemd[1]: var-lib-kubelet-pods-fbbb6a37\x2dfd85\x2d4403\x2da1d1\x2dfa4f11f81390-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dn7qlk.mount: Deactivated successfully. machine # [ 216.775647] k3s[873]: I0921 16:51:25.325689 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-kube-api-access-n7qlk" pod "fbbb6a37-fd85-4403-a1d1-fa4f11f81390" (UID: "fbbb6a37-fd85-4403-a1d1-fa4f11f81390"). InnerVolumeSpecName "kube-api-access-n7qlk". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 216.785193] k3s[873]: I0921 16:51:25.335277 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-nix-grpc-farm" pod "fbbb6a37-fd85-4403-a1d1-fa4f11f81390" (UID: "fbbb6a37-fd85-4403-a1d1-fa4f11f81390"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 216.786192] systemd[1]: var-lib-kubelet-pods-fbbb6a37\x2dfd85\x2d4403\x2da1d1\x2dfa4f11f81390-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 216.809303] dhcpcd[677]: vetha1e48bcc: removing interface machine # [ 216.851566] k3s[873]: I0921 16:51:25.401663 873 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 216.852537] k3s[873]: I0921 16:51:25.401694 873 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-job\") on node \"machine\" DevicePath \"\"" machine # [ 216.852955] k3s[873]: I0921 16:51:25.401712 873 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7qlk\" (UniqueName: \"kubernetes.io/projected/fbbb6a37-fd85-4403-a1d1-fa4f11f81390-kube-api-access-n7qlk\") on node \"machine\" DevicePath \"\"" machine # [ 217.442956] k3s[873]: I0921 16:51:25.992960 873 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96c000fc17e0dc2e6bc96fa5fa30bd6e0d7c18812b5415c87c2a7b07e8cad33c" machine # [ 217.459095] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podfbbb6a37_fd85_4403_a1d1_fa4f11f81390.slice. machine # [ 217.461177] systemd[1]: kubepods-besteffort-podfbbb6a37_fd85_4403_a1d1_fa4f11f81390.slice: Consumed 989ms CPU time over 46.676s wall clock time, 117.3M memory peak, 64.1M read from disk, 664K written to disk, 16.5K incoming IP traffic, 44.1K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 48.03 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.25 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmptl12iqmg/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (11s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath, in 0.27 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.07 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 49.75 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.40 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.48 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-mzvgr -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 220.038914] k3s[873]: E0921 16:51:28.588248 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39812: use of closed network connection machine # [ 221.437658] k3s[873]: E0921 16:51:29.987467 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39826: use of closed network connection machine # [ 222.825741] k3s[873]: E0921 16:51:31.375186 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39838: use of closed network connection machine # [ 224.255441] k3s[873]: E0921 16:51:32.805146 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55446: use of closed network connection machine # [ 225.640449] k3s[873]: E0921 16:51:34.190056 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55466: use of closed network connection machine # [ 226.983831] k3s[873]: time="2026-09-21T16:51:35Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:42726->127.0.0.1:10250: write: broken pipe" machine # [ 226.985874] k3s[873]: E0921 16:51:35.532897 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55484: use of closed network connection machine # [ 228.399537] k3s[873]: E0921 16:51:36.948721 873 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:39528->127.0.0.1:10010: write tcp 127.0.0.1:39528->127.0.0.1:10010: write: connection reset by peer machine # [ 228.402235] k3s[873]: E0921 16:51:36.949628 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55506: use of closed network connection machine # [ 231.116756] k3s[873]: E0921 16:51:39.666435 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55562: use of closed network connection machine # [ 232.489725] k3s[873]: E0921 16:51:41.039046 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55598: use of closed network connection machine # [ 232.493583] k3s[873]: time="2026-09-21T16:51:41Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:42762->127.0.0.1:10250: write: broken pipe" machine # [ 233.870228] k3s[873]: E0921 16:51:42.419692 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58006: use of closed network connection machine # [ 235.261568] k3s[873]: E0921 16:51:43.810573 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58038: use of closed network connection machine # [ 236.590499] k3s[873]: E0921 16:51:45.139815 873 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:55720->127.0.0.1:10010: write tcp 127.0.0.1:55720->127.0.0.1:10010: write: broken pipe machine # [ 236.592274] k3s[873]: E0921 16:51:45.140272 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58086: use of closed network connection machine # [ 238.014891] k3s[873]: E0921 16:51:46.564172 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58112: use of closed network connection machine # [ 239.430736] k3s[873]: E0921 16:51:47.980507 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58136: use of closed network connection machine # [ 240.813673] k3s[873]: E0921 16:51:49.363321 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58174: use of closed network connection machine # [ 240.815470] k3s[873]: E0921 16:51:49.363326 873 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:55734->127.0.0.1:10010: write tcp 127.0.0.1:55734->127.0.0.1:10010: write: broken pipe machine # [ 242.212526] k3s[873]: E0921 16:51:50.761543 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58210: use of closed network connection machine # [ 243.603705] k3s[873]: E0921 16:51:52.153374 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46700: use of closed network connection machine # [ 245.004820] k3s[873]: E0921 16:51:53.554589 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46746: use of closed network connection machine # [ 246.386276] k3s[873]: time="2026-09-21T16:51:54Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:60572->127.0.0.1:10250: write: broken pipe" machine # [ 247.817536] k3s[873]: E0921 16:51:56.367149 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46810: use of closed network connection machine # [ 249.216603] k3s[873]: E0921 16:51:57.765379 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46842: use of closed network connection machine # [ 250.572797] k3s[873]: E0921 16:51:59.122391 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46886: use of closed network connection machine # [ 251.952473] k3s[873]: time="2026-09-21T16:52:00Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:60616->127.0.0.1:10250: write: broken pipe" machine # [ 251.953435] k3s[873]: E0921 16:52:00.502687 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46914: use of closed network connection machine # [ 254.705954] k3s[873]: E0921 16:52:03.255350 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33504: use of closed network connection machine # [ 256.122073] k3s[873]: E0921 16:52:04.671256 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33536: use of closed network connection machine # [ 257.546670] k3s[873]: E0921 16:52:06.095762 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33556: use of closed network connection machine # [ 257.547928] k3s[873]: time="2026-09-21T16:52:06Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:36406->127.0.0.1:10250: write: connection reset by peer" machine # [ 258.926544] k3s[873]: E0921 16:52:07.475603 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33600: use of closed network connection machine # [ 261.697182] k3s[873]: E0921 16:52:10.246366 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33642: use of closed network connection machine # [ 261.698958] k3s[873]: E0921 16:52:10.246387 873 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:53158->127.0.0.1:10010: write tcp 127.0.0.1:53158->127.0.0.1:10010: write: broken pipe machine # [ 261.706821] k3s[873]: time="2026-09-21T16:52:10Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:36422->127.0.0.1:10250: write: connection reset by peer" machine # [ 263.051199] k3s[873]: E0921 16:52:11.600921 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56844: use of closed network connection machine # [ 264.445301] k3s[873]: E0921 16:52:12.995043 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56874: use of closed network connection machine # [ 265.802738] k3s[873]: E0921 16:52:14.352461 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56898: use of closed network connection machine # [ 267.221530] k3s[873]: E0921 16:52:15.771155 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56916: use of closed network connection machine # [ 268.613612] k3s[873]: E0921 16:52:17.162307 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56940: use of closed network connection machine # [ 270.010302] k3s[873]: E0921 16:52:18.559800 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56968: use of closed network connection machine # [ 271.383698] k3s[873]: E0921 16:52:19.933221 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56994: use of closed network connection machine # [ 272.767967] k3s[873]: E0921 16:52:21.317544 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57026: use of closed network connection machine # [ 274.223891] k3s[873]: E0921 16:52:22.773486 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33156: use of closed network connection machine # [ 275.596260] k3s[873]: E0921 16:52:24.145350 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33192: use of closed network connection machine # [ 277.043737] k3s[873]: E0921 16:52:25.592927 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33234: use of closed network connection machine # [ 278.423195] k3s[873]: E0921 16:52:26.972538 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33258: use of closed network connection machine # [ 279.810218] k3s[873]: E0921 16:52:28.359845 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33292: use of closed network connection machine # [ 281.171129] k3s[873]: E0921 16:52:29.720909 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33326: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-mzvgr -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 61.46 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.07 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1 machine # [ 281.624685] niks3-server[1195]: 2026/09/21 16:52:30 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 281.644385] niks3-server[1195]: 2026/09/21 16:52:30 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 281.648759] niks3-server[1195]: 2026/09/21 16:52:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 281.651441] niks3-server[1195]: 2026/09/21 16:52:30 INFO Signed narinfos id=21 count=1 machine # [ 281.656270] niks3-server[1195]: 2026/09/21 16:52:30 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 281.658884] niks3-server[1195]: 2026/09/21 16:52:30 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 281.662599] niks3-server[1195]: 2026/09/21 16:52:30 INFO Completed upload id=21 machine # [ 281.664330] niks3-server[1195]: 2026/09/21 16:52:30 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 290.344269] niks3-server[1195]: 2026/09/21 16:52:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 290.361916] niks3-server[1195]: 2026/09/21 16:52:38 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 290.366795] niks3-server[1195]: 2026/09/21 16:52:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 290.368683] niks3-server[1195]: 2026/09/21 16:52:38 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 290.370873] niks3-server[1195]: 2026/09/21 16:52:38 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 290.376584] niks3-server[1195]: 2026/09/21 16:52:38 INFO Signed narinfos id=22 count=1 machine # [ 290.383261] niks3-server[1195]: 2026/09/21 16:52:38 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 290.385590] niks3-server[1195]: 2026/09/21 16:52:38 INFO Completed upload id=22 machine # [ 290.387799] niks3-server[1195]: 2026/09/21 16:52:38 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 290.483903] niks3-server[1195]: 2026/09/21 16:52:39 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 290.498144] niks3-server[1195]: 2026/09/21 16:52:39 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 290.501168] niks3-server[1195]: 2026/09/21 16:52:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 290.502983] niks3-server[1195]: 2026/09/21 16:52:39 INFO Signed narinfos id=23 count=1 machine # [ 290.505060] niks3-server[1195]: 2026/09/21 16:52:39 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 290.508430] niks3-server[1195]: 2026/09/21 16:52:39 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 290.509694] niks3-server[1195]: 2026/09/21 16:52:39 INFO Completed upload id=23 machine # [ 299.188410] niks3-server[1195]: 2026/09/21 16:52:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 299.205723] niks3-server[1195]: 2026/09/21 16:52:47 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 299.207318] niks3-server[1195]: 2026/09/21 16:52:47 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 299.217076] niks3-server[1195]: 2026/09/21 16:52:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 299.218288] niks3-server[1195]: 2026/09/21 16:52:47 INFO Signed narinfos id=24 count=1 machine # [ 299.221499] niks3-server[1195]: 2026/09/21 16:52:47 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 299.229092] niks3-server[1195]: 2026/09/21 16:52:47 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 299.232987] niks3-server[1195]: 2026/09/21 16:52:47 INFO Completed upload id=24 machine # [ 299.235440] niks3-server[1195]: 2026/09/21 16:52:47 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 299.333217] niks3-server[1195]: 2026/09/21 16:52:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 299.346916] niks3-server[1195]: 2026/09/21 16:52:47 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 299.353591] niks3-server[1195]: 2026/09/21 16:52:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 299.354721] niks3-server[1195]: 2026/09/21 16:52:47 INFO Signed narinfos id=25 count=1 machine # [ 299.357775] niks3-server[1195]: 2026/09/21 16:52:47 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 299.359709] niks3-server[1195]: 2026/09/21 16:52:47 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 299.362345] niks3-server[1195]: 2026/09/21 16:52:47 INFO Completed upload id=25 machine # [ 299.362847] niks3-server[1195]: 2026/09/21 16:52:47 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 308.048267] niks3-server[1195]: 2026/09/21 16:52:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 308.069485] niks3-server[1195]: 2026/09/21 16:52:56 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 308.073166] niks3-server[1195]: 2026/09/21 16:52:56 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 308.076038] niks3-server[1195]: 2026/09/21 16:52:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 308.077564] niks3-server[1195]: 2026/09/21 16:52:56 INFO Signed narinfos id=26 count=1 machine # [ 308.081128] niks3-server[1195]: 2026/09/21 16:52:56 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 308.086856] niks3-server[1195]: 2026/09/21 16:52:56 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 308.089446] niks3-server[1195]: 2026/09/21 16:52:56 INFO Completed upload id=26 machine # [ 308.092075] niks3-server[1195]: 2026/09/21 16:52:56 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1, in 27.90 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 90.31 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.30 seconds) machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv"' machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv"', in 0.08 seconds) (finished: subtest: metrics carry build_info, in 0.39 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 309.839080] k3s[873]: E0921 16:52:58.388453 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55052: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.30 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 310.183744] k3s[873]: E0921 16:52:58.733762 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55084: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.35 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc -- sh -c 'fallocate -l 11468615680 /nix/fill' machine # [ 310.530535] k3s[873]: E0921 16:52:59.080466 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55118: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc -- sh -c 'fallocate -l 11468615680 /nix/fill', in 0.35 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc --since=30s | grep -q 'store paths deleted' machine # [ 314.364192] postgres[786]: [786] LOG: checkpoint starting: time machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc --since=30s | grep -q 'store paths deleted', in 6.80 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc -- sh -c 'rm /nix/fill' machine # [ 317.691750] k3s[873]: E0921 16:53:06.241027 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60354: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc -- sh -c 'rm /nix/fill', in 0.36 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.23 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 318.266811] k3s[873]: E0921 16:53:06.816883 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60376: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.34 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 8.73 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1 machine # [ 318.313188] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 29e6fb66deec48758e930bcada0884ce machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1, in 0.05 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 318.560730] nix[8723]: don't know how to build these paths: machine # [ 318.561940] nix[8723]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 318.591175] nix[8723]: copying 1 paths to '127.0.0.1:30051'... machine # [ 318.595681] nix[8723]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 318.679741] niks3-server[1195]: 2026/09/21 16:53:07 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 318.699236] niks3-server[1195]: 2026/09/21 16:53:07 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 318.705612] niks3-server[1195]: 2026/09/21 16:53:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 318.709055] niks3-server[1195]: 2026/09/21 16:53:07 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 318.712861] niks3-server[1195]: 2026/09/21 16:53:07 INFO Signed narinfos id=27 count=1 machine # [ 318.719981] niks3-server[1195]: 2026/09/21 16:53:07 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 318.723314] niks3-server[1195]: 2026/09/21 16:53:07 INFO Completed upload id=27 machine # [ 318.724901] niks3-server[1195]: 2026/09/21 16:53:07 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 318.734988] nix[8723]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 318.735338] nix[8723]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.10 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.27 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 319.714868] nix[8723]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 319.715683] nix[8723]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 319.738054] systemd[1]: cri-containerd-41ea40f2a11835ce035a7e4862b8b68b847a980f53f3ff0de9ebe0539149e29b.scope: Deactivated successfully. machine # [ 319.738967] systemd[1]: cri-containerd-41ea40f2a11835ce035a7e4862b8b68b847a980f53f3ff0de9ebe0539149e29b.scope: Consumed 3.625s CPU time over 4min 22.912s wall clock time, 50.7M memory peak, 29.6M read from disk, 484.6K incoming IP traffic, 457.4K outgoing IP traffic. machine # [ 319.772065] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod06d55e4b_c03a_4f2e_8685_a02a6b667139.slice. machine # [ 319.810099] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-41ea40f2a11835ce035a7e4862b8b68b847a980f53f3ff0de9ebe0539149e29b-rootfs.mount: Deactivated successfully. machine # [ 319.849969] systemd[1]: cri-containerd-3c796da8642e538d9ce2d1a51724cc0c6202112e079a85568ede6eac1fdc2536.scope: Deactivated successfully. machine # [ 319.852447] k3s[873]: I0921 16:53:08.401016 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/06d55e4b-c03a-4f2e-8685-a02a6b667139-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-fbfht\" (UID: \"06d55e4b-c03a-4f2e-8685-a02a6b667139\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-fbfht" machine # [ 319.858523] k3s[873]: I0921 16:53:08.401062 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06d55e4b-c03a-4f2e-8685-a02a6b667139-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-fbfht\" (UID: \"06d55e4b-c03a-4f2e-8685-a02a6b667139\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-fbfht" machine # [ 319.865104] k3s[873]: I0921 16:53:08.401094 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06d55e4b-c03a-4f2e-8685-a02a6b667139-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-fbfht\" (UID: \"06d55e4b-c03a-4f2e-8685-a02a6b667139\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-fbfht" machine # [ 319.870854] k3s[873]: I0921 16:53:08.401126 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/06d55e4b-c03a-4f2e-8685-a02a6b667139-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-fbfht\" (UID: \"06d55e4b-c03a-4f2e-8685-a02a6b667139\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-fbfht" machine # [ 319.900417] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3c796da8642e538d9ce2d1a51724cc0c6202112e079a85568ede6eac1fdc2536-rootfs.mount: Deactivated successfully. machine # [ 319.932567] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-3c796da8642e538d9ce2d1a51724cc0c6202112e079a85568ede6eac1fdc2536-shm.mount: Deactivated successfully. machine # [ 320.144536] cni0: port 6(veth3a231a08) entered disabled state machine # [ 319.992729] dhcpcd[677]: veth3a231a08: carrier lost machine # [ 320.148602] veth3a231a08 (unregistering): left allmulticast mode machine # [ 320.150592] veth3a231a08 (unregistering): left promiscuous mode machine # [ 320.152352] cni0: port 6(veth3a231a08) entered disabled state machine # [ 320.046126] dhcpcd[677]: veth3a231a08: deleting address fe80::7c0d:61ff:fe52:57ab machine # [ 320.050200] dhcpcd[677]: veth3a231a08: deleting route to 169.254.0.0/16 machine # [ 320.257055] cni0: port 1(veth9cc004ac) entered blocking state machine # [ 320.258475] cni0: port 1(veth9cc004ac) entered disabled state machine # [ 320.259700] veth9cc004ac: entered allmulticast mode machine # [ 320.260766] veth9cc004ac: entered promiscuous mode machine # [ 320.110244] (udev-worker)[8930]: Network interface NamePolicy= disabled on kernel command line. machine # [ 320.273240] cni0: port 1(veth9cc004ac) entered blocking state machine # [ 320.274778] cni0: port 1(veth9cc004ac) entered forwarding state machine # [ 320.153513] k3s[873]: I0921 16:53:08.703139 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-ca\" (UniqueName: \"kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-ca\") pod \"91544363-f2ed-4324-8fe3-fa57022621dd\" (UID: \"91544363-f2ed-4324-8fe3-fa57022621dd\") " machine # [ 320.154526] k3s[873]: I0921 16:53:08.703246 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-lb\" (UniqueName: \"kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-lb\") pod \"91544363-f2ed-4324-8fe3-fa57022621dd\" (UID: \"91544363-f2ed-4324-8fe3-fa57022621dd\") " machine # [ 320.155964] k3s[873]: I0921 16:53:08.703289 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/91544363-f2ed-4324-8fe3-fa57022621dd-tmp\" (UniqueName: \"kubernetes.io/empty-dir/91544363-f2ed-4324-8fe3-fa57022621dd-tmp\") pod \"91544363-f2ed-4324-8fe3-fa57022621dd\" (UID: \"91544363-f2ed-4324-8fe3-fa57022621dd\") " machine # [ 320.156937] k3s[873]: I0921 16:53:08.703338 873 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/91544363-f2ed-4324-8fe3-fa57022621dd-config\" (UniqueName: \"kubernetes.io/configmap/91544363-f2ed-4324-8fe3-fa57022621dd-config\") pod \"91544363-f2ed-4324-8fe3-fa57022621dd\" (UID: \"91544363-f2ed-4324-8fe3-fa57022621dd\") " machine # [ 320.173411] k3s[873]: I0921 16:53:08.723483 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-lb" pod "91544363-f2ed-4324-8fe3-fa57022621dd" (UID: "91544363-f2ed-4324-8fe3-fa57022621dd"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 320.180413] k3s[873]: I0921 16:53:08.730489 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91544363-f2ed-4324-8fe3-fa57022621dd-tmp" pod "91544363-f2ed-4324-8fe3-fa57022621dd" (UID: "91544363-f2ed-4324-8fe3-fa57022621dd"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 320.188851] k3s[873]: I0921 16:53:08.738871 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91544363-f2ed-4324-8fe3-fa57022621dd-config" pod "91544363-f2ed-4324-8fe3-fa57022621dd" (UID: "91544363-f2ed-4324-8fe3-fa57022621dd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 320.195058] k3s[873]: I0921 16:53:08.745054 873 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-ca" pod "91544363-f2ed-4324-8fe3-fa57022621dd" (UID: "91544363-f2ed-4324-8fe3-fa57022621dd"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 320.212346] dhcpcd[677]: veth3a231a08: removing interface machine # [ 320.253803] k3s[873]: I0921 16:53:08.803726 873 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 320.257493] k3s[873]: I0921 16:53:08.803763 873 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91544363-f2ed-4324-8fe3-fa57022621dd-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 320.258200] k3s[873]: I0921 16:53:08.803778 873 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/91544363-f2ed-4324-8fe3-fa57022621dd-config\") on node \"machine\" DevicePath \"\"" machine # [ 320.258645] k3s[873]: I0921 16:53:08.803790 873 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/91544363-f2ed-4324-8fe3-fa57022621dd-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 320.266313] systemd[1]: Started libcontainer container 2746dab07c1b572338b36400a756cf6cca67f7469b3e764b31cce1ca379e3867. machine # [ 320.267428] dhcpcd[677]: veth9cc004ac: IAID ad:6b:ed:2b machine # [ 320.268175] dhcpcd[677]: veth9cc004ac: adding address fe80::48be:adff:fe6b:ed2b machine # [ 320.268786] dhcpcd[677]: veth9cc004ac: old hardware address: 4a:be:ad:6b:ed:2b machine # [ 320.269625] dhcpcd[677]: veth9cc004ac: new hardware address: ba:d6:c0:0d:96:42 machine # [ 320.270276] dhcpcd[677]: veth9cc004ac: carrier lost machine # [ 320.317544] dhcpcd[677]: veth9cc004ac: deleting address fe80::48be:adff:fe6b:ed2b machine # [ 320.318762] dhcpcd[677]: veth9cc004ac: carrier acquired machine # [ 320.331507] dhcpcd[677]: veth9cc004ac: IAID c0:0d:96:42 machine # [ 320.332687] dhcpcd[677]: veth9cc004ac: adding address fe80::b8d6:c0ff:fe0d:9642 machine # [ 320.429623] systemd[1]: Started libcontainer container 40ac95ba689ac1f307ec4da3a82cdb0981369c0e9a6fc9993f90326f63be0a1e. machine # [ 320.703388] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod91544363_f2ed_4324_8fe3_fa57022621dd.slice. machine # [ 320.707419] systemd[1]: kubepods-besteffort-pod91544363_f2ed_4324_8fe3_fa57022621dd.slice: Consumed 3.656s CPU time over 4min 25.296s wall clock time, 50.9M memory peak, 29.6M read from disk, 484.6K incoming IP traffic, 457.4K outgoing IP traffic. machine # [ 320.829101] systemd[1]: var-lib-kubelet-pods-91544363\x2df2ed\x2d4324\x2d8fe3\x2dfa57022621dd-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 320.830718] systemd[1]: var-lib-kubelet-pods-91544363\x2df2ed\x2d4324\x2d8fe3\x2dfa57022621dd-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 320.832221] systemd[1]: var-lib-kubelet-pods-91544363\x2df2ed\x2d4324\x2d8fe3\x2dfa57022621dd-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 320.833796] systemd[1]: run-netns-cni\x2d95961ad6\x2d2a5b\x2d460b\x2de7bc\x2db1c316592f98.mount: Deactivated successfully. machine # [ 320.835234] systemd[1]: var-lib-kubelet-pods-91544363\x2df2ed\x2d4324\x2d8fe3\x2dfa57022621dd-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 320.836188] systemd[1]: var-lib-kubelet-pods-91544363\x2df2ed\x2d4324\x2d8fe3\x2dfa57022621dd-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 320.850158] systemd[1]: var-lib-kubelet-pods-91544363\x2df2ed\x2d4324\x2d8fe3\x2dfa57022621dd-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 320.855203] k3s[873]: I0921 16:53:09.404721 873 scope.go:122] "RemoveContainer" containerID="41ea40f2a11835ce035a7e4862b8b68b847a980f53f3ff0de9ebe0539149e29b" machine # [ 320.876761] k3s[873]: I0921 16:53:09.426859 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-fbfht" podStartSLOduration=1.426833961 podStartE2EDuration="1.426833961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 16:53:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 16:53:09.416035102 +0000 UTC m=+300.342237318" watchObservedRunningTime="2026-09-21 16:53:09.426833961 +0000 UTC m=+300.353035897" machine # [ 320.940391] dhcpcd[677]: veth9cc004ac: soliciting a DHCP lease machine # [ 322.219441] nix[8723]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 322.529118] dhcpcd[677]: veth9cc004ac: soliciting an IPv6 router machine # [ 322.688364] k3s[873]: I0921 16:53:11.237688 873 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="91544363-f2ed-4324-8fe3-fa57022621dd" path="/var/lib/kubelet/pods/91544363-f2ed-4324-8fe3-fa57022621dd/volumes" machine # [ 323.271201] nix[8723]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 323.273215] nix[8723]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-cbxvv: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 325.943643] dhcpcd[677]: veth9cc004ac: probing for an IPv4LL address machine # [ 330.818364] dhcpcd[677]: veth9cc004ac: using IPv4LL address 169.254.160.178 machine # [ 330.822258] dhcpcd[677]: veth9cc004ac: adding route to 169.254.0.0/16 machine # [ 334.534168] dhcpcd[677]: veth9cc004ac: no IPv6 Routers available machine # [ 352.184671] niks3-server[1195]: 2026/09/21 16:53:40 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 352.203292] niks3-server[1195]: 2026/09/21 16:53:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 352.206947] niks3-server[1195]: 2026/09/21 16:53:40 INFO Signed narinfos id=28 count=1 machine # [ 352.209141] niks3-server[1195]: 2026/09/21 16:53:40 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 352.211314] niks3-server[1195]: 2026/09/21 16:53:40 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 352.215903] niks3-server[1195]: 2026/09/21 16:53:40 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 352.218869] niks3-server[1195]: 2026/09/21 16:53:40 INFO Completed upload id=28 machine # [ 352.221509] niks3-server[1195]: 2026/09/21 16:53:40 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 353.265374] systemd[1]: vialb.service: Deactivated successfully. machine # [ 353.266671] systemd[1]: vialb.service: Consumed 181ms CPU time over 34.952s wall clock time, 38.6M memory peak, 4K written to disk, 7.9K incoming IP traffic, 17.1K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 33.96 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.06 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.30 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 35.74 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 machine # [ 354.051427] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 6151c29f2bf44e66b67b4c35f4c55ec2 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1, in 0.04 seconds) machine # [ 354.305875] nix[9653]: don't know how to build these paths: machine # [ 354.306596] nix[9653]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 354.328700] nix[9653]: copying 1 paths to '127.0.0.1:30051'... machine # [ 354.329733] nix[9653]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 354.346284] k3s[873]: E0921 16:53:42.895931 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37618: use of closed network connection machine # command terminated with exit code 1 machine # [ 354.408406] niks3-server[1195]: 2026/09/21 16:53:42 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 354.423837] niks3-server[1195]: 2026/09/21 16:53:42 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 354.427172] niks3-server[1195]: 2026/09/21 16:53:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 354.428813] niks3-server[1195]: 2026/09/21 16:53:42 INFO Signed narinfos id=29 count=1 machine # [ 354.433354] niks3-server[1195]: 2026/09/21 16:53:42 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 354.436580] niks3-server[1195]: 2026/09/21 16:53:42 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 354.440203] niks3-server[1195]: 2026/09/21 16:53:42 INFO Completed upload id=29 machine # [ 354.442934] niks3-server[1195]: 2026/09/21 16:53:42 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 354.449106] nix[9653]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 354.450465] nix[9653]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 354.664864] k3s[873]: time="2026-09-21T16:53:43Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:39352->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 354.669358] k3s[873]: E0921 16:53:43.214732 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37644: use of closed network connection machine # command terminated with exit code 1 machine # [ 356.065413] k3s[873]: E0921 16:53:44.613789 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37684: use of closed network connection machine # [ 356.069874] k3s[873]: time="2026-09-21T16:53:44Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:39354->127.0.0.1:10250: write: broken pipe" machine # [ 356.408986] k3s[873]: E0921 16:53:44.959059 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37696: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 357.796847] k3s[873]: E0921 16:53:46.345331 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37730: use of closed network connection machine # [ 358.155542] k3s[873]: E0921 16:53:46.705587 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37760: use of closed network connection machine # command terminated with exit code 1 machine # [ 359.597238] k3s[873]: E0921 16:53:48.146577 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37788: use of closed network connection machine # command terminated with exit code 1 machine # [ 359.946249] k3s[873]: E0921 16:53:48.496219 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37822: use of closed network connection machine # command terminated with exit code 1 machine # [ 361.371307] k3s[873]: E0921 16:53:49.920988 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37840: use of closed network connection machine # command terminated with exit code 1 machine # [ 361.745855] k3s[873]: E0921 16:53:50.295760 873 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:45706->127.0.0.1:10010: write tcp 127.0.0.1:45706->127.0.0.1:10010: write: broken pipe machine # command terminated with exit code 1 machine # [ 361.747512] k3s[873]: E0921 16:53:50.296752 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37866: use of closed network connection machine # command terminated with exit code 1 machine # [ 363.109326] k3s[873]: E0921 16:53:51.659014 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51692: use of closed network connection machine # [ 363.414054] k3s[873]: E0921 16:53:51.964074 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51722: use of closed network connection machine # [ 363.414853] k3s[873]: time="2026-09-21T16:53:51Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:60778->127.0.0.1:10250: write: connection reset by peer" machine # [ 363.735359] k3s[873]: E0921 16:53:52.285358 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51758: use of closed network connection machine # command terminated with exit code 1 machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-hs4hp --wait=false, in 0.25 seconds) machine: must succeed: sleep 5.0 machine # [ 364.377406] systemd[1]: cri-containerd-a528b9da1f223eb787ff4d491edef1e79041ce06987fc480acbec594e5e2ab1b.scope: Deactivated successfully. machine # [ 364.379381] systemd[1]: cri-containerd-a528b9da1f223eb787ff4d491edef1e79041ce06987fc480acbec594e5e2ab1b.scope: Consumed 314ms CPU time over 4min 47.903s wall clock time, 12.3M memory peak, 5.2M read from disk. machine # [ 364.423750] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a528b9da1f223eb787ff4d491edef1e79041ce06987fc480acbec594e5e2ab1b-rootfs.mount: Deactivated successfully. machine # [ 364.763260] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod0a7f207d_383d_4e5f_b987_711ee9dc1b15.slice. machine # [ 364.795694] k3s[873]: I0921 16:53:53.345260 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0a7f207d-383d-4e5f-b987-711ee9dc1b15-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb\" (UID: \"0a7f207d-383d-4e5f-b987-711ee9dc1b15\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb" machine # [ 364.796938] k3s[873]: I0921 16:53:53.345309 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0a7f207d-383d-4e5f-b987-711ee9dc1b15-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb\" (UID: \"0a7f207d-383d-4e5f-b987-711ee9dc1b15\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb" machine # [ 364.797688] k3s[873]: I0921 16:53:53.345342 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x7bq\" (UniqueName: \"kubernetes.io/projected/0a7f207d-383d-4e5f-b987-711ee9dc1b15-kube-api-access-7x7bq\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb\" (UID: \"0a7f207d-383d-4e5f-b987-711ee9dc1b15\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb" machine # [ 364.799229] k3s[873]: I0921 16:53:53.345376 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/0a7f207d-383d-4e5f-b987-711ee9dc1b15-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb\" (UID: \"0a7f207d-383d-4e5f-b987-711ee9dc1b15\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb" machine # [ 364.800362] k3s[873]: I0921 16:53:53.345630 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/0a7f207d-383d-4e5f-b987-711ee9dc1b15-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb\" (UID: \"0a7f207d-383d-4e5f-b987-711ee9dc1b15\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb" machine # [ 364.801410] k3s[873]: I0921 16:53:53.345884 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0a7f207d-383d-4e5f-b987-711ee9dc1b15-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb\" (UID: \"0a7f207d-383d-4e5f-b987-711ee9dc1b15\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb" machine # [ 364.802868] k3s[873]: I0921 16:53:53.346243 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0a7f207d-383d-4e5f-b987-711ee9dc1b15-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb\" (UID: \"0a7f207d-383d-4e5f-b987-711ee9dc1b15\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb" machine # [ 364.803856] k3s[873]: I0921 16:53:53.346378 873 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/0a7f207d-383d-4e5f-b987-711ee9dc1b15-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb\" (UID: \"0a7f207d-383d-4e5f-b987-711ee9dc1b15\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb" machine # [ 365.267098] cni0: port 6(vethd45f481a) entered blocking state machine # [ 365.269125] cni0: port 6(vethd45f481a) entered disabled state machine # [ 365.270817] vethd45f481a: entered allmulticast mode machine # [ 365.272064] vethd45f481a: entered promiscuous mode machine # [ 365.284570] cni0: port 6(vethd45f481a) entered blocking state machine # [ 365.286154] cni0: port 6(vethd45f481a) entered forwarding state machine # [ 365.216852] (udev-worker)[10381]: Network interface NamePolicy= disabled on kernel command line. machine # [ 365.277083] dhcpcd[677]: vethd45f481a: IAID e5:75:f8:59 machine # [ 365.277710] systemd[1]: Started libcontainer container 398f446cbf4a1307114ba8f8eca1053cd17ef1df1b293cde23780d89cdeaa2bf. machine # [ 365.278978] dhcpcd[677]: vethd45f481a: adding address fe80::3096:e5ff:fe75:f859 machine # [ 365.440647] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3814933452.mount: Deactivated successfully. machine # [ 365.442165] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3135728633.mount: Deactivated successfully. machine # [ 365.502900] systemd[1]: tmp-ovl\x2didmapped2560961200.mount: Deactivated successfully. machine # [ 365.523564] systemd[1]: Started libcontainer container 303fb578436ed29d4284d744049c412270f54917b5451e7e75eecec2537724c8. machine # [ 366.462575] dhcpcd[677]: vethd45f481a: soliciting a DHCP lease machine # [ 366.646988] dhcpcd[677]: vethd45f481a: soliciting an IPv6 router machine # [ 367.626077] systemd[1]: cri-containerd-303fb578436ed29d4284d744049c412270f54917b5451e7e75eecec2537724c8.scope: Deactivated successfully. machine # [ 367.636348] systemd[1]: cri-containerd-303fb578436ed29d4284d744049c412270f54917b5451e7e75eecec2537724c8.scope: Consumed 982ms CPU time over 2.102s wall clock time, 475.2M memory peak, 183.7M read from disk, 143.4M written to disk. machine # [ 367.711412] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-303fb578436ed29d4284d744049c412270f54917b5451e7e75eecec2537724c8-rootfs.mount: Deactivated successfully. machine # [ 368.252944] systemd[1]: Started libcontainer container 86215ca277ba8a71f2d430021c5726a2f85642406f02670db601b3416e9b72a8. machine # [ 368.514195] systemd[1]: Started libcontainer container 932a12e06e5ec4c935a59c6001e2c019df348c6c7ce17721c5ee2e59bb6184d2. machine # [ 368.718283] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2047061071.mount: Deactivated successfully. machine # [ 368.753591] systemd[1]: tmp-ovl\x2didmapped730417805.mount: Deactivated successfully. machine # [ 368.775349] systemd[1]: Started libcontainer container 51b0285ae0026db72c7ca9e0130737f8448f1a950264831fac1b8877f5166733. machine # [ 369.109074] k3s[873]: I0921 16:53:57.658076 873 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-c95wb" podStartSLOduration=2.58601564 podStartE2EDuration="4.658026747s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.072011107s" isStatefulPod=false podCreationTimestamp="2026-09-21 16:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 16:53:57.655984588 +0000 UTC m=+348.582191552" watchObservedRunningTime="2026-09-21 16:53:57.658026747 +0000 UTC m=+348.584233432" machine: (finished: must succeed: sleep 5.0, in 5.06 seconds) machine # [ 369.679639] k3s[873]: E0921 16:53:58.229473 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51834: use of closed network connection machine # command terminated with exit code 1 machine # [ 370.002186] k3s[873]: E0921 16:53:58.552117 873 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51862: use of closed network connection machine # [ 370.002644] k3s[873]: E0921 16:53:58.552459 873 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:54582->127.0.0.1:10010: write tcp 127.0.0.1:54582->127.0.0.1:10010: write: broken pipe machine: waiting for success: ! systemctl is-active slow machine # [ 371.464194] dhcpcd[677]: vethd45f481a: probing for an IPv4LL address machine # [ 375.957871] dhcpcd[677]: vethd45f481a: using IPv4LL address 169.254.35.22 machine # [ 375.962139] dhcpcd[677]: vethd45f481a: adding route to 169.254.0.0/16 machine # [ 378.651109] dhcpcd[677]: vethd45f481a: no IPv6 Routers available machine # [ 382.943648] niks3-server[1195]: 2026/09/21 16:54:11 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 382.969243] niks3-server[1195]: 2026/09/21 16:54:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 382.970852] niks3-server[1195]: 2026/09/21 16:54:11 INFO Signed narinfos id=30 count=1 machine # [ 382.975288] niks3-server[1195]: 2026/09/21 16:54:11 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 382.976527] niks3-server[1195]: 2026/09/21 16:54:11 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 382.985839] niks3-server[1195]: 2026/09/21 16:54:11 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 382.989663] niks3-server[1195]: 2026/09/21 16:54:11 INFO Completed upload id=30 machine # [ 382.995386] niks3-server[1195]: 2026/09/21 16:54:11 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 383.042333] systemd[1]: slow.service: Deactivated successfully. machine # [ 383.043625] systemd[1]: slow.service: Consumed 147ms CPU time over 28.990s wall clock time, 38.5M memory peak, 4K written to disk, 4.6K incoming IP traffic, 11.5K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 13.93 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.06 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.05 seconds) machine: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath, in 0.37 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.09 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 30.50 seconds) (finished: run the VM test script, in 385.42 seconds) test script finished in 385.50s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.24 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh