tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.01 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.7INgM8sd8x', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: f13dcb49-ec49-4a91-92b8-a84b4f79fbb5 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-27T14:41:57Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-27T14:41:57Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-27T14:41:57Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-27T14:41:57Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-27T14:41:57Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-27T14:41:57Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-27T14:41:57Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-27T14:41:57Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-27T14:41:57Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-27T14:41:57Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-27T14:41:57Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-27T14:41:57Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/387dxxcc4npn8ihah5fly5k4grgn2x7c-nixos-system-machine-test/init regInfo=/nix/store/r8wr1hwbs0hdpsfd548hdp6rjzal1m36-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 485263727 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000810] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000839] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000877] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002721] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002732] Using GB pages for direct mapping machine # [ 0.002810] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002817] ACPI: Early table checksum verification disabled machine # [ 0.002819] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002823] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002826] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002833] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002835] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002836] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002838] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002839] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002841] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002842] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002843] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002844] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002844] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002845] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002845] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002845] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003060] No NUMA configuration found machine # [ 0.003061] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003063] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005125] Zone ranges: machine # [ 0.005126] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005127] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005128] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005129] Device empty machine # [ 0.005130] Movable zone start for each node machine # [ 0.005131] Early memory node ranges machine # [ 0.005131] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005132] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005133] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005134] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005152] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005397] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.071337] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.071811] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.071825] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.071855] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.071858] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.071860] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.071861] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.071862] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.071863] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.071865] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.071866] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.071870] TSC deadline timer available machine # [ 0.071874] CPU topo: Max. logical packages: 1 machine # [ 0.071875] CPU topo: Max. logical dies: 1 machine # [ 0.071875] CPU topo: Max. dies per package: 1 machine # [ 0.071879] CPU topo: Max. threads per core: 1 machine # [ 0.071880] CPU topo: Num. cores per package: 4 machine # [ 0.071880] CPU topo: Num. threads per package: 4 machine # [ 0.071880] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.071902] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.071917] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.071919] kvm-guest: setup PV sched yield machine # [ 0.071929] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.071930] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.071931] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.071932] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.071934] Booting paravirtualized kernel on KVM machine # [ 0.071937] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.076408] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.078423] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.078471] kvm-guest: PV spinlocks enabled machine # [ 0.078473] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.078476] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/387dxxcc4npn8ihah5fly5k4grgn2x7c-nixos-system-machine-test/init regInfo=/nix/store/r8wr1hwbs0hdpsfd548hdp6rjzal1m36-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.078567] Unknown kernel command line parameters "regInfo=/nix/store/r8wr1hwbs0hdpsfd548hdp6rjzal1m36-closure-info/registration", will be passed to user space. machine # [ 0.078580] random: crng init done machine # [ 0.078581] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.082664] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.084643] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.084717] software IO TLB: area num 4. machine # [ 0.151930] Fallback order for Node 0: 0 machine # [ 0.151937] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.151939] Policy zone: Normal machine # [ 0.154244] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.160837] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.169142] allocated 8388608 bytes of page_ext machine # [ 0.178709] ftrace: allocating 48787 entries in 192 pages machine # [ 0.178712] ftrace: allocated 192 pages with 2 groups machine # [ 0.179534] Dynamic Preempt: lazy machine # [ 0.179724] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.179725] rcu: RCU event tracing is enabled. machine # [ 0.179725] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.179727] Trampoline variant of Tasks RCU enabled. machine # [ 0.179728] Rude variant of Tasks RCU enabled. machine # [ 0.179728] Tracing variant of Tasks RCU enabled. machine # [ 0.179728] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.179729] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.179749] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.179751] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.179752] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.184055] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.184336] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.184344] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.184454] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.187999] Console: colour VGA+ 80x25 machine # [ 0.188002] printk: legacy console [tty0] enabled machine # [ 0.219581] printk: legacy console [ttyS0] enabled machine # [ 0.331617] ACPI: Core revision 20250807 machine # [ 0.332552] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.334137] APIC: Switch to symmetric I/O mode setup machine # [ 0.335186] x2apic enabled machine # [ 0.335944] APIC: Switched APIC routing to: physical x2apic machine # [ 0.336927] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.338235] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.339766] kvm-guest: setup PV IPIs machine # [ 0.341382] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.342453] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.346839] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.348922] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.349952] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.350836] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.351840] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.353836] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.354836] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.356633] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.357837] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.358836] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.359843] Spectre V2 : Enabling IBPB for BPF machine # [ 0.360837] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.361837] active return thunk: srso_alias_return_thunk machine # [ 0.362761] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.363836] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.364836] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.365836] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.366836] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.367836] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.368836] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.370837] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.371836] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.372835] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.373836] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.374836] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.375836] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.404360] Freeing SMP alternatives memory: 44K machine # [ 0.404839] pid_max: default: 32768 minimum: 301 machine # [ 0.405925] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.406947] landlock: Up and running. machine # [ 0.407837] Yama: becoming mindful. machine # [ 0.408909] LSM support for eBPF active machine # [ 0.409751] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.410905] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.413568] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.414354] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.414841] ... version: 2 machine # [ 0.415590] ... bit width: 48 machine # [ 0.415839] ... generic counters: 6 machine # [ 0.416625] ... generic bitmap: 000000000000003f machine # [ 0.417661] ... fixed-purpose counters: 0 machine # [ 0.418428] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.418838] ... value mask: 0000ffffffffffff machine # [ 0.419806] ... max period: 00007fffffffffff machine # [ 0.420602] ... global_ctrl mask: 000000000000003f machine # [ 0.420963] signal: max sigframe size: 3376 machine # [ 0.421768] rcu: Hierarchical SRCU implementation. machine # [ 0.422468] rcu: Max phase no-delay instances is 400. machine # [ 0.423008] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.428299] smp: Bringing up secondary CPUs ... machine # [ 0.429244] smpboot: x86: Booting SMP configuration: machine # [ 0.429847] .... node #0, CPUs: #1 #2 #3 machine # [ 0.433023] smp: Brought up 1 node, 4 CPUs machine # [ 0.434589] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.435185] Memory: 3957912K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved) machine # [ 0.436839] devtmpfs: initialized machine # [ 0.437909] x86/mm: Memory block size: 128MB machine # [ 0.440904] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.441911] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.442925] pinctrl core: initialized pinctrl subsystem machine # [ 0.444150] PM: RTC time: 14:41:57, date: 2026-09-27 machine # [ 0.447658] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.449551] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.449869] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.451348] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.451849] audit: initializing netlink subsys (disabled) machine # [ 0.452899] audit: type=2000 audit(1790520118.290:1): state=initialized audit_enabled=0 res=1 machine # [ 0.453133] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.454839] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.455840] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.456839] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.457838] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.458854] cpuidle: using governor menu machine # [ 0.461060] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.462062] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.462842] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.463853] PCI: Using configuration type 1 for base access machine # [ 0.465002] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.467286] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.468762] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.469727] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.470747] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.475651] ACPI: Added _OSI(Module Device) machine # [ 0.477845] ACPI: Added _OSI(Processor Device) machine # [ 0.479845] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.488541] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.495155] ACPI: Interpreter enabled machine # [ 0.495858] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.496668] ACPI: Using IOAPIC for interrupt routing machine # [ 0.497581] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.498847] PCI: Using E820 reservations for host bridge windows machine # [ 0.502176] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.516150] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.517860] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.522236] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.526166] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.530136] PCI host bridge to bus 0000:00 machine # [ 0.531855] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.534846] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.536843] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.538844] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.541844] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.543843] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.546845] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.549441] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.552804] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.566363] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.566852] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.567860] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.569932] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.572254] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.584873] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.586861] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.589934] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.592859] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.597321] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.606887] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.608862] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.611888] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.615972] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.622878] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.625941] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.627886] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.631097] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.634428] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.635901] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.638902] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.641860] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.646143] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.655897] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.657899] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.662585] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.670896] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.672916] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.678236] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.683891] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.708933] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.711704] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.715886] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.716892] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.719455] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.723890] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.725847] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.726862] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.729440] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.732879] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.733821] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.734681] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.737483] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.739781] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.740790] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.743589] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.745056] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.747259] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.749099] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.751706] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.752895] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.754147] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.756098] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.759615] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.759846] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.762205] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.763569] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.768043] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.769953] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.770954] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.771950] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.772944] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.773939] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.774943] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.776938] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.778160] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.778863] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.780862] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.781855] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.782852] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.783852] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.784852] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.785852] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.789172] iommu: Default domain type: Translated machine # [ 0.789839] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.791105] ACPI: bus type USB registered machine # [ 0.791902] usbcore: registered new interface driver usbfs machine # [ 0.792853] usbcore: registered new interface driver hub machine # [ 0.793802] usbcore: registered new device driver usb machine # [ 0.796748] NetLabel: Initializing machine # [ 0.796748] NetLabel: domain hash size = 128 machine # [ 0.797839] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.798840] NetLabel: unlabeled traffic allowed by default machine # [ 0.799775] PCI: Using ACPI for IRQ routing machine # [ 0.843965] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.844835] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.844835] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.851868] vgaarb: loaded machine # [ 0.853376] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.854843] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.862840] clocksource: Switched to clocksource kvm-clock machine # [ 0.867483] VFS: Disk quotas dquot_6.6.0 machine # [ 0.869346] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.872836] pnp: PnP ACPI init machine # [ 0.874837] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.877168] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.881289] pnp: PnP ACPI: found 5 devices machine # [ 0.894562] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.898434] clocksource: Switched to clocksource acpi_pm machine # [ 0.901798] NET: Registered PF_INET protocol family machine # [ 0.905475] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.939300] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.940904] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.942362] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.943885] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.945265] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.946813] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.948308] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.949651] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.951061] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.952059] NET: Registered PF_XDP protocol family machine # [ 0.952949] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.954032] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.955078] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.956239] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.957415] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.958648] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.960820] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.963086] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.965254] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.967383] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.969259] PCI: CLS 0 bytes, default 64 machine # [ 0.970141] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.970667] Trying to unpack rootfs image as initramfs... machine # [ 0.971347] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.974201] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.995486] Initialise system trusted keyrings machine # [ 0.996787] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.008787] Key type asymmetric registered machine # [ 1.009599] Asymmetric key parser 'x509' registered machine # [ 1.010586] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.012267] io scheduler mq-deadline registered machine # [ 1.013087] io scheduler kyber registered machine # [ 1.018225] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.019625] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.022207] Linux agpgart interface v0.103 machine # [ 1.023019] ACPI: bus type drm_connector registered machine # [ 1.026397] usbcore: registered new interface driver usbserial_generic machine # [ 1.027606] usbserial: USB Serial support registered for generic machine # [ 1.028667] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.028667] Please enable it if your BIOS has the CPPC option. machine # [ 1.031054] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.032575] drop_monitor: Initializing network drop monitor service machine # [ 1.033860] NET: Registered PF_INET6 protocol family machine # [ 1.035885] Segment Routing with IPv6 machine # [ 1.036657] In-situ OAM (IOAM) with IPv6 machine # [ 1.039136] IPI shorthand broadcast: enabled machine # [ 1.043957] sched_clock: Marking stable (890017060, 153491178)->(1067483893, -23975655) machine # [ 1.045926] registered taskstats version 1 machine # [ 1.047026] Loading compiled-in X.509 certificates machine # [ 1.057124] Demotion targets for Node 0: null machine # [ 1.058323] Key type .fscrypt registered machine # [ 1.059045] Key type fscrypt-provisioning registered machine # [ 1.060051] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.060999] ima: Allocated hash algorithm: sha1 machine # [ 1.061881] ima: No architecture policies found machine # [ 1.063067] PM: Magic number: 10:665:688 machine # [ 1.064795] RAS: Correctable Errors collector initialized. machine # [ 1.069385] clk: Disabling unused clocks machine # [ 1.070125] PM: genpd: Disabling unused power domains machine # [ 1.240370] Freeing initrd memory: 29052K machine # [ 1.244598] Freeing unused decrypted memory: 2028K machine # [ 1.247640] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.248822] Write protecting the kernel read-only data: 32768k machine # [ 1.251025] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.252715] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.303723] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.304950] Run /init as init process machine # [ 1.320039] systemd[1]: Inserted module 'autofs4' machine # [ 1.346255] fuse: init (API version 7.45) machine # [ 1.355720] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.358633] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.362253] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.364454] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.369541] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.371716] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.379426] virtiofs virtio6: discovered new tag: shared machine # [ 1.392683] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.396579] virtiofs virtio7: discovered new tag: xchg machine # [ 1.398212] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.426180] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.763118] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.775608] systemd[1]: Detected virtualization kvm. machine # [ 1.777924] systemd[1]: Detected architecture x86-64. machine # [ 1.780156] systemd[1]: Running in initrd. machine # [ 1.782834] systemd[1]: Initializing machine ID from random generator. machine # [ 1.785829] systemd[1]: Hostname set to . machine # [ 1.928980] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.993204] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.004115] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.005339] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.006846] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.008004] systemd[1]: Reached target Path Units. machine # [ 2.008901] systemd[1]: Reached target Slice Units. machine # [ 2.009853] systemd[1]: Reached target Swaps. machine # [ 2.010729] systemd[1]: Reached target Timer Units. machine # [ 2.011798] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.013091] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.014240] systemd[1]: Listening on Journal Sockets. machine # [ 2.015242] systemd[1]: Listening on udev Control Socket. machine # [ 2.016339] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.017353] systemd[1]: Reached target Socket Units. machine # [ 2.019338] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.021453] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.024705] systemd[1]: Starting Journal Service... machine # [ 2.027736] systemd[1]: Starting Load Kernel Modules... machine # [ 2.028943] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.035676] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.037705] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.039330] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.044549] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.046108] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.050117] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.055626] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.057963] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.059828] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.065804] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.065916] systemd-journald[93]: Collecting audit messages is disabled. machine # [ 2.072893] systemd[1]: Finished Load Kernel Modules. machine # [ 2.083828] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.087181] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.088579] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.089876] systemd[1]: Reached target Local File Systems. machine # [ 2.092068] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.103812] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.107678] systemd[1]: Started Journal Service. machine # [ 1.954223] systemd-modules-load[94]: Using 4 probe threads machine # [ 1.956432] systemd-modules-load[94]: Inserted module 'virtio_balloon' machine # [ 1.957621] systemd-modules-load[94]: Inserted module 'dm_mod' machine # [ 1.958705] systemd-modules-load[94]: Inserted module 'virtio_gpu' machine # [ 1.959739] systemd[1]: Starting Create System Files and Directories... machine # [ 1.962042] systemd-udevd[104]: Using default interface naming scheme 'v261'. machine # [ 1.971935] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.980032] systemd[1]: Finished Create System Files and Directories. machine # [ 2.003193] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.004096] systemd[1]: Reached target System Initialization. machine # [ 2.004903] systemd[1]: Reached target Basic System. machine # [ 2.253172] SCSI subsystem initialized machine # [ 2.254408] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.257047] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.259322] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.260154] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.267525] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.268325] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.270024] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.277619] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.280127] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.281889] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.283379] usb usb1: Product: EHCI Host Controller machine # [ 2.284182] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.284965] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.291920] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.294508] hub 1-0:1.0: USB hub found machine # [ 2.295476] hub 1-0:1.0: 6 ports detected machine # [ 2.302225] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.303388] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.306764] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.307636] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.310333] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.313850] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.314961] usb usb2: Product: UHCI Host Controller machine # [ 2.315738] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.316556] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 2.320946] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.168162] (udev-worker)[119]: Network inter[ 2.322228] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # face NamePolicy= disabled on kernel command line[ 2.323437] ahci 0000:00:1f.2: flags: 64bit ncq only machine # . machine # [ 2.331735] hub 2-0:1.0: USB hub found machine # [ 2.333357] hub 2-0:1.0: 2 ports detected machine # [ 2.335055] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.337995] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.340084] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.341479] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.342651] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.191137] (udev-worker)[126]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.347228] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.348649] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.349675] scsi host0: ahci machine # [ 2.350204] usb usb3: Product: UHCI Host Controller machine # [ 2.351133] scsi host1: ahci machine # [ 2.351171] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.351681] scsi host2: ahci machine # [ 2.352011] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.353569] scsi host3: ahci machine # [ 2.354117] hub 3-0:1.0: USB hub found machine # [ 2.355014] scsi host4: ahci machine # [ 2.355209] hub 3-0:1.0: 2 ports detected machine # [ 2.355905] scsi host5: ahci machine # [ 2.356811] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.196621] (udev-worker)[126]: Network inter[ 2.356819] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # face NamePolicy= disabled on kernel command line.[ 2.356824] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # machine # [ 2.356830] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.209164] systemd[1]: Starting Virtual Console Setup...[ 2.356835] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # machine # [ 2.211672] systemd[1]: Found[ 2.356844] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # device /dev/disk/by-label/nixos.[ 2.358546] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # machine # [ 2.214358] systemd[1]: Reached target Initrd Root Device. machine # [ 2.367424] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.215500] systemd[1]: Starting File System Check on /dev/di[ 2.367451] uhci_hcd 0000:00:1d.2: detected 2 ports machine # sk/by-label/nixos... machine # [ 2.367674] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.368034] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.368037] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.368039] usb usb4: Product: UHCI Host Controller machine # [ 2.368040] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.368042] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.368248] hub 4-0:1.0: USB hub found machine # [ 2.368285] hub 4-0:1.0: 2 ports detected machine # [ 2.233088] systemd-vconsole-setup[146]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.235840] systemd-fsck[174]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.237162] systemd[1]: Finished Virtual Console Setup. machine # [ 2.238835] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.538747] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.670048] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.673318] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.676176] usb 1-1: Product: QEMU USB Tablet machine # [ 2.677901] usb 1-1: Manufacturer: QEMU machine # [ 2.679404] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.681603] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.684054] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.687551] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.689959] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.692670] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.694811] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.696975] ata3.00: applying bridge limits machine # [ 2.699010] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.701337] ata3.00: configured for UDMA/100 machine # [ 2.704067] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.717204] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.737343] usbcore: registered new interface driver usbhid machine # [ 2.739738] usbhid: USB HID core driver machine # [ 2.755756] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.759954] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.777009] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.813096] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.886832] systemd[1]: Mounting /sysroot... machine # [ 3.282425] EXT4-fs (vda): mounted filesystem f13dcb49-ec49-4a91-92b8-a84b4f79fbb5 r/w with ordered data mode. Quota mode: none. machine # [ 3.167082] systemd[1]: Mounted /sysroot. machine # [ 3.168904] systemd[1]: Reached target Initrd Root File System. machine # [ 3.172595] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.174696] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.178124] systemd[1]: Mounting /sysroot/run... machine # [ 3.182224] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.190371] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.193627] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.205916] systemd[1]: Mounted /sysroot/run. machine # [ 3.209110] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.211278] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.218120] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.220376] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.222495] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.228395] systemd-sysroot-fstab-check[194]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.231932] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.233894] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.235869] systemd[1]: Reload requested from client PID 194 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.238566] systemd[1]: Reloading... machine # [ 3.313159] systemd[1]: Reloading finished in 76 ms. machine # [ 3.336686] systemd-sysroot-fstab-check[194]: Requesting initrd-fs.target/start/replace... machine # [ 3.339707] systemd-sysroot-fstab-check[194]: Requesting swap.target/start/replace... machine # [ 3.342555] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.344705] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.347120] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.349425] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.370399] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.372662] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.887838] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.940728] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.943504] systemd[1]: Reached target Initrd File Systems. machine # [ 3.947475] systemd[1]: Starting Find NixOS closure... machine # [ 3.950864] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.973549] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.976529] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.991662] systemd[1]: Finished Find NixOS closure. machine # [ 3.993522] systemd[1]: Reached target Initrd Default Target. machine # [ 3.995969] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.031687] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.033734] systemd[1]: Stopped target Basic System. machine # [ 4.035455] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.037395] systemd[1]: Stopped target Path Units. machine # [ 4.039171] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.041639] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.045223] systemd[1]: Stopped target Slice Units. machine # [ 4.047339] systemd[1]: Stopped target Socket Units. machine # [ 4.050413] systemd[1]: Stopped target System Initialization. machine # [ 4.052744] systemd[1]: Stopped target Swaps. machine # [ 4.054289] systemd[1]: Stopped target Timer Units. machine # [ 4.057379] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.059775] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.061758] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.064217] systemd[1]: Stopped Find NixOS closure. machine # [ 4.065908] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.067898] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.070181] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.071962] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.073975] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.075583] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.077655] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.079672] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.081557] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.083338] systemd[1]: Stopped target Local File Systems. machine # [ 4.084848] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.086640] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.088545] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.090137] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.092312] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.094603] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.096123] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.097322] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.098349] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.099383] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.100496] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.101571] systemd[1]: Closed udev Control Socket. machine # [ 4.102451] systemd[1]: Starting Cleanup udev Database... machine # [ 4.103298] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.104574] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.105648] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.107111] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.108218] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.109328] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.110299] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.111398] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.122701] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.123961] systemd[1]: Finished Cleanup udev Database. machine # [ 4.124893] systemd[1]: Reached target Switch Root. machine # [ 4.126284] systemd[1]: Starting NixOS Activation... machine # [ 4.287238] initrd-nixos-activation-start[240]: booting system configuration /nix/store/387dxxcc4npn8ihah5fly5k4grgn2x7c-nixos-system-machine-test machine # [ 4.355827] initrd-nixos-activation-start[240]: running activation script... machine # [ 4.718786] initrd-nixos-activation-start[263]: setting up /etc... machine # [ 4.918372] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.921210] systemd[1]: Finished NixOS Activation. machine # [ 4.923090] systemd[1]: Starting Switch Root... machine # [ 4.938523] systemd[1]: Switching root. machine # [ 5.150690] systemd-journald[93]: Received SIGTERM from PID 1 (systemd). machine # [ 5.278792] NET: Registered PF_VSOCK protocol family machine # [ 5.666332] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.676746] systemd[1]: Detected virtualization kvm. machine # [ 5.678605] systemd[1]: Detected architecture x86-64. machine # [ 5.680649] systemd[1]: Detected first boot. machine # [ 5.685613] systemd[1]: Initializing machine ID from random generator. machine # [ 5.854728] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.949311] systemd[1]: Applying preset policy. machine # [ 6.161552] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.415462] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.416920] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.419005] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.421324] systemd[1]: Created slice Slice /system/getty. machine # [ 6.422863] systemd[1]: Created slice User and Session Slice. machine # [ 6.423814] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.425182] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.426330] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.427184] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.428059] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.428971] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.429794] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.430762] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.431715] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.432768] systemd[1]: Reached target Path Units. machine # [ 6.433583] systemd[1]: Reached target Remote File Systems. machine # [ 6.434423] systemd[1]: Reached target Slice Units. machine # [ 6.435160] systemd[1]: Reached target Swaps. machine # [ 6.437337] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.440233] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.442268] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.444554] systemd[1]: Listening on Factory Reset Management. machine # [ 6.445588] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.448910] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.450229] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.452496] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.453655] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.454999] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.456529] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.461866] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.463057] systemd[1]: Listening on udev Control Socket. machine # [ 6.464065] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.466765] systemd[1]: Mounting Huge Pages File System... machine # [ 6.469087] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.471894] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.484951] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.490176] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.496090] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.498375] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.501954] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.505875] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.512646] systemd[1]: Mounting FUSE Control File System... machine # [ 6.515099] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.525360] systemd[1]: Starting Journal Service... machine # [ 6.529083] systemd[1]: Starting Load Kernel Modules... machine # [ 6.535632] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.544885] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.545973] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.549016] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.551802] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.552880] systemd[1]: Mounted Huge Pages File System. machine # [ 6.553920] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.555012] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.556006] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.557450] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.558847] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.560346] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.561510] systemd[1]: Mounted FUSE Control File System. machine # [ 6.564449] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.567448] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.585394] systemd-journald[334]: Collecting audit messages is enabled. machine # [ 6.589916] EXT4-fs (vda): re-mounted f13dcb49-ec49-4a91-92b8-a84b4f79fbb5. machine # [ 6.590104] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.593605] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.595359] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.596406] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.596663] loop: module loaded machine # [ 6.598411] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.599766] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.447474] systemd[1]: Queued start job for default target M[ 6.601486] systemd[1]: Started Journal Service. machine # ulti-User System. machine # [ 6.449529] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.450919] systemd-modules-load[335]: Using 2 probe threads machine # [ 6.452093] systemd-modules-load[335]: Inserted module 'loop' machine # [ 6.453420] systemd-oomd[336]: No swap; memory pressure usage will be degraded machine # [ 6.457673] systemd[1]: Finished Load Kernel Modules. machine # [ 6.458547] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.465053] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.466960] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.474071] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.475612] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.481953] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.482790] systemd[1]: Reached target First Boot Complete. machine # [ 6.642099] systemd-journald[334]: Received client request to flush runtime journal. machine # [ 6.540340] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.541452] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.542757] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.543705] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.544973] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.556033] systemd-udevd[363]: Using default interface naming scheme 'v261'. machine # [ 6.591876] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.592953] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.660212] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.687619] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.700538] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.706954] (udev-worker)[377]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.709183] (udev-worker)[377]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.718812] (udev-worker)[381]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.733269] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.734480] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.736134] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.738447] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.740160] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.741571] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.914502] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.917043] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.929906] mousedev: PS/2 mouse device common for all mice machine # [ 6.930913] Console: switching to colour dummy device 80x25 machine # [ 6.933082] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.933591] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.934883] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.935698] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.942200] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.951391] Console: switching to colour frame buffer device 160x50 machine # [ 6.952378] ACPI: button: Power Button [PWRF] machine # [ 6.953263] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.958801] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.990136] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.993225] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.993979] rtc_cmos PNP0B00:00: setting system clock to 2026-09-27T14:42:04 UTC (1790520124) machine # [ 6.995362] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.995750] systemd-journald[334]: Time jumped backwards, rotating. machine # [ 7.001696] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 7.003352] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 7.024859] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.025896] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.931939] systemd[1]: Starting Virtual Console Setup... machine # [ 7.087146] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.089723] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.942943] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.951538] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.110301] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.115780] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.967566] systemd[1]: Starting Virtual Console Setup... machine # [ 6.976234] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.981605] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.000283] systemd[1]: Starting Virtual Console Setup... machine # [ 7.161726] ppdev: user-space parallel port driver machine # [ 7.187723] kvm_amd: TSC scaling supported machine # [ 7.188227] kvm_amd: Nested Virtualization enabled machine # [ 7.188855] kvm_amd: Nested Paging enabled machine # [ 7.189430] kvm_amd: LBR virtualization supported machine # [ 7.189990] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.190652] kvm_amd: Virtual GIF supported machine # [ 7.191100] kvm_amd: Virtual NMI enabled machine # [ 7.291238] EDAC MC: Ver: 3.0.0 machine # [ 7.175396] systemd-vconsole-setup[409]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.179333] systemd[1]: Finished Virtual Console Setup. machine # [ 7.267347] systemd[1]: Mounting /run/wrappers... machine # [ 7.302698] systemd[1]: Mounted /run/wrappers. machine # [ 7.304287] systemd[1]: Reached target Local File Systems. machine # [ 7.307793] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.310814] systemd[1]: Starting register-nix-paths.service... machine # [ 7.313506] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.315384] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.318457] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.320682] systemd[1]: Starting Create System Files and Directories... machine # [ 7.390460] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.394989] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.412316] systemd[1]: Finished Create System Files and Directories. machine # [ 7.415139] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.417073] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.451233] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.462750] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.465498] systemd[1]: Starting Update is Completed... machine # [ 7.487420] systemd[1]: Finished Update is Completed. machine # [ 7.610885] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.612074] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.842295] systemd[1]: Finished register-nix-paths.service. machine # [ 7.844596] systemd[1]: Reached target System Initialization. machine # [ 7.846734] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.849342] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.851574] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.853937] systemd[1]: Reached target Timer Units. machine # [ 7.855882] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.859769] systemd[1]: Listening on niks3 server socket. machine # [ 7.862129] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.864247] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.867297] systemd[1]: Reached target Socket Units. machine # [ 7.869299] systemd[1]: Reached target Basic System. machine # [ 7.871319] systemd[1]: Started backdoor.service. machine # [ 7.873384] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.882197] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.884648] systemd[1]: Starting Post-Boot Actions... machine # [ 7.886781] systemd[1]: Started Reset console on configuration changes. machine # [ 7.889530] systemd[1]: Starting resolvconf update... machine # [ 7.894038] systemd[1]: Started rustfs.service. machine # [ 7.897952] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.904181] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.942494] nsncd[492]: Sep 27 14:42:05.599 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.945270] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.947001] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.948146] systemd[1]: Reached target User and Group Name Lookups. machine # connecting to host... machine # [ 7.949478] systemd[1]: Starting User Login Management... machine # [ 7.950457] systemd[1]: Finished Post-Boot Actions. machine # [ 7.977387] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 8.62 seconds) machine: (finished: waiting for the VM to finish booting, in 8.96 seconds) machine # [ 8.015912] dbus-broker-launch[498]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 8.025094] systemd-logind[520]: New seat seat0. machine # [ 8.026870] dbus-broker-launch[498]: NSS returned no entry for 'systemd-timesync' machine # [ 8.028933] dbus-broker-launch[498]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 8.033104] systemd-logind[520]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 8.034667] systemd-logind[520]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 8.036338] systemd-logind[520]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 8.037703] systemd[1]: Started User Login Management. machine # [ 8.039406] systemd[1]: Starting linger-users.service... machine # [ 8.052371] systemd[1]: Started D-Bus System Message Bus. machine # [ 8.057928] dbus-broker-launch[498]: Ready machine # [ 8.065101] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.067116] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.067588] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.068120] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.068587] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.071920] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.072383] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.076132] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.076576] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.077453] systemd[1]: Finished linger-users.service. machine # [ 8.115516] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.116436] nsncd[597]: Sep 27 14:42:05.773 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.116948] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.117447] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.140783] systemd[1]: Finished resolvconf update. machine # [ 8.141294] systemd[1]: Reached target Preparation for Network. machine # [ 8.143902] systemd[1]: Starting DHCP Client... machine # [ 8.145378] systemd[1]: Starting Address configuration of eth1... machine # [ 8.147242] systemd[1]: Starting Extra networking commands.... machine # [ 8.210841] network-addresses-eth1-start[626]: adding address 192.168.1.1/24... done machine # [ 8.220430] network-addresses-eth1-start[626]: adding address 2001:db8:1::1/64... done machine # [ 8.239253] systemd[1]: Finished Address configuration of eth1. machine # [ 8.240604] dhcpcd[635]: dhcpcd-10.3.2 starting machine # [ 8.247311] dhcpcd[683]: dev: loaded udev machine # [ 8.413262] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.414440] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.268884] systemd[1]: Finished Extra networking commands.. machine # [ 8.269894] systemd[1]: Reached target Network. machine # [ 8.272267] systemd[1]: Starting PostgreSQL Server... machine # [ 8.273818] systemd[1]: Starting Permit User Sessions... machine # [ 8.284596] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.297509] systemd[1]: Finished Permit User Sessions. machine # [ 8.300147] systemd[1]: Started Getty on tty1. machine # [ 8.300749] systemd[1]: Reached target Login Prompts. machine # [ 8.519609] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.535193] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.536397] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.538400] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.539697] cfg80211: failed to load regulatory.db machine # [ 8.580015] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.429217] dhcpcd[683]: eth0: waiting for carrier machine # [ 8.430081] dhcpcd[683]: eth0: carrier acquired machine # [ 8.432618] postgresql-pre-start[713]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.434193] postgresql-pre-start[713]: This user must also own the server process. machine # [ 8.436533] dhcpcd[683]: DUID 00:01:00:01:32:4b:e7:be:52:54:00:12:34:56 machine # [ 8.437051] dhcpcd[683]: eth0: IAID 00:12:34:56 machine # [ 8.437603] dhcpcd[683]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.439416] postgresql-pre-start[713]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.440045] postgresql-pre-start[713]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.440487] postgresql-pre-start[713]: The default text search configuration will be set to "english". machine # [ 8.441025] postgresql-pre-start[713]: Data page checksums are enabled. machine # [ 8.443793] postgresql-pre-start[713]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.445687] postgresql-pre-start[713]: creating subdirectories ... ok machine # [ 8.446621] postgresql-pre-start[713]: selecting dynamic shared memory implementation ... posix machine # [ 8.509635] postgresql-pre-start[713]: selecting default "max_connections" ... 100 machine # [ 8.569215] postgresql-pre-start[713]: selecting default "shared_buffers" ... 128MB machine # [ 9.327132] postgresql-pre-start[713]: selecting default time zone ... UTC machine # [ 9.328815] postgresql-pre-start[713]: creating configuration files ... ok machine # [ 9.437474] dhcpcd[683]: eth0: soliciting a DHCP lease machine # [ 9.611185] NET: Registered PF_PACKET protocol family machine # [ 9.472062] dhcpcd[683]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.476399] dhcpcd[683]: eth0: probing address 10.0.2.15/24 machine # [ 9.514939] postgresql-pre-start[713]: running bootstrap script ... ok machine # [ 9.933869] postgresql-pre-start[713]: performing post-bootstrap initialization ... ok machine # [ 10.180971] postgresql-pre-start[713]: syncing data to disk ... ok machine # [ 10.181702] postgresql-pre-start[713]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.182611] postgresql-pre-start[713]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.183498] postgresql-pre-start[713]: Success. You can now start the database server using: machine # [ 10.184238] postgresql-pre-start[713]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.297241] postgres[758]: [758] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.299738] postgres[758]: [758] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.300452] postgres[758]: [758] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.304233] postgres[758]: [758] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.316428] postgres[768]: [768] LOG: database system was shut down at 2026-09-27 14:42:07 GMT machine # [ 10.325236] postgres[758]: [758] LOG: database system is ready to accept connections machine # [ 10.332880] systemd[1]: Started PostgreSQL Server. machine # [ 10.337751] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.635073] postgresql-setup-start[779]: CREATE DATABASE machine # [ 10.678633] postgresql-setup-start[784]: CREATE ROLE machine # [ 10.697825] postgresql-setup-start[786]: ALTER DATABASE machine # [ 10.703957] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.705372] dhcpcd[683]: eth0: soliciting an IPv6 router machine # [ 10.706092] dhcpcd[683]: eth0: Router Advertisement from fe80::2 machine # [ 10.706749] systemd[1]: Reached target PostgreSQL. machine # [ 10.707367] dhcpcd[683]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.708161] dhcpcd[683]: eth0: adding route to fec0::/64 machine # [ 10.708759] dhcpcd[683]: eth0: adding default route via fe80::2 machine # [ 14.221579] dhcpcd[683]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.222165] dhcpcd[683]: eth0: adding route to 10.0.2.0/24 machine # [ 14.223748] dhcpcd[683]: eth0: adding default route via 10.0.2.2 machine # [ 14.351244] systemd[1]: Started DHCP Client. machine # [ 14.353831] systemd[1]: Reached target Network is Online. machine # [ 14.358569] systemd[1]: Starting k3s service... machine # [ 14.425752] k3s[877]: time="2026-09-27T14:42:12Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.426672] k3s[877]: time="2026-09-27T14:42:12Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 16.346098] rustfs-bucket-start[892]: mb s3://farm machine # [ 16.351774] systemd[1]: Finished rustfs-bucket.service. machine # [ 16.973059] k3s[877]: time="2026-09-27T14:42:14Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 17.507937] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.512918] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.514327] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.588668] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.589479] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.596973] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.602194] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.605989] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.609931] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.614618] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:15.270226941 +0000 UTC notAfter=2036-09-24 13:42:15.270226941 +0000 UTC" machine # [ 17.615383] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.616568] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.618439] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.620056] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.621124] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.622288] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.623426] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790520135: notBefore=2026-09-27 13:42:15.277683754 +0000 UTC notAfter=2036-09-24 13:42:15.277683754 +0000 UTC" machine # [ 17.624980] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.626933] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.628427] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.629947] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790520135: notBefore=2026-09-27 13:42:15.281348745 +0000 UTC notAfter=2036-09-24 13:42:15.281348745 +0000 UTC" machine # [ 17.631478] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.632580] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790520135: notBefore=2026-09-27 13:42:15.283015996 +0000 UTC notAfter=2036-09-24 13:42:15.283015996 +0000 UTC" machine # [ 17.633876] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.635106] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790520135: notBefore=2026-09-27 13:42:15.284896403 +0000 UTC notAfter=2036-09-24 13:42:15.284896403 +0000 UTC" machine # [ 17.635995] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.636919] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.777982] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790520135: notBefore=2026-09-27 13:42:15 +0000 UTC notAfter=2027-09-27 13:42:15 +0000 UTC" machine # [ 17.778434] k3s[877]: time="2026-09-27T14:42:15Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.833265] k3s[877]: time="2026-09-27T14:42:15Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__ae58_ced4_9a2b_856b-83e554:fec0::ae58:ced4:9a2b:856b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=ED0731C6F7E428E1AF4EFC7D3339EB79CAA4995A]" machine # [ 18.956357] k3s[877]: time="2026-09-27T14:42:16Z" level=info msg="Password verified locally for node machine" machine # [ 18.957363] k3s[877]: time="2026-09-27T14:42:16Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790520135: notBefore=2026-09-27 13:42:16 +0000 UTC notAfter=2027-09-27 13:42:16 +0000 UTC" machine # [ 19.234853] k3s[877]: time="2026-09-27T14:42:16Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:16 +0000 UTC notAfter=2027-09-27 13:42:16 +0000 UTC" machine # [ 19.323109] k3s[877]: time="2026-09-27T14:42:16Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:16 +0000 UTC notAfter=2027-09-27 13:42:16 +0000 UTC" machine # [ 19.411833] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790520135: notBefore=2026-09-27 13:42:17 +0000 UTC notAfter=2027-09-27 13:42:17 +0000 UTC" machine # [ 19.522556] k3s[877]: time="2026-09-27T14:42:17Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:44916: runtime core not ready" machine # [ 19.622816] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Module overlay was already loaded" machine # [ 19.866035] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.870650] Bridge firewalling registered machine # [ 19.731932] k3s[877]: time="2026-09-27T14:42:17Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.739407] k3s[877]: time="2026-09-27T14:42:17Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.749523] k3s[877]: time="2026-09-27T14:42:17Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.816664] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.820267] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.824175] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.828090] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.831353] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.834582] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.837188] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.839698] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.843460] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.846441] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Connection to etcd is ready" machine # [ 19.848671] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="ETCD server is now running" machine # [ 19.850840] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.852797] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.854514] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.856382] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.879490] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.885677] k3s[877]: I0927 14:42:17.487704 877 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.887141] k3s[877]: I0927 14:42:17.489626 877 server.go:158] Version: v1.35.8+k3s1 machine # [ 19.888262] k3s[877]: I0927 14:42:17.489649 877 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.889724] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.907736] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.915517] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.917174] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.919062] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.920734] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.922556] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.923888] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Run: k3s kubectl" machine # [ 19.924964] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.926668] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.928478] k3s[877]: time="2026-09-27T14:42:17Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:44974: runtime core not ready" machine # [ 19.930177] k3s[877]: I0927 14:42:17.582589 877 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.931851] k3s[877]: I0927 14:42:17.584988 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 19.933173] k3s[877]: I0927 14:42:17.586990 877 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.937830] k3s[877]: I0927 14:42:17.587074 877 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.942625] k3s[877]: I0927 14:42:17.587425 877 instance.go:240] Using reconciler: lease machine # [ 19.943856] k3s[877]: I0927 14:42:17.599784 877 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.945386] k3s[877]: W0927 14:42:17.599806 877 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.948146] k3s[877]: I0927 14:42:17.603167 877 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.991594] k3s[877]: I0927 14:42:17.650705 877 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.992044] k3s[877]: I0927 14:42:17.651483 877 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 20.016508] k3s[877]: I0927 14:42:17.675939 877 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 20.021053] k3s[877]: time="2026-09-27T14:42:17Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 20.041993] k3s[877]: I0927 14:42:17.701418 877 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 20.042165] k3s[877]: W0927 14:42:17.701463 877 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 20.042637] k3s[877]: W0927 14:42:17.701476 877 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 20.043243] k3s[877]: I0927 14:42:17.701777 877 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 20.043656] k3s[877]: W0927 14:42:17.701793 877 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.044212] k3s[877]: I0927 14:42:17.702269 877 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 20.044733] k3s[877]: I0927 14:42:17.702647 877 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 20.045444] k3s[877]: W0927 14:42:17.702663 877 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 20.045981] k3s[877]: W0927 14:42:17.702675 877 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 20.046683] k3s[877]: I0927 14:42:17.703426 877 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 20.047032] k3s[877]: W0927 14:42:17.703445 877 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 20.047513] k3s[877]: I0927 14:42:17.704103 877 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 20.048041] k3s[877]: W0927 14:42:17.704122 877 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 20.048506] k3s[877]: W0927 14:42:17.704134 877 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 20.049093] k3s[877]: I0927 14:42:17.704659 877 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 20.049576] k3s[877]: W0927 14:42:17.704676 877 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 20.050126] k3s[877]: W0927 14:42:17.704688 877 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 20.050588] k3s[877]: I0927 14:42:17.705097 877 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 20.051124] k3s[877]: W0927 14:42:17.705246 877 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 20.051682] k3s[877]: I0927 14:42:17.707153 877 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 20.052206] k3s[877]: W0927 14:42:17.707175 877 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 20.052655] k3s[877]: I0927 14:42:17.707542 877 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 20.053189] k3s[877]: W0927 14:42:17.707557 877 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 20.053657] k3s[877]: W0927 14:42:17.707568 877 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 20.054220] k3s[877]: I0927 14:42:17.708203 877 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 20.054696] k3s[877]: W0927 14:42:17.708223 877 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 20.055195] k3s[877]: I0927 14:42:17.709778 877 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 20.055672] k3s[877]: W0927 14:42:17.709796 877 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.056440] k3s[877]: W0927 14:42:17.709808 877 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 20.056976] k3s[877]: I0927 14:42:17.710371 877 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 20.057683] k3s[877]: W0927 14:42:17.710406 877 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 20.058443] k3s[877]: W0927 14:42:17.710417 877 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 20.059051] k3s[877]: I0927 14:42:17.712276 877 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 20.059545] k3s[877]: W0927 14:42:17.712299 877 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 20.060062] k3s[877]: W0927 14:42:17.712310 877 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 20.060552] k3s[877]: I0927 14:42:17.713776 877 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 20.061096] k3s[877]: W0927 14:42:17.713795 877 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 20.061585] k3s[877]: W0927 14:42:17.713807 877 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 20.062140] k3s[877]: W0927 14:42:17.713818 877 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 20.062651] k3s[877]: I0927 14:42:17.721915 877 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 20.063179] k3s[877]: W0927 14:42:17.721941 877 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 20.063662] k3s[877]: W0927 14:42:17.721953 877 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 20.066695] k3s[877]: I0927 14:42:17.726074 877 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 20.067235] k3s[877]: W0927 14:42:17.726106 877 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.067761] k3s[877]: W0927 14:42:17.726117 877 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 20.068475] k3s[877]: I0927 14:42:17.726885 877 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 20.069191] k3s[877]: W0927 14:42:17.726902 877 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 20.073490] k3s[877]: I0927 14:42:17.732091 877 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 20.074170] k3s[877]: W0927 14:42:17.732130 877 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 20.074740] k3s[877]: W0927 14:42:17.732143 877 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 20.075416] k3s[877]: W0927 14:42:17.732153 877 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 20.118715] k3s[877]: I0927 14:42:17.735792 877 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 20.119625] k3s[877]: W0927 14:42:17.735814 877 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.404055] k3s[877]: I0927 14:42:18.063282 877 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.404353] k3s[877]: I0927 14:42:18.063283 877 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.404824] k3s[877]: I0927 14:42:18.063687 877 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.405452] k3s[877]: I0927 14:42:18.063800 877 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.411675] k3s[877]: I0927 14:42:18.071085 877 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 20.412138] k3s[877]: I0927 14:42:18.071427 877 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.412551] k3s[877]: I0927 14:42:18.071451 877 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.413124] k3s[877]: I0927 14:42:18.071934 877 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.413594] k3s[877]: I0927 14:42:18.072277 877 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.414205] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.414695] k3s[877]: I0927 14:42:18.072852 877 controller.go:142] Starting OpenAPI controller machine # [ 20.415408] k3s[877]: I0927 14:42:18.072909 877 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.415919] k3s[877]: I0927 14:42:18.072914 877 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.416573] k3s[877]: I0927 14:42:18.072993 877 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.417121] k3s[877]: I0927 14:42:18.073147 877 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.417587] k3s[877]: I0927 14:42:18.073773 877 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 20.418166] k3s[877]: I0927 14:42:18.073842 877 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 20.430987] k3s[877]: I0927 14:42:18.080560 877 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.431488] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.432214] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.432746] k3s[877]: I0927 14:42:18.081342 877 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.433436] k3s[877]: I0927 14:42:18.081372 877 naming_controller.go:305] Starting NamingConditionController machine # [ 20.434111] k3s[877]: I0927 14:42:18.081432 877 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.434609] k3s[877]: I0927 14:42:18.081462 877 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.435177] k3s[877]: I0927 14:42:18.081491 877 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 20.442066] k3s[877]: I0927 14:42:18.101057 877 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.442365] k3s[877]: I0927 14:42:18.101264 877 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.442886] k3s[877]: I0927 14:42:18.101282 877 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.443593] k3s[877]: I0927 14:42:18.101331 877 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 20.444156] k3s[877]: I0927 14:42:18.101341 877 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.444644] k3s[877]: I0927 14:42:18.101389 877 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.445176] k3s[877]: I0927 14:42:18.101400 877 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.445628] k3s[877]: I0927 14:42:18.101445 877 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 20.454651] k3s[877]: I0927 14:42:18.114101 877 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.455184] k3s[877]: I0927 14:42:18.114147 877 controller.go:78] Starting OpenAPI AggregationController machine # [ 20.458442] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.458863] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.459486] k3s[877]: I0927 14:42:18.117974 877 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.462603] k3s[877]: I0927 14:42:18.122050 877 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.513041] k3s[877]: I0927 14:42:18.172294 877 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.513286] k3s[877]: I0927 14:42:18.172346 877 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.513747] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.514484] k3s[877]: I0927 14:42:18.172625 877 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.514970] k3s[877]: I0927 14:42:18.173941 877 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 20.515681] k3s[877]: I0927 14:42:18.173973 877 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 20.522554] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.523336] k3s[877]: I0927 14:42:18.182759 877 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 20.525682] k3s[877]: I0927 14:42:18.185109 877 shared_informer.go:377] "Caches are synced" machine # [ 20.526178] k3s[877]: I0927 14:42:18.185151 877 policy_source.go:248] refreshing policies machine # [ 20.527377] k3s[877]: E0927 14:42:18.186817 877 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 20.542744] k3s[877]: I0927 14:42:18.202103 877 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.544370] k3s[877]: I0927 14:42:18.202143 877 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.558928] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.559498] k3s[877]: I0927 14:42:18.218315 877 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.560330] k3s[877]: I0927 14:42:18.218384 877 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 20.563300] k3s[877]: I0927 14:42:18.222617 877 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 20.564055] k3s[877]: I0927 14:42:18.222707 877 aggregator.go:187] initial CRD sync complete... machine # [ 20.564762] k3s[877]: I0927 14:42:18.222727 877 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.565657] k3s[877]: I0927 14:42:18.222742 877 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.569173] k3s[877]: I0927 14:42:18.222754 877 cache.go:39] Caches are synced for autoregister controller machine # [ 20.572519] k3s[877]: E0927 14:42:18.231936 877 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 20.582144] k3s[877]: time="2026-09-27T14:42:18Z" level=error msg="Error while syncing ConfigMap" configmap=kube-system/kube-apiserver-legacy-service-account-token-tracking error="namespaces \"kube-system\" not found" logger=k3s/UnhandledError machine # [ 20.616327] k3s[877]: I0927 14:42:18.275707 877 controller.go:667] quota admission added evaluator for: namespaces machine # [ 20.624108] k3s[877]: I0927 14:42:18.283495 877 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.624699] k3s[877]: I0927 14:42:18.284003 877 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.632475] k3s[877]: I0927 14:42:18.291922 877 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.732489] k3s[877]: I0927 14:42:18.391739 877 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.852155] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="containerd is now running" machine # [ 20.861670] k3s[877]: time="2026-09-27T14:42:18Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 21.424528] k3s[877]: I0927 14:42:19.083149 877 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.434257] k3s[877]: I0927 14:42:19.093579 877 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.438465] k3s[877]: I0927 14:42:19.093628 877 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 21.823137] k3s[877]: time="2026-09-27T14:42:19Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 22.261159] k3s[877]: I0927 14:42:19.920481 877 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.301787] k3s[877]: I0927 14:42:19.961163 877 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 22.383172] k3s[877]: I0927 14:42:20.042484 877 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 22.388367] k3s[877]: W0927 14:42:20.047760 877 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 22.389798] k3s[877]: I0927 14:42:20.049239 877 controller.go:667] quota admission added evaluator for: endpoints machine # [ 22.394832] k3s[877]: I0927 14:42:20.054252 877 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 23.826480] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="Kube API server is now running" machine # [ 23.826655] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="k3s is up and running" machine # [ 23.827148] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="Waiting for untainted node" machine # [ 23.827806] systemd[1]: Started k3s service. machine # [ 23.830288] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.836088] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.837599] systemd[1]: Starting niks3 server... machine # [ 23.846767] k3s[877]: I0927 14:42:21.506201 877 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 23.848226] k3s[877]: I0927 14:42:21.506229 877 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.850752] k3s[877]: I0927 14:42:21.510204 877 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 23.851274] k3s[877]: I0927 14:42:21.510668 877 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.851711] k3s[877]: I0927 14:42:21.510689 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.852468] k3s[877]: I0927 14:42:21.510739 877 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.853883] k3s[877]: I0927 14:42:21.510822 877 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.854651] k3s[877]: I0927 14:42:21.510889 877 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.855217] k3s[877]: I0927 14:42:21.510910 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.856863] k3s[877]: I0927 14:42:21.510939 877 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.857629] k3s[877]: I0927 14:42:21.510954 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.865485] k3s[877]: I0927 14:42:21.524903 877 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.877400] k3s[877]: I0927 14:42:21.536802 877 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 23.877742] k3s[877]: I0927 14:42:21.536847 877 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 23.891487] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.893067] k3s[877]: I0927 14:42:21.552499 877 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 23.899476] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.903840] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.932336] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.951382] k3s[877]: I0927 14:42:21.610813 877 shared_informer.go:377] "Caches are synced" machine # [ 23.951830] k3s[877]: I0927 14:42:21.610962 877 shared_informer.go:377] "Caches are synced" machine # [ 23.952455] k3s[877]: I0927 14:42:21.611013 877 shared_informer.go:377] "Caches are synced" machine: (finished: waiting for unit k3s.service, in 24.94 seconds) machine # [ 23.974985] k3s[877]: I0927 14:42:21.634199 877 shared_informer.go:370] "Waiting for caches to sync" machine: waiting for success: kubectl get ns farm machine # [ 23.982627] k3s[877]: time="2026-09-27T14:42:21Z" level=info msg="Waiting for CRD addons.k3s.cattle.io to become available" machine # [ 23.985285] k3s[877]: I0927 14:42:21.644723 877 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.006783] k3s[877]: I0927 14:42:21.665501 877 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.009445] k3s[877]: I0927 14:42:21.668709 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 24.010096] k3s[877]: I0927 14:42:21.669567 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 24.012106] k3s[877]: I0927 14:42:21.671030 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 24.013971] k3s[877]: I0927 14:42:21.671067 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 24.015045] k3s[877]: I0927 14:42:21.671345 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 24.015827] k3s[877]: I0927 14:42:21.671373 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 24.017362] k3s[877]: I0927 14:42:21.671400 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 24.018806] k3s[877]: I0927 14:42:21.671437 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 24.020298] k3s[877]: I0927 14:42:21.671463 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 24.020999] k3s[877]: I0927 14:42:21.671497 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 24.021547] k3s[877]: I0927 14:42:21.672666 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 24.022029] k3s[877]: I0927 14:42:21.672697 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 24.022555] k3s[877]: I0927 14:42:21.673051 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 24.025111] k3s[877]: I0927 14:42:21.673082 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 24.025754] k3s[877]: I0927 14:42:21.673116 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 24.026440] k3s[877]: I0927 14:42:21.673152 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 24.026945] k3s[877]: I0927 14:42:21.673176 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 24.027614] k3s[877]: I0927 14:42:21.673214 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 24.028134] k3s[877]: I0927 14:42:21.673253 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 24.028605] k3s[877]: I0927 14:42:21.673281 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 24.028957] k3s[877]: I0927 14:42:21.673335 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 24.061126] k3s[877]: I0927 14:42:21.719751 877 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.076374] k3s[877]: I0927 14:42:21.735759 877 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.174975] k3s[877]: I0927 14:42:21.834355 877 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.510482] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Done waiting for CRD addons.k3s.cattle.io to become available" machine # [ 24.511340] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.524547] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.525275] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.530543] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.532102] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 24.533192] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 24.534418] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.535517] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.537099] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.538225] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.539376] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.540493] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.608066] k3s[877]: I0927 14:42:22.267333 877 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 24.613616] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::ae58:ced4:9a2b:856b 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.614276] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.782113] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__ae58_ced4_9a2b_856b-83e554:fec0::ae58:ced4:9a2b:856b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=ED0731C6F7E428E1AF4EFC7D3339EB79CAA4995A]" machine # [ 24.860971] k3s[877]: time="2026-09-27T14:42:22Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=231) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__ae58_ced4_9a2b_856b-83e554:fec0::ae58:ced4:9a2b:856b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=ED0731C6F7E428E1AF4EFC7D3339EB79CAA4995A]" machine # [ 25.015353] k3s[877]: I0927 14:42:22.674752 877 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 25.015579] k3s[877]: I0927 14:42:22.674778 877 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 25.352878] k3s[877]: I0927 14:42:23.012215 877 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 25.353123] k3s[877]: I0927 14:42:23.012279 877 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.821900] k3s[877]: time="2026-09-27T14:42:23Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.823111] k3s[877]: time="2026-09-27T14:42:23Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.829144] k3s[877]: I0927 14:42:23.487550 877 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.831814] k3s[877]: time="2026-09-27T14:42:23Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.834257] k3s[877]: time="2026-09-27T14:42:23Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.842840] k3s[877]: time="2026-09-27T14:42:23Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.848993] k3s[877]: time="2026-09-27T14:42:23Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.856664] k3s[877]: time="2026-09-27T14:42:23Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 26.070586] k3s[877]: I0927 14:42:23.729137 877 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 26.115967] k3s[877]: I0927 14:42:23.775129 877 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 26.269374] k3s[877]: W0927 14:42:23.928692 877 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 26.418762] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 26.433089] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 26.474027] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 26.477373] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 26.479857] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 26.481411] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 26.483597] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 26.485397] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 26.487555] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 26.495985] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 26.498591] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 26.501688] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 26.502212] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 26.505885] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 26.506444] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 26.509130] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 26.509875] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 26.515548] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine: (finished: waiting for success: kubectl get ns farm, in 2.64 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 26.677140] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 26.688932] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.12 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.821151] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 5.959927309s" machine # [ 26.821939] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 26.833901] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.13 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.13 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 27.048603] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 27.056386] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 27.056697] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 27.057222] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 27.057716] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 27.060544] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 27.062740] k3s[877]: time="2026-09-27T14:42:24Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 27.151698] k3s[877]: I0927 14:42:24.810748 877 serving.go:392] Generated self-signed cert in-memory machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.223547] k3s[877]: I0927 14:42:24.882932 877 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 27.284687] k3s[877]: I0927 14:42:24.944073 877 serving.go:392] Generated self-signed cert in-memory machine # [ 27.387697] k3s[877]: I0927 14:42:25.047051 877 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 27.391956] k3s[877]: I0927 14:42:25.051360 877 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 27.393512] k3s[877]: I0927 14:42:25.051893 877 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 27.395051] k3s[877]: I0927 14:42:25.051977 877 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 27.396616] k3s[877]: I0927 14:42:25.052002 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.397987] k3s[877]: I0927 14:42:25.052008 877 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 27.400259] k3s[877]: I0927 14:42:25.052030 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.401618] k3s[877]: I0927 14:42:25.052048 877 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 27.404184] k3s[877]: I0927 14:42:25.052065 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.405645] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 27.414059] k3s[877]: I0927 14:42:25.072682 877 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 27.416058] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 27.419534] k3s[877]: I0927 14:42:25.076288 877 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 27.493142] k3s[877]: I0927 14:42:25.152504 877 shared_informer.go:377] "Caches are synced" machine # [ 27.494531] k3s[877]: I0927 14:42:25.152567 877 shared_informer.go:377] "Caches are synced" machine # [ 27.495794] k3s[877]: I0927 14:42:25.152629 877 shared_informer.go:377] "Caches are synced" machine # [ 27.630183] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 27.639291] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 27.646902] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 27.655700] k3s[877]: W0927 14:42:25.315089 877 controllermanager.go:306] "node-route-controller" is disabled machine # [ 27.656408] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 27.657467] k3s[877]: I0927 14:42:25.315407 877 controllermanager.go:329] Started "cloud-node-controller" machine # [ 27.659215] k3s[877]: I0927 14:42:25.315571 877 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 27.660302] k3s[877]: I0927 14:42:25.315974 877 controllermanager.go:329] Started "service-lb-controller" machine # [ 27.662243] k3s[877]: I0927 14:42:25.316030 877 node_controller.go:176] Sending events to api server. machine # [ 27.663735] k3s[877]: I0927 14:42:25.316118 877 node_lifecycle_controller.go:112] Sending events to api server machine # [ 27.664670] k3s[877]: I0927 14:42:25.316199 877 node_controller.go:185] Waiting for informer caches to sync machine # [ 27.665929] k3s[877]: I0927 14:42:25.316445 877 controller.go:235] Starting service controller machine # [ 27.667161] k3s[877]: I0927 14:42:25.316473 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.714341] k3s[877]: I0927 14:42:25.373769 877 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 27.836846] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.868911] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 27.897405] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 27.957503] k3s[877]: I0927 14:42:25.616830 877 shared_informer.go:377] "Caches are synced" machine # [ 28.018238] k3s[877]: I0927 14:42:25.677477 877 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 28.018644] k3s[877]: I0927 14:42:25.677601 877 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 28.022718] k3s[877]: I0927 14:42:25.682057 877 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 28.031116] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 28.042664] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 28.223720] k3s[877]: time="2026-09-27T14:42:25Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 28.255686] k3s[877]: I0927 14:42:25.915043 877 controller.go:667] quota admission added evaluator for: jobs.batch machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.364097] k3s[877]: I0927 14:42:26.023490 877 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 28.365297] k3s[877]: I0927 14:42:26.024763 877 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 28.373779] k3s[877]: time="2026-09-27T14:42:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 28.385078] k3s[877]: time="2026-09-27T14:42:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 28.418076] k3s[877]: I0927 14:42:26.076850 877 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.418402] k3s[877]: I0927 14:42:26.076931 877 taint_eviction.go:288] "Sending events to API server" machine # [ 28.418876] k3s[877]: I0927 14:42:26.076946 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.426263] k3s[877]: I0927 14:42:26.085540 877 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.426540] k3s[877]: I0927 14:42:26.085576 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.427109] k3s[877]: I0927 14:42:26.086569 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.427608] k3s[877]: I0927 14:42:26.086619 877 disruption.go:458] "Sending events to api server." machine # [ 28.428148] k3s[877]: I0927 14:42:26.086681 877 disruption.go:465] "Starting disruption controller" machine # [ 28.428649] k3s[877]: I0927 14:42:26.086692 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.431088] k3s[877]: I0927 14:42:26.086827 877 stateful_set.go:180] "Starting stateful set controller" machine # [ 28.431880] k3s[877]: I0927 14:42:26.086876 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.432584] k3s[877]: I0927 14:42:26.087031 877 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 28.433151] k3s[877]: I0927 14:42:26.087051 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.433693] k3s[877]: I0927 14:42:26.087147 877 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.437518] k3s[877]: I0927 14:42:26.087167 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.438078] k3s[877]: I0927 14:42:26.087199 877 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.438609] k3s[877]: I0927 14:42:26.087220 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.439197] k3s[877]: I0927 14:42:26.087255 877 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.439694] k3s[877]: I0927 14:42:26.087300 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.440419] k3s[877]: I0927 14:42:26.087331 877 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.440972] k3s[877]: I0927 14:42:26.087450 877 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 28.441669] k3s[877]: I0927 14:42:26.087470 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.442423] k3s[877]: I0927 14:42:26.087500 877 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.443021] k3s[877]: I0927 14:42:26.087540 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.443490] k3s[877]: I0927 14:42:26.092644 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.444095] k3s[877]: I0927 14:42:26.092750 877 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 28.447072] k3s[877]: I0927 14:42:26.092771 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.447789] k3s[877]: I0927 14:42:26.092823 877 gc_controller.go:98] "Starting GC controller" machine # [ 28.448477] k3s[877]: I0927 14:42:26.092881 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.449124] k3s[877]: I0927 14:42:26.092933 877 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 28.449595] k3s[877]: I0927 14:42:26.092975 877 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 28.450185] k3s[877]: I0927 14:42:26.092985 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.450680] k3s[877]: I0927 14:42:26.093066 877 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.451459] k3s[877]: I0927 14:42:26.093085 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.455152] k3s[877]: I0927 14:42:26.093333 877 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.455342] k3s[877]: I0927 14:42:26.093348 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.455825] k3s[877]: I0927 14:42:26.095625 877 job_controller.go:254] "Starting job controller" machine # [ 28.456568] k3s[877]: I0927 14:42:26.095643 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.457176] k3s[877]: I0927 14:42:26.095697 877 horizontal.go:204] "Starting HPA controller" machine # [ 28.457762] k3s[877]: I0927 14:42:26.095725 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.458751] k3s[877]: I0927 14:42:26.095784 877 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.459483] k3s[877]: I0927 14:42:26.095803 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.460083] k3s[877]: I0927 14:42:26.095834 877 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.460735] k3s[877]: I0927 14:42:26.095852 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.461455] k3s[877]: I0927 14:42:26.095956 877 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.464564] k3s[877]: I0927 14:42:26.096006 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.465576] k3s[877]: I0927 14:42:26.096092 877 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.466161] k3s[877]: I0927 14:42:26.096127 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.466662] k3s[877]: I0927 14:42:26.096217 877 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 28.467402] k3s[877]: I0927 14:42:26.096236 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.467965] k3s[877]: I0927 14:42:26.096300 877 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.468639] k3s[877]: I0927 14:42:26.096322 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.472083] k3s[877]: I0927 14:42:26.096355 877 expand_controller.go:328] "Starting expand controller" machine # [ 28.472638] k3s[877]: I0927 14:42:26.096375 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.473241] k3s[877]: I0927 14:42:26.096405 877 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 28.475065] k3s[877]: I0927 14:42:26.096424 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.475791] k3s[877]: I0927 14:42:26.096541 877 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.476608] k3s[877]: I0927 14:42:26.096586 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.477205] k3s[877]: I0927 14:42:26.096672 877 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.477847] k3s[877]: I0927 14:42:26.096690 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.478416] k3s[877]: I0927 14:42:26.096778 877 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 28.479062] k3s[877]: I0927 14:42:26.096811 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.479608] k3s[877]: I0927 14:42:26.096896 877 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 28.480179] k3s[877]: I0927 14:42:26.096916 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.480683] k3s[877]: I0927 14:42:26.097156 877 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 28.481406] k3s[877]: I0927 14:42:26.097202 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.481966] k3s[877]: I0927 14:42:26.097237 877 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.482635] k3s[877]: I0927 14:42:26.097258 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.483693] k3s[877]: I0927 14:42:26.097344 877 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 28.484395] k3s[877]: I0927 14:42:26.097363 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.484943] k3s[877]: I0927 14:42:26.097391 877 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 28.485653] k3s[877]: I0927 14:42:26.097413 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.486197] k3s[877]: I0927 14:42:26.097455 877 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.486729] k3s[877]: I0927 14:42:26.097500 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.487437] k3s[877]: I0927 14:42:26.097632 877 controller.go:423] "Starting resource claim controller" machine # [ 28.488033] k3s[877]: I0927 14:42:26.097651 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.488536] k3s[877]: I0927 14:42:26.098349 877 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.489105] k3s[877]: I0927 14:42:26.098370 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.489676] k3s[877]: I0927 14:42:26.098484 877 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.490401] k3s[877]: I0927 14:42:26.101546 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.491093] k3s[877]: I0927 14:42:26.101655 877 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.491651] k3s[877]: I0927 14:42:26.101717 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.492396] k3s[877]: I0927 14:42:26.101812 877 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.492986] k3s[877]: I0927 14:42:26.101832 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.493740] k3s[877]: I0927 14:42:26.101887 877 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.494585] k3s[877]: I0927 14:42:26.101906 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.495213] k3s[877]: I0927 14:42:26.101957 877 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.495429] k3s[877]: I0927 14:42:26.102542 877 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.496040] k3s[877]: I0927 14:42:26.102830 877 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 28.496596] k3s[877]: I0927 14:42:26.102876 877 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.499407] k3s[877]: I0927 14:42:26.103061 877 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.502465] k3s[877]: I0927 14:42:26.103245 877 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.505526] k3s[877]: I0927 14:42:26.109605 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmchartconfigs.helm.cattle.io" machine # [ 28.507585] k3s[877]: I0927 14:42:26.109688 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmcharts.helm.cattle.io" machine # [ 28.509679] k3s[877]: I0927 14:42:26.109812 877 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="addons.k3s.cattle.io" machine # [ 28.511608] k3s[877]: I0927 14:42:26.110051 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.539162] k3s[877]: I0927 14:42:26.198572 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.626833] k3s[877]: I0927 14:42:26.286235 877 shared_informer.go:377] "Caches are synced" machine # [ 28.628235] k3s[877]: I0927 14:42:26.286632 877 shared_informer.go:377] "Caches are synced" machine # [ 28.629488] k3s[877]: I0927 14:42:26.286775 877 shared_informer.go:377] "Caches are synced" machine # [ 28.630805] k3s[877]: I0927 14:42:26.287876 877 shared_informer.go:377] "Caches are synced" machine # [ 28.632237] k3s[877]: I0927 14:42:26.287943 877 shared_informer.go:377] "Caches are synced" machine # [ 28.632599] k3s[877]: I0927 14:42:26.287976 877 shared_informer.go:377] "Caches are synced" machine # [ 28.633637] k3s[877]: I0927 14:42:26.288009 877 shared_informer.go:377] "Caches are synced" machine # [ 28.634702] k3s[877]: I0927 14:42:26.288070 877 shared_informer.go:377] "Caches are synced" machine # [ 28.635651] k3s[877]: I0927 14:42:26.288302 877 shared_informer.go:377] "Caches are synced" machine # [ 28.636668] k3s[877]: I0927 14:42:26.289705 877 shared_informer.go:377] "Caches are synced" machine # [ 28.637452] k3s[877]: I0927 14:42:26.292792 877 shared_informer.go:377] "Caches are synced" machine # [ 28.637969] k3s[877]: I0927 14:42:26.292852 877 shared_informer.go:377] "Caches are synced" machine # [ 28.638350] k3s[877]: I0927 14:42:26.292942 877 shared_informer.go:377] "Caches are synced" machine # [ 28.638937] k3s[877]: I0927 14:42:26.294372 877 shared_informer.go:377] "Caches are synced" machine # [ 28.639686] k3s[877]: I0927 14:42:26.294440 877 shared_informer.go:377] "Caches are synced" machine # [ 28.640462] k3s[877]: I0927 14:42:26.295043 877 shared_informer.go:377] "Caches are synced" machine # [ 28.641024] k3s[877]: I0927 14:42:26.296581 877 shared_informer.go:377] "Caches are synced" machine # [ 28.641521] k3s[877]: I0927 14:42:26.296663 877 shared_informer.go:377] "Caches are synced" machine # [ 28.642084] k3s[877]: I0927 14:42:26.296767 877 shared_informer.go:377] "Caches are synced" machine # [ 28.642965] k3s[877]: I0927 14:42:26.296855 877 shared_informer.go:377] "Caches are synced" machine # [ 28.643515] k3s[877]: I0927 14:42:26.297042 877 shared_informer.go:377] "Caches are synced" machine # [ 28.644076] k3s[877]: I0927 14:42:26.297126 877 shared_informer.go:377] "Caches are synced" machine # [ 28.644621] k3s[877]: I0927 14:42:26.297246 877 shared_informer.go:377] "Caches are synced" machine # [ 28.645171] k3s[877]: I0927 14:42:26.297664 877 shared_informer.go:377] "Caches are synced" machine # [ 28.645790] k3s[877]: I0927 14:42:26.297763 877 shared_informer.go:377] "Caches are synced" machine # [ 28.646553] k3s[877]: I0927 14:42:26.298056 877 shared_informer.go:377] "Caches are synced" machine # [ 28.646729] k3s[877]: I0927 14:42:26.298137 877 shared_informer.go:377] "Caches are synced" machine # [ 28.647445] k3s[877]: I0927 14:42:26.298168 877 shared_informer.go:377] "Caches are synced" machine # [ 28.648109] k3s[877]: I0927 14:42:26.298226 877 shared_informer.go:377] "Caches are synced" machine # [ 28.648696] k3s[877]: I0927 14:42:26.298315 877 range_allocator.go:177] "Sending events to api server" machine # [ 28.649452] k3s[877]: I0927 14:42:26.298392 877 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.650058] k3s[877]: I0927 14:42:26.298403 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.650558] k3s[877]: I0927 14:42:26.298414 877 shared_informer.go:377] "Caches are synced" machine # [ 28.651135] k3s[877]: I0927 14:42:26.298751 877 shared_informer.go:377] "Caches are synced" machine # [ 28.651687] k3s[877]: I0927 14:42:26.298942 877 shared_informer.go:377] "Caches are synced" machine # [ 28.652459] k3s[877]: I0927 14:42:26.299265 877 shared_informer.go:377] "Caches are synced" machine # [ 28.653033] k3s[877]: I0927 14:42:26.299299 877 shared_informer.go:377] "Caches are synced" machine # [ 28.653604] k3s[877]: I0927 14:42:26.299355 877 shared_informer.go:377] "Caches are synced" machine # [ 28.653963] k3s[877]: I0927 14:42:26.301495 877 shared_informer.go:377] "Caches are synced" machine # [ 28.654378] k3s[877]: I0927 14:42:26.301664 877 shared_informer.go:377] "Caches are synced" machine # [ 28.655018] k3s[877]: I0927 14:42:26.301769 877 shared_informer.go:377] "Caches are synced" machine # [ 28.655566] k3s[877]: I0927 14:42:26.301801 877 shared_informer.go:377] "Caches are synced" machine # [ 28.656162] k3s[877]: I0927 14:42:26.301893 877 shared_informer.go:377] "Caches are synced" machine # [ 28.656779] k3s[877]: I0927 14:42:26.302013 877 shared_informer.go:377] "Caches are synced" machine # [ 28.657515] k3s[877]: I0927 14:42:26.312898 877 shared_informer.go:377] "Caches are synced" machine # [ 28.665923] k3s[877]: time="2026-09-27T14:42:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 28.717742] k3s[877]: I0927 14:42:26.377156 877 shared_informer.go:377] "Caches are synced" machine # [ 28.767530] k3s[877]: time="2026-09-27T14:42:26Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 28.833822] k3s[877]: time="2026-09-27T14:42:26Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.053763] k3s[877]: time="2026-09-27T14:42:26Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 29.174661] k3s[877]: I0927 14:42:26.834003 877 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.178585] k3s[877]: I0927 14:42:26.838022 877 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.338596] k3s[877]: time="2026-09-27T14:42:26Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.366070] k3s[877]: I0927 14:42:27.025441 877 controller.go:667] quota admission added evaluator for: replicasets.apps machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.640417] k3s[877]: I0927 14:42:27.299673 877 shared_informer.go:377] "Caches are synced" machine # [ 29.643099] k3s[877]: I0927 14:42:27.302499 877 shared_informer.go:377] "Caches are synced" machine # [ 29.643725] k3s[877]: I0927 14:42:27.302546 877 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.644806] k3s[877]: I0927 14:42:27.302556 877 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.837104] k3s[877]: time="2026-09-27T14:42:27Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.813069] postgres[1222]: [1222] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 30.813262] postgres[1222]: [1222] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 30.831596] niks3-server[1213]: 2026/09/27 14:42:28 OK 20241026095416_initial_model.sql (9.87ms) machine # [ 30.836511] k3s[877]: time="2026-09-27T14:42:28Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.837411] niks3-server[1213]: 2026/09/27 14:42:28 OK 20251210153512_drop_unused_gin_index.sql (5.74ms) machine # [ 30.842281] niks3-server[1213]: 2026/09/27 14:42:28 OK 20251218171726_add_pins.sql (4.85ms) machine # [ 30.845480] niks3-server[1213]: 2026/09/27 14:42:28 OK 20260628120000_add_object_size_and_stats.sql (3.08ms) machine # [ 30.849751] niks3-server[1213]: 2026/09/27 14:42:28 OK 20260905000000_add_claims.sql (4.22ms) machine # [ 30.853424] niks3-server[1213]: 2026/09/27 14:42:28 OK 20260920000000_drop_claims.sql (3.55ms) machine # [ 30.858361] niks3-server[1213]: 2026/09/27 14:42:28 OK 20260923120000_add_pushes.sql (4.86ms) machine # [ 30.858661] niks3-server[1213]: 2026/09/27 14:42:28 goose: successfully migrated database to version: 20260923120000 machine # [ 30.866037] niks3-server[1213]: 2026/09/27 14:42:28 OK 1_commit_pending_closure.sql (4.96ms) machine # [ 30.869340] niks3-server[1213]: 2026/09/27 14:42:28 OK 2_object_stats_trigger.sql (3.29ms) machine # [ 30.877438] niks3-server[1213]: 2026/09/27 14:42:28 OK 3_commit_push.sql (8.02ms) machine # [ 30.877730] niks3-server[1213]: 2026/09/27 14:42:28 goose: up to current file version: 3 machine # [ 30.881219] niks3-server[1213]: 2026/09/27 14:42:28 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.881555] niks3-server[1213]: 2026/09/27 14:42:28 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.884915] niks3-server[1213]: 2026/09/27 14:42:28 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.918305] niks3-server[1213]: 2026/09/27 14:42:28 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.918774] niks3-server[1213]: 2026/09/27 14:42:28 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.919737] niks3-server[1213]: 2026/09/27 14:42:28 INFO systemd watchdog enabled interval=15s machine # [ 30.920569] niks3-server[1213]: 2026/09/27 14:42:28 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.921381] systemd[1]: Started niks3 server. machine # [ 30.921904] systemd[1]: Reached target Multi-User System. machine # [ 30.922585] systemd[1]: Startup finished in 1.156s (kernel) + 3.922s (initrd) + 25.840s (userspace) = 30.920s. machine # [ 31.834993] k3s[877]: time="2026-09-27T14:42:29Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.055452] k3s[877]: time="2026-09-27T14:42:29Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 32.058708] k3s[877]: time="2026-09-27T14:42:29Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 32.061317] k3s[877]: time="2026-09-27T14:42:29Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.064444] k3s[877]: time="2026-09-27T14:42:29Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 32.067574] k3s[877]: time="2026-09-27T14:42:29Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 32.071095] k3s[877]: time="2026-09-27T14:42:29Z" level=info msg="Handling backend connection request [machine]" machine # [ 32.073607] k3s[877]: time="2026-09-27T14:42:29Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.076633] k3s[877]: time="2026-09-27T14:42:29Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.834320] k3s[877]: time="2026-09-27T14:42:30Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.835226] k3s[877]: time="2026-09-27T14:42:31Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.833976] k3s[877]: time="2026-09-27T14:42:32Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.547488] k3s[877]: time="2026-09-27T14:42:33Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.4" machine # [ 35.551125] k3s[877]: time="2026-09-27T14:42:33Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:f5cd467dd1ccee3e6e4380440d650cde2511c1f39c1f79ff0ec22b83d746f4a7" machine # [ 35.838343] k3s[877]: time="2026-09-27T14:42:33Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 36.425504] k3s[877]: time="2026-09-27T14:42:34Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 9.603552126s" machine # [ 36.426368] k3s[877]: time="2026-09-27T14:42:34Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.834504] k3s[877]: time="2026-09-27T14:42:34Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 37.833819] k3s[877]: time="2026-09-27T14:42:35Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.244276] k3s[877]: time="2026-09-27T14:42:35Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.4" machine # [ 38.247471] k3s[877]: time="2026-09-27T14:42:35Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 38.314769] k3s[877]: time="2026-09-27T14:42:35Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.888596735s" machine # [ 38.318693] k3s[877]: time="2026-09-27T14:42:35Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 38.377678] k3s[877]: time="2026-09-27T14:42:36Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::ae58:ced4:9a2b:856b --node-labels= --read-only-port=0" machine # [ 38.389840] k3s[877]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 38.395984] k3s[877]: I0927 14:42:36.054273 877 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 38.399068] k3s[877]: I0927 14:42:36.054329 877 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 38.402172] k3s[877]: I0927 14:42:36.054391 877 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 38.404793] k3s[877]: I0927 14:42:36.054419 877 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 38.408820] k3s[877]: I0927 14:42:36.057478 877 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 38.412851] k3s[877]: I0927 14:42:36.065890 877 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 38.416376] k3s[877]: I0927 14:42:36.074404 877 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 38.418441] k3s[877]: I0927 14:42:36.074457 877 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 38.420630] k3s[877]: I0927 14:42:36.074903 877 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 38.422589] k3s[877]: I0927 14:42:36.074944 877 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 38.436968] k3s[877]: I0927 14:42:36.075230 877 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 38.438713] k3s[877]: I0927 14:42:36.075257 877 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 38.440181] k3s[877]: I0927 14:42:36.075379 877 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 38.442190] k3s[877]: I0927 14:42:36.080233 877 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 38.443670] k3s[877]: I0927 14:42:36.080660 877 kubelet.go:482] "Attempting to sync node with API server" machine # [ 38.445129] k3s[877]: I0927 14:42:36.080693 877 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 38.447073] k3s[877]: I0927 14:42:36.080764 877 kubelet.go:394] "Adding apiserver pod source" machine # [ 38.448390] k3s[877]: I0927 14:42:36.080790 877 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 38.450139] k3s[877]: I0927 14:42:36.084004 877 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 38.452380] k3s[877]: I0927 14:42:36.085310 877 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 38.454946] k3s[877]: I0927 14:42:36.085370 877 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 38.457689] k3s[877]: I0927 14:42:36.091731 877 server.go:1252] "Started kubelet" machine # [ 38.458381] k3s[877]: I0927 14:42:36.092613 877 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 38.459062] k3s[877]: I0927 14:42:36.092749 877 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 38.459982] k3s[877]: I0927 14:42:36.093096 877 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 38.460930] k3s[877]: I0927 14:42:36.093213 877 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 38.462047] k3s[877]: I0927 14:42:36.095552 877 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 38.462576] k3s[877]: I0927 14:42:36.096024 877 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 38.463249] k3s[877]: I0927 14:42:36.096857 877 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 38.464045] k3s[877]: E0927 14:42:36.097038 877 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 38.464554] k3s[877]: I0927 14:42:36.097099 877 server.go:317] "Adding debug handlers to kubelet server" machine # [ 38.465129] k3s[877]: I0927 14:42:36.097278 877 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 38.465736] k3s[877]: I0927 14:42:36.097333 877 reconciler.go:29] "Reconciler: start to sync state" machine # [ 38.466342] k3s[877]: I0927 14:42:36.102098 877 factory.go:223] Registration of the systemd container factory successfully machine # [ 38.466823] k3s[877]: I0927 14:42:36.102206 877 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 38.467577] k3s[877]: E0927 14:42:36.104946 877 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 38.468380] k3s[877]: I0927 14:42:36.105392 877 factory.go:223] Registration of the containerd container factory successfully machine # [ 38.469221] k3s[877]: E0927 14:42:36.106195 877 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 38.469697] k3s[877]: I0927 14:42:36.121149 877 cpu_manager.go:225] "Starting" policy="none" machine # [ 38.470310] k3s[877]: I0927 14:42:36.121167 877 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 38.470864] k3s[877]: I0927 14:42:36.121190 877 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 38.471682] k3s[877]: I0927 14:42:36.129840 877 policy_none.go:50] "Start" machine # [ 38.472432] k3s[877]: I0927 14:42:36.129861 877 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 38.472971] k3s[877]: I0927 14:42:36.129878 877 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 38.480404] k3s[877]: I0927 14:42:36.139478 877 policy_none.go:44] "Start" machine # [ 38.485137] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 38.505607] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 38.510213] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 38.515511] k3s[877]: E0927 14:42:36.174913 877 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 38.517820] k3s[877]: I0927 14:42:36.175586 877 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 38.519439] k3s[877]: I0927 14:42:36.175637 877 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 38.521606] k3s[877]: I0927 14:42:36.175899 877 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 38.523087] k3s[877]: E0927 14:42:36.177115 877 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 38.525593] k3s[877]: E0927 14:42:36.177160 877 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 38.566485] k3s[877]: I0927 14:42:36.225867 877 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 38.571279] k3s[877]: I0927 14:42:36.230681 877 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 38.571866] k3s[877]: I0927 14:42:36.230740 877 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 38.572628] k3s[877]: I0927 14:42:36.230792 877 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 38.576789] k3s[877]: E0927 14:42:36.234943 877 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 38.619071] k3s[877]: I0927 14:42:36.278433 877 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 38.623591] k3s[877]: I0927 14:42:36.282996 877 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 38.625219] k3s[877]: E0927 14:42:36.283028 877 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 38.627485] k3s[877]: time="2026-09-27T14:42:36Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 38.629285] k3s[877]: I0927 14:42:36.286123 877 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 38.632715] k3s[877]: I0927 14:42:36.286605 877 node_controller.go:429] Initializing node machine with cloud provider machine # [ 38.636162] k3s[877]: I0927 14:42:36.286671 877 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 38.636575] k3s[877]: E0927 14:42:36.286695 877 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 38.636796] k3s[877]: I0927 14:42:36.291893 877 node_controller.go:429] Initializing node machine with cloud provider machine # [ 38.637490] k3s[877]: I0927 14:42:36.291939 877 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 38.638064] k3s[877]: E0927 14:42:36.291957 877 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 38.638588] k3s[877]: I0927 14:42:36.297056 877 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.639150] k3s[877]: I0927 14:42:36.297145 877 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.639627] k3s[877]: I0927 14:42:36.297219 877 node_lifecycle_controller.go:1038] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" machine # [ 38.640474] k3s[877]: I0927 14:42:36.299941 877 node_controller.go:429] Initializing node machine with cloud provider machine # [ 38.641877] k3s[877]: I0927 14:42:36.300664 877 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 38.642640] k3s[877]: E0927 14:42:36.300688 877 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 38.643205] k3s[877]: time="2026-09-27T14:42:36Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 38.645051] k3s[877]: I0927 14:42:36.304182 877 node_controller.go:429] Initializing node machine with cloud provider machine # [ 38.645625] k3s[877]: I0927 14:42:36.304230 877 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 38.646184] k3s[877]: E0927 14:42:36.304249 877 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 38.648824] k3s[877]: I0927 14:42:36.308287 877 node_controller.go:429] Initializing node machine with cloud provider machine # [ 38.649771] k3s[877]: I0927 14:42:36.309247 877 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 38.650444] k3s[877]: E0927 14:42:36.309921 877 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 38.656844] k3s[877]: I0927 14:42:36.311295 877 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 38.657757] k3s[877]: I0927 14:42:36.315394 877 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 38.659096] k3s[877]: I0927 14:42:36.316105 877 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 38.682777] k3s[877]: time="2026-09-27T14:42:36Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 38.683142] k3s[877]: time="2026-09-27T14:42:36Z" level=info msg="Starting flannel with backend vxlan" machine # [ 38.684370] k3s[877]: I0927 14:42:36.343836 877 node_controller.go:429] Initializing node machine with cloud provider machine # [ 38.701981] k3s[877]: I0927 14:42:36.361413 877 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 38.702576] k3s[877]: I0927 14:42:36.362036 877 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 38.704495] k3s[877]: I0927 14:42:36.363945 877 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 38.705118] k3s[877]: I0927 14:42:36.363972 877 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 38.706276] k3s[877]: time="2026-09-27T14:42:36Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 38.707272] k3s[877]: time="2026-09-27T14:42:36Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 38.707927] k3s[877]: I0927 14:42:36.367039 877 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 38.708574] k3s[877]: I0927 14:42:36.367159 877 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 38.709127] k3s[877]: I0927 14:42:36.367174 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 38.709667] k3s[877]: I0927 14:42:36.367212 877 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 38.710525] k3s[877]: I0927 14:42:36.367248 877 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 38.711661] k3s[877]: I0927 14:42:36.367304 877 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 38.712210] k3s[877]: I0927 14:42:36.367318 877 kube.go:537] Starting kube subnet manager machine # [ 38.712798] k3s[877]: I0927 14:42:36.370362 877 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 38.713475] k3s[877]: I0927 14:42:36.370383 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 38.714043] k3s[877]: I0927 14:42:36.370413 877 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 38.714527] k3s[877]: I0927 14:42:36.370429 877 shared_informer.go:370] "Waiting for caches to sync" machine # [ 38.807950] k3s[877]: I0927 14:42:36.467271 877 shared_informer.go:377] "Caches are synced" machine # [ 38.811091] k3s[877]: I0927 14:42:36.470477 877 shared_informer.go:377] "Caches are synced" machine # [ 38.811629] k3s[877]: I0927 14:42:36.470560 877 shared_informer.go:377] "Caches are synced" machine # [ 38.836723] k3s[877]: time="2026-09-27T14:42:36Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 38.864301] k3s[877]: I0927 14:42:36.523655 877 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.175660] k3s[877]: I0927 14:42:36.834907 877 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::ae58:ced4:9a2b:856b"] machine # [ 39.177825] k3s[877]: E0927 14:42:36.835037 877 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 39.195209] k3s[877]: I0927 14:42:36.854600 877 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 39.195464] k3s[877]: I0927 14:42:36.854663 877 server_linux.go:136] "Using iptables Proxier" machine # [ 39.212254] k3s[877]: I0927 14:42:36.871661 877 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 39.222106] k3s[877]: I0927 14:42:36.881481 877 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 39.222416] k3s[877]: I0927 14:42:36.881535 877 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 39.223399] k3s[877]: I0927 14:42:36.882830 877 config.go:200] "Starting service config controller" machine # [ 39.223717] k3s[877]: I0927 14:42:36.882856 877 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 39.224545] k3s[877]: I0927 14:42:36.882889 877 config.go:106] "Starting endpoint slice config controller" machine # [ 39.225131] k3s[877]: I0927 14:42:36.882903 877 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 39.225748] k3s[877]: I0927 14:42:36.882933 877 config.go:403] "Starting serviceCIDR config controller" machine # [ 39.226500] k3s[877]: I0927 14:42:36.882945 877 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 39.227157] k3s[877]: I0927 14:42:36.883628 877 config.go:309] "Starting node config controller" machine # [ 39.227661] k3s[877]: I0927 14:42:36.883643 877 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 39.228398] k3s[877]: I0927 14:42:36.883655 877 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 39.423239] k3s[877]: I0927 14:42:37.081857 877 apiserver.go:52] "Watching apiserver" machine # [ 39.624289] k3s[877]: I0927 14:42:37.283064 877 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 39.624895] k3s[877]: I0927 14:42:37.283110 877 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 39.626156] k3s[877]: I0927 14:42:37.283126 877 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 39.633953] systemd[1]: Created slice libcontainer container kubepods-burstable-podb4952a7d_108d_4430_9e65_8a68221db3b2.slice. machine # [ 39.638687] k3s[877]: I0927 14:42:37.298119 877 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 39.643644] k3s[877]: I0927 14:42:37.303040 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4952a7d-108d-4430-9e65-8a68221db3b2-custom-config-volume\") pod \"coredns-c5fdd76cf-cmvdg\" (UID: \"b4952a7d-108d-4430-9e65-8a68221db3b2\") " pod="kube-system/coredns-c5fdd76cf-cmvdg" machine # [ 39.644183] k3s[877]: I0927 14:42:37.303081 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5gwd\" (UniqueName: \"kubernetes.io/projected/b4952a7d-108d-4430-9e65-8a68221db3b2-kube-api-access-l5gwd\") pod \"coredns-c5fdd76cf-cmvdg\" (UID: \"b4952a7d-108d-4430-9e65-8a68221db3b2\") " pod="kube-system/coredns-c5fdd76cf-cmvdg" machine # [ 39.644760] k3s[877]: I0927 14:42:37.303106 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-helm\") pod \"helm-install-nix-grpc-farm-8fnlx\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " pod="kube-system/helm-install-nix-grpc-farm-8fnlx" machine # [ 39.647196] k3s[877]: I0927 14:42:37.303131 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-cache\") pod \"helm-install-nix-grpc-farm-8fnlx\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " pod="kube-system/helm-install-nix-grpc-farm-8fnlx" machine # [ 39.647934] k3s[877]: I0927 14:42:37.303154 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-tmp\") pod \"helm-install-nix-grpc-farm-8fnlx\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " pod="kube-system/helm-install-nix-grpc-farm-8fnlx" machine # [ 39.648658] k3s[877]: I0927 14:42:37.303180 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4952a7d-108d-4430-9e65-8a68221db3b2-config-volume\") pod \"coredns-c5fdd76cf-cmvdg\" (UID: \"b4952a7d-108d-4430-9e65-8a68221db3b2\") " pod="kube-system/coredns-c5fdd76cf-cmvdg" machine # [ 39.649673] k3s[877]: I0927 14:42:37.303204 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-config\") pod \"helm-install-nix-grpc-farm-8fnlx\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " pod="kube-system/helm-install-nix-grpc-farm-8fnlx" machine # [ 39.651205] k3s[877]: I0927 14:42:37.303230 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-values\") pod \"helm-install-nix-grpc-farm-8fnlx\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " pod="kube-system/helm-install-nix-grpc-farm-8fnlx" machine # [ 39.651936] k3s[877]: I0927 14:42:37.303255 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/230e4190-31d0-47ec-9bd4-33e7d3d55358-content\") pod \"helm-install-nix-grpc-farm-8fnlx\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " pod="kube-system/helm-install-nix-grpc-farm-8fnlx" machine # [ 39.652862] k3s[877]: I0927 14:42:37.303280 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzf8z\" (UniqueName: \"kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-kube-api-access-fzf8z\") pod \"helm-install-nix-grpc-farm-8fnlx\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " pod="kube-system/helm-install-nix-grpc-farm-8fnlx" machine # [ 39.697431] systemd[1]: Created slice libcontainer container kubepods-burstable-pod230e4190_31d0_47ec_9bd4_33e7d3d55358.slice. machine # [ 39.707938] k3s[877]: I0927 14:42:37.367376 877 kube.go:163] Node controller sync successful machine # [ 39.709151] k3s[877]: I0927 14:42:37.368604 877 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 39.714086] k3s[877]: I0927 14:42:37.373497 877 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::ae58:ced4:9a2b:856b", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::ae58:ced4:9a2b:856b", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 39.737966] (udev-worker)[1317]: Network interface NamePolicy= disabled on kernel command line. machine # [ 39.747181] k3s[877]: I0927 14:42:37.406424 877 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 39.751360] k3s[877]: I0927 14:42:37.410816 877 iptables.go:50] Starting flannel in iptables mode... machine # [ 39.751676] k3s[877]: time="2026-09-27T14:42:37Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 39.752924] k3s[877]: time="2026-09-27T14:42:37Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 39.753659] k3s[877]: time="2026-09-27T14:42:37Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 39.755903] k3s[877]: time="2026-09-27T14:42:37Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 39.756674] k3s[877]: I0927 14:42:37.411256 877 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 39.777238] dhcpcd[683]: flannel.1: IAID 5f:2e:ea:d4 machine # [ 39.777401] dhcpcd[683]: flannel.1: adding address fe80::40b6:5fff:fe2e:ead4 machine # [ 39.818243] k3s[877]: I0927 14:42:37.477652 877 iptables.go:111] Setting up masking rules machine # [ 39.830895] k3s[877]: I0927 14:42:37.490281 877 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 39.832696] k3s[877]: time="2026-09-27T14:42:37Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 39.841368] k3s[877]: time="2026-09-27T14:42:37Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 39.841719] k3s[877]: time="2026-09-27T14:42:37Z" level=info msg="Running flannel backend" machine # [ 39.842205] k3s[877]: I0927 14:42:37.500826 877 vxlan_network.go:68] watching for new subnet leases machine # [ 39.842702] k3s[877]: I0927 14:42:37.500867 877 vxlan_network.go:115] starting vxlan device watcher machine # [ 39.886771] k3s[877]: I0927 14:42:37.546141 877 iptables.go:358] bootstrap done machine # [ 39.931376] k3s[877]: I0927 14:42:37.590810 877 iptables.go:358] bootstrap done machine # [ 40.053379] (udev-worker)[1413]: Network interface NamePolicy= disabled on kernel command line. machine # [ 40.219246] cni0: port 1(veth18235209) entered blocking state machine # [ 40.220816] cni0: port 1(veth18235209) entered disabled state machine # [ 40.221670] veth18235209: entered allmulticast mode machine # [ 40.222269] veth18235209: entered promiscuous mode machine # [ 40.070766] (udev-worker)[1552]: Network interface NamePolicy= disabled on kernel command line. machine # [ 40.233131] cni0: port 1(veth18235209) entered blocking state machine # [ 40.233813] cni0: port 1(veth18235209) entered forwarding state machine # [ 40.097362] dhcpcd[683]: veth18235209: IAID 66:07:fc:08 machine # [ 40.097719] dhcpcd[683]: veth18235209: adding address fe80::6c26:66ff:fe07:fc08 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 40.526945] cni0: port 2(veth5158439a) entered blocking state machine # [ 40.528517] cni0: port 2(veth5158439a) entered disabled state machine # [ 40.530588] veth5158439a: entered allmulticast mode machine # [ 40.532255] veth5158439a: entered promiscuous mode machine # [ 40.550523] cni0: port 2(veth5158439a) entered blocking state machine # [ 40.551865] cni0: port 2(veth5158439a) entered forwarding state machine # [ 40.433910] (udev-worker)[1657]: Network interface NamePolicy= disabled on kernel command line. machine # [ 40.463505] dhcpcd[683]: veth5158439a: IAID 61:b1:89:f5 machine # [ 40.464472] dhcpcd[683]: veth5158439a: adding address fe80::d8e1:61ff:feb1:89f5 machine # [ 40.648633] dhcpcd[683]: veth18235209: soliciting a DHCP lease machine # [ 40.702651] systemd[1]: Started libcontainer container 24bd367912dcf21eb36b1ac870eadc8d9765a961d18f2e443f13195a317a4004. machine # [ 40.706038] systemd[1]: Started libcontainer container 5d0a664b514723184af96120f56ce26b6fa67eb347562e0e660e4d6aa560b45a. machine # [ 40.810821] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2550487385.mount: Deactivated successfully. machine # [ 40.858696] k3s[877]: time="2026-09-27T14:42:38Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 40.859035] k3s[877]: I0927 14:42:38.516642 877 network_policy_controller.go:164] Starting network policy controller machine # [ 40.971992] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4175562586.mount: Deactivated successfully. machine # [ 41.157209] dhcpcd[683]: flannel.1: soliciting an IPv6 router machine # [ 41.205222] k3s[877]: I0927 14:42:38.864588 877 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 41.353303] dhcpcd[683]: flannel.1: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 41.697057] dhcpcd[683]: veth5158439a: soliciting an IPv6 router machine # [ 41.785771] systemd[1]: Started libcontainer container c3a25658a008153942528ef21ca1ce15996aff7e1daf3a7bbe04a88b37db7623. machine # [ 41.996415] systemd[1]: Started libcontainer container 2dd1d8f8395761fe4367c7bc5f7169dde592794eed4e03572c573fd4b8e0c26f. machine # [ 42.421731] dhcpcd[683]: veth5158439a: soliciting a DHCP lease machine # [ 42.429838] dhcpcd[683]: veth18235209: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 42.625779] k3s[877]: I0927 14:42:40.284597 877 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-cmvdg" podStartSLOduration=13.284565352 podStartE2EDuration="13.284565352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:42:40.280738329 +0000 UTC m=+25.805786208" watchObservedRunningTime="2026-09-27 14:42:40.284565352 +0000 UTC m=+25.809612672" machine # [ 42.626063] k3s[877]: I0927 14:42:40.285249 877 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-8fnlx" podStartSLOduration=13.285236387 podStartE2EDuration="13.285236387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:42:40.266036461 +0000 UTC m=+25.791083781" watchObservedRunningTime="2026-09-27 14:42:40.285236387 +0000 UTC m=+25.810283707" machine # [ 42.999650] k3s[877]: I0927 14:42:40.658960 877 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.161.173"} machine # [ 43.043973] systemd[1]: cri-containerd-2dd1d8f8395761fe4367c7bc5f7169dde592794eed4e03572c573fd4b8e0c26f.scope: Deactivated successfully. machine # [ 43.044982] systemd[1]: cri-containerd-2dd1d8f8395761fe4367c7bc5f7169dde592794eed4e03572c573fd4b8e0c26f.scope: Consumed 587ms CPU time over 1.047s wall clock time, 35.3M memory peak, 2.4M incoming IP traffic, 147.8K outgoing IP traffic. machine # [ 43.094923] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2dd1d8f8395761fe4367c7bc5f7169dde592794eed4e03572c573fd4b8e0c26f-rootfs.mount: Deactivated successfully. machine # [ 43.641489] k3s[877]: I0927 14:42:41.300384 877 node_lifecycle_controller.go:1057] "Controller detected that some Nodes are Ready. Exiting master disruption mode" machine # [ 43.665253] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod6ed354d1_064b_42ce_a53c_932f9fa9f7e7.slice. machine # [ 43.669942] k3s[877]: I0927 14:42:41.329281 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/6ed354d1-064b-42ce-a53c-932f9fa9f7e7-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c\" (UID: \"6ed354d1-064b-42ce-a53c-932f9fa9f7e7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" machine # [ 43.670451] k3s[877]: I0927 14:42:41.329322 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/6ed354d1-064b-42ce-a53c-932f9fa9f7e7-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c\" (UID: \"6ed354d1-064b-42ce-a53c-932f9fa9f7e7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" machine # [ 43.670938] k3s[877]: I0927 14:42:41.329351 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thpsb\" (UniqueName: \"kubernetes.io/projected/6ed354d1-064b-42ce-a53c-932f9fa9f7e7-kube-api-access-thpsb\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c\" (UID: \"6ed354d1-064b-42ce-a53c-932f9fa9f7e7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" machine # [ 43.671831] k3s[877]: I0927 14:42:41.329376 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f981501a-0d76-464d-bda0-ec9e0340106b-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-zkc2k\" (UID: \"f981501a-0d76-464d-bda0-ec9e0340106b\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-zkc2k" machine # [ 43.674635] k3s[877]: I0927 14:42:41.329417 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/6ed354d1-064b-42ce-a53c-932f9fa9f7e7-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c\" (UID: \"6ed354d1-064b-42ce-a53c-932f9fa9f7e7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" machine # [ 43.675516] k3s[877]: I0927 14:42:41.329442 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/6ed354d1-064b-42ce-a53c-932f9fa9f7e7-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c\" (UID: \"6ed354d1-064b-42ce-a53c-932f9fa9f7e7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" machine # [ 43.676066] k3s[877]: I0927 14:42:41.329466 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6ed354d1-064b-42ce-a53c-932f9fa9f7e7-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c\" (UID: \"6ed354d1-064b-42ce-a53c-932f9fa9f7e7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" machine # [ 43.676518] k3s[877]: I0927 14:42:41.329504 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/13a49bb7-bf32-4050-8520-f66bdf89c818-niks3-token\") pod \"nix-grpc-farm-scheduler-c5d75967-f9rvk\" (UID: \"13a49bb7-bf32-4050-8520-f66bdf89c818\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-f9rvk" machine # [ 43.680084] k3s[877]: I0927 14:42:41.329592 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/13a49bb7-bf32-4050-8520-f66bdf89c818-oidc\") pod \"nix-grpc-farm-scheduler-c5d75967-f9rvk\" (UID: \"13a49bb7-bf32-4050-8520-f66bdf89c818\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-f9rvk" machine # [ 43.680756] k3s[877]: I0927 14:42:41.329619 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khcl7\" (UniqueName: \"kubernetes.io/projected/13a49bb7-bf32-4050-8520-f66bdf89c818-kube-api-access-khcl7\") pod \"nix-grpc-farm-scheduler-c5d75967-f9rvk\" (UID: \"13a49bb7-bf32-4050-8520-f66bdf89c818\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-f9rvk" machine # [ 43.681471] k3s[877]: I0927 14:42:41.329645 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f981501a-0d76-464d-bda0-ec9e0340106b-config\") pod \"nix-grpc-farm-lb-75b44f88dd-zkc2k\" (UID: \"f981501a-0d76-464d-bda0-ec9e0340106b\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-zkc2k" machine # [ 43.682055] k3s[877]: I0927 14:42:41.329690 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/13a49bb7-bf32-4050-8520-f66bdf89c818-tls\") pod \"nix-grpc-farm-scheduler-c5d75967-f9rvk\" (UID: \"13a49bb7-bf32-4050-8520-f66bdf89c818\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-f9rvk" machine # [ 43.682557] k3s[877]: I0927 14:42:41.329728 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-zkc2k\" (UID: \"f981501a-0d76-464d-bda0-ec9e0340106b\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-zkc2k" machine # [ 43.683854] k3s[877]: I0927 14:42:41.329752 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-zkc2k\" (UID: \"f981501a-0d76-464d-bda0-ec9e0340106b\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-zkc2k" machine # [ 43.688538] k3s[877]: I0927 14:42:41.329783 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/6ed354d1-064b-42ce-a53c-932f9fa9f7e7-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c\" (UID: \"6ed354d1-064b-42ce-a53c-932f9fa9f7e7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" machine # [ 43.733950] k3s[877]: I0927 14:42:41.329814 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/6ed354d1-064b-42ce-a53c-932f9fa9f7e7-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c\" (UID: \"6ed354d1-064b-42ce-a53c-932f9fa9f7e7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" machine # [ 43.734690] k3s[877]: I0927 14:42:41.329842 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/6ed354d1-064b-42ce-a53c-932f9fa9f7e7-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c\" (UID: \"6ed354d1-064b-42ce-a53c-932f9fa9f7e7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" machine # [ 43.735407] k3s[877]: I0927 14:42:41.329868 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/13a49bb7-bf32-4050-8520-f66bdf89c818-ca\") pod \"nix-grpc-farm-scheduler-c5d75967-f9rvk\" (UID: \"13a49bb7-bf32-4050-8520-f66bdf89c818\") " pod="farm/nix-grpc-farm-scheduler-c5d75967-f9rvk" machine # [ 43.758768] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod13a49bb7_bf32_4050_8520_f66bdf89c818.slice. machine # [ 43.770870] k3s[877]: I0927 14:42:41.430298 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/83aafdd6-d6a5-4333-9554-d78ee97ed3a9-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c\" (UID: \"83aafdd6-d6a5-4333-9554-d78ee97ed3a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" machine # [ 43.771315] k3s[877]: I0927 14:42:41.430390 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/83aafdd6-d6a5-4333-9554-d78ee97ed3a9-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c\" (UID: \"83aafdd6-d6a5-4333-9554-d78ee97ed3a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" machine # [ 43.771708] k3s[877]: I0927 14:42:41.430435 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/83aafdd6-d6a5-4333-9554-d78ee97ed3a9-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c\" (UID: \"83aafdd6-d6a5-4333-9554-d78ee97ed3a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" machine # [ 43.772416] k3s[877]: I0927 14:42:41.430549 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/83aafdd6-d6a5-4333-9554-d78ee97ed3a9-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c\" (UID: \"83aafdd6-d6a5-4333-9554-d78ee97ed3a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" machine # [ 43.772970] k3s[877]: I0927 14:42:41.430593 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9d2n\" (UniqueName: \"kubernetes.io/projected/83aafdd6-d6a5-4333-9554-d78ee97ed3a9-kube-api-access-h9d2n\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c\" (UID: \"83aafdd6-d6a5-4333-9554-d78ee97ed3a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" machine # [ 43.773629] k3s[877]: I0927 14:42:41.430675 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/83aafdd6-d6a5-4333-9554-d78ee97ed3a9-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c\" (UID: \"83aafdd6-d6a5-4333-9554-d78ee97ed3a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" machine # [ 43.774174] k3s[877]: I0927 14:42:41.430703 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/83aafdd6-d6a5-4333-9554-d78ee97ed3a9-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c\" (UID: \"83aafdd6-d6a5-4333-9554-d78ee97ed3a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" machine # [ 43.774939] k3s[877]: I0927 14:42:41.430738 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/83aafdd6-d6a5-4333-9554-d78ee97ed3a9-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c\" (UID: \"83aafdd6-d6a5-4333-9554-d78ee97ed3a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" machine # [ 43.775620] k3s[877]: I0927 14:42:41.430796 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/83aafdd6-d6a5-4333-9554-d78ee97ed3a9-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c\" (UID: \"83aafdd6-d6a5-4333-9554-d78ee97ed3a9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" machine # [ 43.840166] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf981501a_0d76_464d_bda0_ec9e0340106b.slice. machine # [ 43.855558] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod83aafdd6_d6a5_4333_9554_d78ee97ed3a9.slice. machine # [ 44.039997] cni0: port 3(veth392a7af8) entered blocking state machine # [ 44.040870] cni0: port 3(veth392a7af8) entered disabled state machine # [ 44.041720] veth392a7af8: entered allmulticast mode machine # [ 44.042485] veth392a7af8: entered promiscuous mode machine # [ 44.052320] cni0: port 3(veth392a7af8) entered blocking state machine # [ 44.052977] cni0: port 3(veth392a7af8) entered forwarding state machine # [ 43.943259] (udev-worker)[2139]: Network interface NamePolicy= disabled on kernel command line. machine # [ 43.982056] dhcpcd[683]: veth392a7af8: IAID 23:c3:cb:d9 machine # [ 43.982916] dhcpcd[683]: veth392a7af8: adding address fe80::1058:23ff:fec3:cbd9 machine # [ 44.027975] systemd[1]: Started libcontainer container 32f41013761ef11f97d237a2637c64c63d7b77f2d8965a13280b2be638bd1120. machine # [ 44.296794] cni0: port 4(veth5a488763) entered blocking state machine # [ 44.143761] ([ 44.297684] cni0: port 4(veth5a488763) entered disabled state machine # udev-worker)[2151]: Network inte[ 44.298584] veth5a488763: entered allmulticast mode machine # rface NamePolicy[ 44.299313] veth5a488763: entered promiscuous mode machine # = disabled on kernel command line. machine # [ 44.312929] cni0: port 4(veth5a488763) entered blocking state machine # [ 44.313666] cni0: port 4(veth5a488763) entered forwarding state machine # [ 44.161575] (udev-worker)[2156]: Network interface NamePolicy= disabled on kernel command line. machine # [ 44.316595] cni0: port 5(vethef593022) entered blocking state machine # [ 44.317561] cni0: port 5(vethef593022) entered disabled state machine # [ 44.319669] vethef593022: entered allmulticast mode machine # [ 44.321151] vethef593022: entered promiscuous mode machine # [ 44.332641] cni0: port 5(vethef593022) entered blocking state machine # [ 44.333371] cni0: port 5(vethef593022) entered forwarding state machine # [ 44.189394] dhcpcd[683]: veth5a488763: IAID 67:66:6c:94 machine # [ 44.190270] dhcpcd[683]: veth5a488763: adding address fe80::9424:67ff:fe66:6c94 machine # [ 44.206133] dhcpcd[683]: vethef593022: IAID cc:b1:e1:46 machine # [ 44.207207] dhcpcd[683]: vethef593022: adding address fe80::6c69:ccff:feb1:e146 machine # [ 44.208452] dhcpcd[683]: vethef593022: carrier lost machine # [ 44.389371] cni0: port 6(vetha9c57f9a) entered blocking state machine # [ 44.390122] cni0: port 6(vetha9c57f9a) entered disabled state machine # [ 44.391114] vetha9c57f9a: entered allmulticast mode machine # [ 44.392130] vetha9c57f9a: entered promiscuous mode machine # [ 44.244194] dhcpcd[683]: vethef593022: deleting address fe80::6c69:ccff:feb1:e146 machine # [ 44.245317] dhcpcd[683]: veth5a488763: soliciting a DHCP lease machine # [ 44.403152] cni0: port 6(vetha9c57f9a) entered blocking state machine # [ 44.403801] cni0: port 6(vetha9c57f9a) entered forwarding state machine # [ 44.251739] dhcpcd[683]: vethef593022: carrier acquired machine # [ 44.259359] dhcpcd[683]: vethef593022: IAID cc:b1:e1:46 machine # [ 44.260360] dhcpcd[683]: vethef593022: adding address fe80::6c69:ccff:feb1:e146 machine # [ 44.271504] dhcpcd[683]: vetha9c57f9a: IAID c4:58:83:e7 machine # [ 44.271862] dhcpcd[683]: vetha9c57f9a: adding address fe80::4814:c4ff:fe58:83e7 machine # [ 44.272515] dhcpcd[683]: vetha9c57f9a: old hardware address: 4a:14:c4:58:83:e7 machine # [ 44.273083] dhcpcd[683]: vetha9c57f9a: new hardware address: 02:a8:d2:c1:18:44 machine # [ 44.273576] dhcpcd[683]: vetha9c57f9a: carrier lost machine # [ 44.302485] dhcpcd[683]: vetha9c57f9a: deleting address fe80::4814:c4ff:fe58:83e7 machine # [ 44.303260] dhcpcd[683]: vetha9c57f9a: carrier acquired machine # [ 44.308990] dhcpcd[683]: vetha9c57f9a: IAID d2:c1:18:44 machine # [ 44.309351] dhcpcd[683]: vetha9c57f9a: adding address fe80::a8:d2ff:fec1:1844 machine # [ 44.377897] dhcpcd[683]: vethef593022: soliciting a DHCP lease machine # [ 44.417871] systemd[1]: Started libcontainer container db20d06d9f389fbd18a58d8941f02ee758e18401ab4e68f9ebd60cd89822d7e2. machine # [ 44.452341] systemd[1]: Started libcontainer container 3d5a01f73f06a3a026e85fb0dee006fe9abb4b2d2a7f2233f15462eeb57d5318. machine # [ 44.486648] systemd[1]: Started libcontainer container 867ca78b15bd5bd2b9fad7ebfaccd2b1e0167864b6a3a8f3c4d134d57b9a94ed. machine # [ 44.625785] systemd[1]: cri-containerd-5d0a664b514723184af96120f56ce26b6fa67eb347562e0e660e4d6aa560b45a.scope: Deactivated successfully. machine # [ 44.660983] k3s[877]: E0927 14:42:42.320079 877 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 44.667316] k3s[877]: E0927 14:42:42.320219 877 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 44.668356] k3s[877]: E0927 14:42:42.320415 877 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c_farm(6ed354d1-064b-42ce-a53c-932f9fa9f7e7): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 44.668544] k3s[877]: E0927 14:42:42.320491 877 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" podUID="6ed354d1-064b-42ce-a53c-932f9fa9f7e7" machine # [ 44.724886] k3s[877]: E0927 14:42:42.384212 877 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 44.725372] k3s[877]: E0927 14:42:42.384272 877 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 44.726140] k3s[877]: E0927 14:42:42.384403 877 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c_farm(83aafdd6-d6a5-4333-9554-d78ee97ed3a9): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 44.726356] k3s[877]: E0927 14:42:42.384465 877 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" podUID="83aafdd6-d6a5-4333-9554-d78ee97ed3a9" machine # [ 44.756837] k3s[877]: E0927 14:42:42.416210 877 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 44.757230] k3s[877]: E0927 14:42:42.416259 877 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.4" machine # [ 44.767558] k3s[877]: E0927 14:42:42.426979 877 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-c5d75967-f9rvk_farm(13a49bb7-bf32-4050-8520-f66bdf89c818): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.4\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 44.768352] k3s[877]: E0927 14:42:42.427048 877 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.4\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.4\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-c5d75967-f9rvk" podUID="13a49bb7-bf32-4050-8520-f66bdf89c818" machine # [ 44.986852] cni0: port 2(veth5158439a) entered disabled state machine # [ 44.834413] dhcpcd[683]: veth5158439a: carrier lost machine # [ 44.988830] veth5158439a (unregistering): left allmulticast mode machine # [ 44.989847] veth5158439a (unregistering): left promiscuous mode machine # [ 44.990808] cni0: port 2(veth5158439a) entered disabled state machine # [ 44.870183] dhcpcd[683]: veth5158439a: deleting address fe80::d8e1:61ff:feb1:89f5 machine # [ 44.883354] k3s[877]: I0927 14:42:42.542316 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-config\") pod \"230e4190-31d0-47ec-9bd4-33e7d3d55358\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " machine # [ 44.887848] k3s[877]: I0927 14:42:42.542360 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-kube-api-access-fzf8z\" (UniqueName: \"kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-kube-api-access-fzf8z\") pod \"230e4190-31d0-47ec-9bd4-33e7d3d55358\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " machine # [ 44.892744] k3s[877]: I0927 14:42:42.542388 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-helm\") pod \"230e4190-31d0-47ec-9bd4-33e7d3d55358\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " machine # [ 44.897380] k3s[877]: I0927 14:42:42.542419 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-cache\") pod \"230e4190-31d0-47ec-9bd4-33e7d3d55358\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " machine # [ 44.903079] k3s[877]: I0927 14:42:42.542446 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-values\" (UniqueName: \"kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-values\") pod \"230e4190-31d0-47ec-9bd4-33e7d3d55358\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " machine # [ 44.908642] k3s[877]: I0927 14:42:42.542480 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/230e4190-31d0-47ec-9bd4-33e7d3d55358-content\" (UniqueName: \"kubernetes.io/configmap/230e4190-31d0-47ec-9bd4-33e7d3d55358-content\") pod \"230e4190-31d0-47ec-9bd4-33e7d3d55358\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " machine # [ 44.913242] k3s[877]: I0927 14:42:42.542533 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-tmp\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-tmp\") pod \"230e4190-31d0-47ec-9bd4-33e7d3d55358\" (UID: \"230e4190-31d0-47ec-9bd4-33e7d3d55358\") " machine # [ 44.918659] k3s[877]: I0927 14:42:42.558051 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/230e4190-31d0-47ec-9bd4-33e7d3d55358-content" pod "230e4190-31d0-47ec-9bd4-33e7d3d55358" (UID: "230e4190-31d0-47ec-9bd4-33e7d3d55358"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 44.923133] k3s[877]: I0927 14:42:42.562585 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-values" pod "230e4190-31d0-47ec-9bd4-33e7d3d55358" (UID: "230e4190-31d0-47ec-9bd4-33e7d3d55358"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 44.927395] k3s[877]: I0927 14:42:42.567137 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-tmp" pod "230e4190-31d0-47ec-9bd4-33e7d3d55358" (UID: "230e4190-31d0-47ec-9bd4-33e7d3d55358"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 44.931673] k3s[877]: I0927 14:42:42.569763 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-cache" pod "230e4190-31d0-47ec-9bd4-33e7d3d55358" (UID: "230e4190-31d0-47ec-9bd4-33e7d3d55358"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 44.936860] k3s[877]: I0927 14:42:42.574422 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-config" pod "230e4190-31d0-47ec-9bd4-33e7d3d55358" (UID: "230e4190-31d0-47ec-9bd4-33e7d3d55358"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 44.937184] k3s[877]: I0927 14:42:42.582605 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-helm" pod "230e4190-31d0-47ec-9bd4-33e7d3d55358" (UID: "230e4190-31d0-47ec-9bd4-33e7d3d55358"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 44.937623] k3s[877]: I0927 14:42:42.583240 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-kube-api-access-fzf8z" pod "230e4190-31d0-47ec-9bd4-33e7d3d55358" (UID: "230e4190-31d0-47ec-9bd4-33e7d3d55358"). InnerVolumeSpecName "kube-api-access-fzf8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 44.938241] dhcpcd[683]: veth5158439a: removing interface machine # [ 44.983784] k3s[877]: I0927 14:42:42.643151 877 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 44.984155] k3s[877]: I0927 14:42:42.643180 877 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 44.984702] k3s[877]: I0927 14:42:42.643197 877 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzf8z\" (UniqueName: \"kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-kube-api-access-fzf8z\") on node \"machine\" DevicePath \"\"" machine # [ 44.985404] k3s[877]: I0927 14:42:42.643210 877 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 44.985910] k3s[877]: I0927 14:42:42.643222 877 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/230e4190-31d0-47ec-9bd4-33e7d3d55358-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 44.986761] k3s[877]: I0927 14:42:42.643235 877 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/230e4190-31d0-47ec-9bd4-33e7d3d55358-values\") on node \"machine\" DevicePath \"\"" machine # [ 44.987545] k3s[877]: I0927 14:42:42.643247 877 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/230e4190-31d0-47ec-9bd4-33e7d3d55358-content\") on node \"machine\" DevicePath \"\"" machine # [ 45.026904] k3s[877]: time="2026-09-27T14:42:42Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.4" machine # [ 45.033031] k3s[877]: time="2026-09-27T14:42:42Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:213be8b7d793a5ec97bf81d36000ff647a1accc4a2c2f359d8843cddbc5888dc" machine # [ 45.047344] systemd[1]: Started libcontainer container 02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2. machine # [ 45.103091] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-5d0a664b514723184af96120f56ce26b6fa67eb347562e0e660e4d6aa560b45a-rootfs.mount: Deactivated successfully. machine # [ 45.106798] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-5d0a664b514723184af96120f56ce26b6fa67eb347562e0e660e4d6aa560b45a-shm.mount: Deactivated successfully. machine # [ 45.109080] systemd[1]: run-netns-cni\x2da186c1d9\x2df69c\x2d8bbd\x2d1337\x2d2a716ca150d1.mount: Deactivated successfully. machine # [ 45.110753] systemd[1]: var-lib-kubelet-pods-230e4190\x2d31d0\x2d47ec\x2d9bd4\x2d33e7d3d55358-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dfzf8z.mount: Deactivated successfully. machine # [ 45.113156] systemd[1]: var-lib-kubelet-pods-230e4190\x2d31d0\x2d47ec\x2d9bd4\x2d33e7d3d55358-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 45.115290] systemd[1]: var-lib-kubelet-pods-230e4190\x2d31d0\x2d47ec\x2d9bd4\x2d33e7d3d55358-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 45.117296] systemd[1]: var-lib-kubelet-pods-230e4190\x2d31d0\x2d47ec\x2d9bd4\x2d33e7d3d55358-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 45.119422] systemd[1]: var-lib-kubelet-pods-230e4190\x2d31d0\x2d47ec\x2d9bd4\x2d33e7d3d55358-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 45.121576] systemd[1]: var-lib-kubelet-pods-230e4190\x2d31d0\x2d47ec\x2d9bd4\x2d33e7d3d55358-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 45.193936] dhcpcd[683]: veth392a7af8: soliciting a DHCP lease machine # [ 45.367248] k3s[877]: time="2026-09-27T14:42:43Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 7.051935091s" machine # [ 45.623524] k3s[877]: I0927 14:42:43.281387 877 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d0a664b514723184af96120f56ce26b6fa67eb347562e0e660e4d6aa560b45a" machine # [ 45.632073] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod230e4190_31d0_47ec_9bd4_33e7d3d55358.slice. machine # [ 45.634278] systemd[1]: kubepods-burstable-pod230e4190_31d0_47ec_9bd4_33e7d3d55358.slice: Consumed 619ms CPU time over 5.932s wall clock time, 35.6M memory peak, 2.4M incoming IP traffic, 147.8K outgoing IP traffic. machine # [ 45.644586] k3s[877]: I0927 14:42:43.303853 877 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-zkc2k" podStartSLOduration=2.303832046 podStartE2EDuration="2.303832046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:42:43.303453507 +0000 UTC m=+28.828500827" watchObservedRunningTime="2026-09-27 14:42:43.303832046 +0000 UTC m=+28.828879366" machine # [ 45.650360] dhcpcd[683]: veth18235209: probing for an IPv4LL address machine # [ 45.700788] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3484277363.mount: Deactivated successfully. machine # [ 46.034387] dhcpcd[683]: veth392a7af8: soliciting an IPv6 router machine # [ 46.064272] dhcpcd[683]: veth5a488763: soliciting an IPv6 router machine # [ 46.095695] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4222075820.mount: Deactivated successfully. machine # [ 46.242879] dhcpcd[683]: vetha9c57f9a: soliciting a DHCP lease machine # [ 46.277408] dhcpcd[683]: vethef593022: soliciting an IPv6 router machine # [ 46.353686] dhcpcd[683]: flannel.1: probing for an IPv4LL address machine # [ 46.400551] dhcpcd[683]: vetha9c57f9a: soliciting an IPv6 router machine # [ 49.245206] dhcpcd[683]: veth5a488763: probing for an IPv4LL address machine # [ 49.378601] dhcpcd[683]: vethef593022: probing for an IPv4LL address machine # [ 50.193920] dhcpcd[683]: veth392a7af8: probing for an IPv4LL address machine # [ 51.178753] dhcpcd[683]: veth18235209: using IPv4LL address 169.254.194.4 machine # [ 51.179277] dhcpcd[683]: veth18235209: adding route to 169.254.0.0/16 machine # [ 51.243369] dhcpcd[683]: vetha9c57f9a: probing for an IPv4LL address machine # [ 51.267717] dhcpcd[683]: flannel.1: using IPv4LL address 169.254.92.228 machine # [ 51.268138] dhcpcd[683]: flannel.1: adding route to 169.254.0.0/16 machine # [ 51.816349] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3621140171.mount: Deactivated successfully. machine # [ 51.830641] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped1605161552.mount: Deactivated successfully. machine # [ 51.929494] systemd[1]: Started libcontainer container cd484b8384054834ecc86560a3f5c31df939fccfe2efdb9392e704fbbf5651bc. machine # [ 51.964426] systemd[1]: Started libcontainer container a80a1694e65e45e3c46c6269c127e43cc77b264984e9aa7992aab492f29a4b95. machine # [ 52.025307] systemd[1]: Started libcontainer container 626619d3847a7b159e95aa8729febb0c637371d64955926bc35a2a0c0d539eca. machine # [ 52.238106] niks3-server[1213]: 2026/09/27 14:42:49 INFO lead: acquired remote=10.42.0.6:33246 machine # [ 52.764507] k3s[877]: I0927 14:42:50.422138 877 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-c5d75967-f9rvk" podStartSLOduration=8.380939611 podStartE2EDuration="9.422110486s" totalImagesPullingTime="1.041170875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:42:50.421413191 +0000 UTC m=+35.946460511" watchObservedRunningTime="2026-09-27 14:42:50.422110486 +0000 UTC m=+35.947158085" machine # [ 52.809893] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount352274588.mount: Deactivated successfully. machine # [ 53.158814] dhcpcd[683]: flannel.1: no IPv6 Routers available machine # error: timed out waiting for the condition machine # [ 54.316447] systemd[1]: cri-containerd-cd484b8384054834ecc86560a3f5c31df939fccfe2efdb9392e704fbbf5651bc.scope: Deactivated successfully. machine # [ 54.318552] systemd[1]: cri-containerd-cd484b8384054834ecc86560a3f5c31df939fccfe2efdb9392e704fbbf5651bc.scope: Consumed 939ms CPU time over 2.385s wall clock time, 349.4M memory peak, 84.3M read from disk, 248.2M written to disk. machine # [ 54.329119] systemd[1]: cri-containerd-626619d3847a7b159e95aa8729febb0c637371d64955926bc35a2a0c0d539eca.scope: Deactivated successfully. machine # [ 54.333703] systemd[1]: cri-containerd-626619d3847a7b159e95aa8729febb0c637371d64955926bc35a2a0c0d539eca.scope: Consumed 936ms CPU time over 2.303s wall clock time, 390.3M memory peak, 77.5M read from disk, 193.5M written to disk. machine # [ 54.431708] dhcpcd[683]: veth18235209: no IPv6 Routers available machine # [ 54.437433] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-cd484b8384054834ecc86560a3f5c31df939fccfe2efdb9392e704fbbf5651bc-rootfs.mount: Deactivated successfully. machine # [ 54.447092] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-626619d3847a7b159e95aa8729febb0c637371d64955926bc35a2a0c0d539eca-rootfs.mount: Deactivated successfully. machine # [ 54.798533] dhcpcd[683]: veth5a488763: using IPv4LL address 169.254.68.43 machine # [ 54.799144] dhcpcd[683]: veth5a488763: adding route to 169.254.0.0/16 machine # [ 54.850976] dhcpcd[683]: veth392a7af8: using IPv4LL address 169.254.97.158 machine # [ 54.853462] dhcpcd[683]: veth392a7af8: adding route to 169.254.0.0/16 machine # [ 54.997339] systemd[1]: Started libcontainer container b824239dc27889dec1b8d2dfbb3c231dff16e3092fb5758f9f3f977759e87be9. machine # [ 55.008357] systemd[1]: Started libcontainer container 97cf8cb9184b44a72a2d8d9b5f0d96bc67b2103774aaa3cecbb55ad748fc7456. machine # [ 55.079426] dhcpcd[683]: vethef593022: using IPv4LL address 169.254.112.93 machine # [ 55.080935] dhcpcd[683]: vethef593022: adding route to 169.254.0.0/16 machine # [ 55.145431] systemd[1]: Started libcontainer container fc64eff854ead2fc96bcea4dd04026e758b0fc61abe47a3cf64fb486ec249792. machine # [ 55.249305] systemd[1]: Started libcontainer container d542d5d6bf521b1722b96d150fd635005d663e3bc2986c9793e9aa1d289981d0. machine # [ 55.381572] systemd[1]: Started libcontainer container e55310442a42de84dd6ca7d08120f6a951768e60569976abdaea0ce5cbf99f99. machine # [ 55.445507] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3080530885.mount: Deactivated successfully. machine # [ 55.459301] systemd[1]: Started libcontainer container 69e51ba64d52597e43d29a646fd74291706329b6c5ee0343523565fe627d494c. machine # [ 55.761658] k3s[877]: I0927 14:42:53.419957 877 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c" podStartSLOduration=9.070071329 podStartE2EDuration="12.419911323s" totalImagesPullingTime="1.088292227s" totalInitContainerRuntime="2.261547767s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:42:53.397816057 +0000 UTC m=+38.922868126" watchObservedRunningTime="2026-09-27 14:42:53.419911323 +0000 UTC m=+38.944963113" machine # [ 56.169070] dhcpcd[683]: vetha9c57f9a: using IPv4LL address 169.254.235.92 machine # [ 56.169302] dhcpcd[683]: vetha9c57f9a: adding route to 169.254.0.0/16 machine # [ 58.039846] dhcpcd[683]: veth392a7af8: no IPv6 Routers available machine # [ 58.066486] dhcpcd[683]: veth5a488763: no IPv6 Routers available machine # [ 58.281176] dhcpcd[683]: vethef593022: no IPv6 Routers available machine # [ 58.403727] dhcpcd[683]: vetha9c57f9a: no IPv6 Routers available machine # [ 59.087214] k3s[877]: I0927 14:42:56.745810 877 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c" podStartSLOduration=12.368761247 podStartE2EDuration="15.745763072s" totalImagesPullingTime="1.026989184s" totalInitContainerRuntime="2.350012641s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:42:53.420417533 +0000 UTC m=+38.945468764" watchObservedRunningTime="2026-09-27 14:42:56.745763072 +0000 UTC m=+42.270814862" machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 39.74 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.24 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.15 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.03 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.46 seconds) machine: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.08 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.21 seconds) machine: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 40.97 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.16 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.15 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 101.107058] niks3-server[1213]: 2026/09/27 14:43:38 INFO Received push request method=POST path=/api/pushes machine # [ 101.135116] niks3-server[1213]: 2026/09/27 14:43:38 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 101.142337] niks3-server[1213]: 2026/09/27 14:43:38 INFO Signed narinfos id=1 count=1 machine # [ 101.149984] niks3-server[1213]: 2026/09/27 14:43:38 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 101.156062] niks3-server[1213]: 2026/09/27 14:43:38 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 101.159765] niks3-server[1213]: 2026/09/27 14:43:38 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 101.163416] niks3-server[1213]: 2026/09/27 14:43:38 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 125.889942] niks3-server[1213]: 2026/09/27 14:44:03 INFO Received push request method=POST path=/api/pushes machine # [ 125.908152] niks3-server[1213]: 2026/09/27 14:44:03 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 125.915388] niks3-server[1213]: 2026/09/27 14:44:03 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 125.919775] niks3-server[1213]: 2026/09/27 14:44:03 INFO Signed narinfos id=2 count=1 machine # [ 125.924346] niks3-server[1213]: 2026/09/27 14:44:03 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 125.928401] niks3-server[1213]: 2026/09/27 14:44:03 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 125.932920] niks3-server[1213]: 2026/09/27 14:44:03 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 125.935958] niks3-server[1213]: 2026/09/27 14:44:03 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 126.008995] niks3-server[1213]: 2026/09/27 14:44:03 INFO Received push request method=POST path=/api/pushes machine # [ 126.021531] niks3-server[1213]: 2026/09/27 14:44:03 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 126.022670] niks3-server[1213]: 2026/09/27 14:44:03 INFO Signed narinfos id=3 count=1 machine # [ 126.023966] niks3-server[1213]: 2026/09/27 14:44:03 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 126.025513] niks3-server[1213]: 2026/09/27 14:44:03 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 126.030912] niks3-server[1213]: 2026/09/27 14:44:03 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 126.035936] niks3-server[1213]: 2026/09/27 14:44:03 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 150.351125] niks3-server[1213]: 2026/09/27 14:44:28 INFO Received push request method=POST path=/api/pushes machine # [ 150.370361] niks3-server[1213]: 2026/09/27 14:44:28 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 150.371855] niks3-server[1213]: 2026/09/27 14:44:28 INFO Signed narinfos id=4 count=1 machine # [ 150.373157] niks3-server[1213]: 2026/09/27 14:44:28 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 150.376402] niks3-server[1213]: 2026/09/27 14:44:28 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 150.378576] niks3-server[1213]: 2026/09/27 14:44:28 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 150.383268] niks3-server[1213]: 2026/09/27 14:44:28 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 150.389145] niks3-server[1213]: 2026/09/27 14:44:28 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 150.464783] niks3-server[1213]: 2026/09/27 14:44:28 INFO Received push request method=POST path=/api/pushes machine # [ 150.474582] niks3-server[1213]: 2026/09/27 14:44:28 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 150.476235] niks3-server[1213]: 2026/09/27 14:44:28 INFO Signed narinfos id=5 count=1 machine # [ 150.479400] niks3-server[1213]: 2026/09/27 14:44:28 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 150.481063] niks3-server[1213]: 2026/09/27 14:44:28 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 150.484983] niks3-server[1213]: 2026/09/27 14:44:28 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 150.488021] niks3-server[1213]: 2026/09/27 14:44:28 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 175.807712] niks3-server[1213]: 2026/09/27 14:44:53 INFO Received push request method=POST path=/api/pushes machine # [ 175.824281] niks3-server[1213]: 2026/09/27 14:44:53 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 175.826933] niks3-server[1213]: 2026/09/27 14:44:53 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 175.828902] niks3-server[1213]: 2026/09/27 14:44:53 INFO Signed narinfos id=6 count=1 machine # [ 175.833944] niks3-server[1213]: 2026/09/27 14:44:53 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 175.841877] niks3-server[1213]: 2026/09/27 14:44:53 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 175.847130] niks3-server[1213]: 2026/09/27 14:44:53 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 175.852129] niks3-server[1213]: 2026/09/27 14:44:53 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 107.62 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.19 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 205.186387] niks3-server[1213]: 2026/09/27 14:45:22 INFO Received push request method=POST path=/api/pushes machine # [ 205.208591] niks3-server[1213]: 2026/09/27 14:45:22 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 205.212625] niks3-server[1213]: 2026/09/27 14:45:22 INFO Signed narinfos id=7 count=1 machine # [ 205.216962] niks3-server[1213]: 2026/09/27 14:45:22 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 205.222139] niks3-server[1213]: 2026/09/27 14:45:22 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 205.226717] niks3-server[1213]: 2026/09/27 14:45:22 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 205.230066] niks3-server[1213]: 2026/09/27 14:45:22 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 229.742197] niks3-server[1213]: 2026/09/27 14:45:47 INFO Received push request method=POST path=/api/pushes machine # [ 229.758491] niks3-server[1213]: 2026/09/27 14:45:47 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 229.762739] niks3-server[1213]: 2026/09/27 14:45:47 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 229.767688] niks3-server[1213]: 2026/09/27 14:45:47 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 229.771483] niks3-server[1213]: 2026/09/27 14:45:47 INFO Signed narinfos id=8 count=1 machine # [ 229.774355] niks3-server[1213]: 2026/09/27 14:45:47 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 229.782686] niks3-server[1213]: 2026/09/27 14:45:47 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 229.782804] niks3-server[1213]: 2026/09/27 14:45:47 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 229.841504] niks3-server[1213]: 2026/09/27 14:45:47 INFO Received push request method=POST path=/api/pushes machine # [ 229.854102] niks3-server[1213]: 2026/09/27 14:45:47 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 229.854602] niks3-server[1213]: 2026/09/27 14:45:47 INFO Signed narinfos id=9 count=1 machine # [ 229.860817] niks3-server[1213]: 2026/09/27 14:45:47 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 229.864993] niks3-server[1213]: 2026/09/27 14:45:47 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 229.869425] niks3-server[1213]: 2026/09/27 14:45:47 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 229.873271] niks3-server[1213]: 2026/09/27 14:45:47 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 254.586652] niks3-server[1213]: 2026/09/27 14:46:12 INFO Received push request method=POST path=/api/pushes machine # [ 254.605219] niks3-server[1213]: 2026/09/27 14:46:12 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 254.606118] niks3-server[1213]: 2026/09/27 14:46:12 INFO Signed narinfos id=10 count=1 machine # [ 254.612101] niks3-server[1213]: 2026/09/27 14:46:12 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 254.613279] niks3-server[1213]: 2026/09/27 14:46:12 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 254.616806] niks3-server[1213]: 2026/09/27 14:46:12 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 254.623413] niks3-server[1213]: 2026/09/27 14:46:12 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 254.624092] niks3-server[1213]: 2026/09/27 14:46:12 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 254.689350] niks3-server[1213]: 2026/09/27 14:46:12 INFO Received push request method=POST path=/api/pushes machine # [ 254.701551] niks3-server[1213]: 2026/09/27 14:46:12 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 254.702761] niks3-server[1213]: 2026/09/27 14:46:12 INFO Signed narinfos id=11 count=1 machine # [ 254.705433] niks3-server[1213]: 2026/09/27 14:46:12 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 254.709760] niks3-server[1213]: 2026/09/27 14:46:12 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 254.712507] niks3-server[1213]: 2026/09/27 14:46:12 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 254.720448] niks3-server[1213]: 2026/09/27 14:46:12 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 279.837425] niks3-server[1213]: 2026/09/27 14:46:37 INFO Received push request method=POST path=/api/pushes machine # [ 279.862982] niks3-server[1213]: 2026/09/27 14:46:37 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 279.867395] niks3-server[1213]: 2026/09/27 14:46:37 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 279.871556] niks3-server[1213]: 2026/09/27 14:46:37 INFO Signed narinfos id=12 count=1 machine # [ 279.874417] niks3-server[1213]: 2026/09/27 14:46:37 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 279.879487] niks3-server[1213]: 2026/09/27 14:46:37 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 279.883850] niks3-server[1213]: 2026/09/27 14:46:37 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 279.887042] niks3-server[1213]: 2026/09/27 14:46:37 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 104.71 seconds) (finished: subtest: build through the balancer lands in the cache, in 212.68 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.18 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.18 seconds) machine: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/4qg21n7g16x8lyv0fhhdx9dx3lxqkcdn-ci-job.json, in 0.19 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 281.632463] systemd[1]: Created slice libcontainer container kubepods-besteffort-podd406ef3d_111a_419d_b6f5_37e171bb6125.slice. machine # [ 281.817717] k3s[877]: I0927 14:46:39.476477 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zl8t\" (UniqueName: \"kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-kube-api-access-9zl8t\") pod \"ci-9xl94\" (UID: \"d406ef3d-111a-419d-b6f5-37e171bb6125\") " pod="ci/ci-9xl94" machine # [ 281.818100] k3s[877]: I0927 14:46:39.476557 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-nix-grpc-farm\") pod \"ci-9xl94\" (UID: \"d406ef3d-111a-419d-b6f5-37e171bb6125\") " pod="ci/ci-9xl94" machine # [ 281.818916] k3s[877]: I0927 14:46:39.476585 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/d406ef3d-111a-419d-b6f5-37e171bb6125-job\") pod \"ci-9xl94\" (UID: \"d406ef3d-111a-419d-b6f5-37e171bb6125\") " pod="ci/ci-9xl94" machine # [ 282.733587] cni0: port 2(vethcd6089ae) entered blocking state machine # [ 282.735317] cni0: port 2(vethcd6089ae) entered disabled state machine # [ 282.738554] vethcd6089ae: entered allmulticast mode machine # [ 282.741067] vethcd6089ae: entered promiscuous mode machine # [ 282.760614] cni0: port 2(vethcd6089ae) entered blocking state machine # [ 282.763090] cni0: port 2(vethcd6089ae) entered forwarding state machine # [ 282.650154] (udev-worker)[4929]: Network interface NamePolicy= disabled on kernel command line. machine # [ 282.677153] dhcpcd[683]: vethcd6089ae: IAID 54:5e:8e:85 machine # [ 282.678078] dhcpcd[683]: vethcd6089ae: adding address fe80::9c37:54ff:fe5e:8e85 machine # [ 282.713642] systemd[1]: Started libcontainer container 6fb46a6838de609dedf4f075b4d4b3d4a45f684618964c6ad2cf45c645cf1b08. machine # [ 284.643785] dhcpcd[683]: vethcd6089ae: soliciting a DHCP lease machine # [ 284.744422] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1870764859.mount: Deactivated successfully. machine # [ 284.816632] systemd[1]: Started libcontainer container c1507d09c3be6913ec417d29064fc9bf5a9f544f625aec03325eb277733f3ccc. machine # [ 284.893771] dhcpcd[683]: vethcd6089ae: soliciting an IPv6 router machine # [ 286.210276] niks3-server[1213]: 2026/09/27 14:46:43 INFO Received push request method=POST path=/api/pushes machine # [ 286.224307] niks3-server[1213]: 2026/09/27 14:46:43 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 286.226857] niks3-server[1213]: 2026/09/27 14:46:43 INFO Signed narinfos id=13 count=1 machine # [ 286.229326] niks3-server[1213]: 2026/09/27 14:46:43 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 286.231264] niks3-server[1213]: 2026/09/27 14:46:43 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 286.237869] niks3-server[1213]: 2026/09/27 14:46:43 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 286.243017] niks3-server[1213]: 2026/09/27 14:46:43 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 289.644685] dhcpcd[683]: vethcd6089ae: probing for an IPv4LL address machine # [ 294.757088] dhcpcd[683]: vethcd6089ae: using IPv4LL address 169.254.218.85 machine # [ 294.757462] dhcpcd[683]: vethcd6089ae: adding route to 169.254.0.0/16 machine # [ 296.896082] dhcpcd[683]: vethcd6089ae: no IPv6 Routers available machine # [ 310.397769] postgres[766]: [766] LOG: checkpoint starting: time machine # [ 310.958350] niks3-server[1213]: 2026/09/27 14:47:08 INFO Received push request method=POST path=/api/pushes machine # [ 310.982806] niks3-server[1213]: 2026/09/27 14:47:08 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 310.984572] niks3-server[1213]: 2026/09/27 14:47:08 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 310.988290] niks3-server[1213]: 2026/09/27 14:47:08 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 310.989224] niks3-server[1213]: 2026/09/27 14:47:08 INFO Signed narinfos id=14 count=1 machine # [ 310.990732] niks3-server[1213]: 2026/09/27 14:47:08 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 310.995150] niks3-server[1213]: 2026/09/27 14:47:08 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 311.008063] niks3-server[1213]: 2026/09/27 14:47:08 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 311.070184] niks3-server[1213]: 2026/09/27 14:47:08 INFO Received push request method=POST path=/api/pushes machine # [ 311.078334] niks3-server[1213]: 2026/09/27 14:47:08 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 311.079236] niks3-server[1213]: 2026/09/27 14:47:08 INFO Signed narinfos id=15 count=1 machine # [ 311.083617] niks3-server[1213]: 2026/09/27 14:47:08 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 311.084832] niks3-server[1213]: 2026/09/27 14:47:08 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 311.088516] niks3-server[1213]: 2026/09/27 14:47:08 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 311.091432] niks3-server[1213]: 2026/09/27 14:47:08 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 335.803601] niks3-server[1213]: 2026/09/27 14:47:33 INFO Received push request method=POST path=/api/pushes machine # [ 335.828874] niks3-server[1213]: 2026/09/27 14:47:33 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 335.829751] niks3-server[1213]: 2026/09/27 14:47:33 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 335.831486] niks3-server[1213]: 2026/09/27 14:47:33 INFO Signed narinfos id=16 count=1 machine # [ 335.833566] niks3-server[1213]: 2026/09/27 14:47:33 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 335.838931] niks3-server[1213]: 2026/09/27 14:47:33 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 335.843220] niks3-server[1213]: 2026/09/27 14:47:33 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 335.847178] niks3-server[1213]: 2026/09/27 14:47:33 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 335.923528] niks3-server[1213]: 2026/09/27 14:47:33 INFO Received push request method=POST path=/api/pushes machine # [ 335.935748] niks3-server[1213]: 2026/09/27 14:47:33 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 335.939094] niks3-server[1213]: 2026/09/27 14:47:33 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 335.939748] niks3-server[1213]: 2026/09/27 14:47:33 INFO Signed narinfos id=17 count=1 machine # [ 335.941135] niks3-server[1213]: 2026/09/27 14:47:33 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 335.952505] niks3-server[1213]: 2026/09/27 14:47:33 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 335.955103] niks3-server[1213]: 2026/09/27 14:47:33 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 360.846145] niks3-server[1213]: 2026/09/27 14:47:58 INFO Received push request method=POST path=/api/pushes machine # [ 360.861295] niks3-server[1213]: 2026/09/27 14:47:58 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 360.863190] niks3-server[1213]: 2026/09/27 14:47:58 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 360.869473] niks3-server[1213]: 2026/09/27 14:47:58 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 360.872653] niks3-server[1213]: 2026/09/27 14:47:58 INFO Signed narinfos id=18 count=1 machine # [ 360.874861] niks3-server[1213]: 2026/09/27 14:47:58 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 360.878276] niks3-server[1213]: 2026/09/27 14:47:58 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 360.881443] niks3-server[1213]: 2026/09/27 14:47:58 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 362.583988] niks3-server[1213]: 2026/09/27 14:48:00 INFO Received push request method=POST path=/api/pushes machine # [ 362.598802] niks3-server[1213]: 2026/09/27 14:48:00 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 362.601344] niks3-server[1213]: 2026/09/27 14:48:00 INFO Signed narinfos id=19 count=1 machine # [ 362.602460] niks3-server[1213]: 2026/09/27 14:48:00 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 362.606211] niks3-server[1213]: 2026/09/27 14:48:00 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 362.609553] niks3-server[1213]: 2026/09/27 14:48:00 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 362.615760] niks3-server[1213]: 2026/09/27 14:48:00 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 387.307950] niks3-server[1213]: 2026/09/27 14:48:24 INFO Received push request method=POST path=/api/pushes machine # [ 387.323382] niks3-server[1213]: 2026/09/27 14:48:24 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 387.325796] niks3-server[1213]: 2026/09/27 14:48:24 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 387.327728] niks3-server[1213]: 2026/09/27 14:48:24 INFO Signed narinfos id=20 count=1 machine # [ 387.328814] niks3-server[1213]: 2026/09/27 14:48:24 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 387.334159] niks3-server[1213]: 2026/09/27 14:48:24 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 387.339057] niks3-server[1213]: 2026/09/27 14:48:24 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 387.343432] niks3-server[1213]: 2026/09/27 14:48:25 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 389.510511] systemd[1]: cri-containerd-c1507d09c3be6913ec417d29064fc9bf5a9f544f625aec03325eb277733f3ccc.scope: Deactivated successfully. machine # [ 389.512369] systemd[1]: cri-containerd-c1507d09c3be6913ec417d29064fc9bf5a9f544f625aec03325eb277733f3ccc.scope: Consumed 1.073s CPU time over 1min 44.693s wall clock time, 123.5M memory peak, 53.9M read from disk, 428K written to disk, 18.1K incoming IP traffic, 44.7K outgoing IP traffic. machine # [ 389.582651] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c1507d09c3be6913ec417d29064fc9bf5a9f544f625aec03325eb277733f3ccc-rootfs.mount: Deactivated successfully. machine # [ 391.161166] systemd[1]: cri-containerd-6fb46a6838de609dedf4f075b4d4b3d4a45f684618964c6ad2cf45c645cf1b08.scope: Deactivated successfully. machine # [ 391.211854] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-6fb46a6838de609dedf4f075b4d4b3d4a45f684618964c6ad2cf45c645cf1b08-rootfs.mount: Deactivated successfully. machine # [ 391.249063] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-6fb46a6838de609dedf4f075b4d4b3d4a45f684618964c6ad2cf45c645cf1b08-shm.mount: Deactivated successfully. machine # [ 391.435813] cni0: port 2(vethcd6089ae) entered disabled state machine # [ 391.284373] dhcpcd[683]: vethcd6089ae: carrier lost machine # [ 391.438327] vethcd6089ae (unregistering): left allmulticast mode machine # [ 391.439501] vethcd6089ae (unregistering): left promiscuous mode machine # [ 391.440611] cni0: port 2(vethcd6089ae) entered disabled state machine # [ 391.308355] systemd[1]: run-netns-cni\x2d36d1fe93\x2db4d0\x2d15a1\x2d4556\x2d177b34a72f93.mount: Deactivated successfully. machine # [ 391.311103] dhcpcd[683]: vethcd6089ae: deleting address fe80::9c37:54ff:fe5e:8e85 machine # [ 391.315337] dhcpcd[683]: vethcd6089ae: deleting route to 169.254.0.0/16 machine # [ 391.380293] dhcpcd[683]: vethcd6089ae: removing interface machine # [ 391.487735] k3s[877]: I0927 14:48:29.146635 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-nix-grpc-farm\") pod \"d406ef3d-111a-419d-b6f5-37e171bb6125\" (UID: \"d406ef3d-111a-419d-b6f5-37e171bb6125\") " machine # [ 391.495987] k3s[877]: I0927 14:48:29.146705 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-kube-api-access-9zl8t\" (UniqueName: \"kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-kube-api-access-9zl8t\") pod \"d406ef3d-111a-419d-b6f5-37e171bb6125\" (UID: \"d406ef3d-111a-419d-b6f5-37e171bb6125\") " machine # [ 391.503925] k3s[877]: I0927 14:48:29.146751 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d406ef3d-111a-419d-b6f5-37e171bb6125-job\" (UniqueName: \"kubernetes.io/configmap/d406ef3d-111a-419d-b6f5-37e171bb6125-job\") pod \"d406ef3d-111a-419d-b6f5-37e171bb6125\" (UID: \"d406ef3d-111a-419d-b6f5-37e171bb6125\") " machine # [ 391.508065] k3s[877]: I0927 14:48:29.147361 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d406ef3d-111a-419d-b6f5-37e171bb6125-job" pod "d406ef3d-111a-419d-b6f5-37e171bb6125" (UID: "d406ef3d-111a-419d-b6f5-37e171bb6125"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 391.511938] k3s[877]: I0927 14:48:29.155872 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-kube-api-access-9zl8t" pod "d406ef3d-111a-419d-b6f5-37e171bb6125" (UID: "d406ef3d-111a-419d-b6f5-37e171bb6125"). InnerVolumeSpecName "kube-api-access-9zl8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 391.516258] k3s[877]: I0927 14:48:29.156030 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-nix-grpc-farm" pod "d406ef3d-111a-419d-b6f5-37e171bb6125" (UID: "d406ef3d-111a-419d-b6f5-37e171bb6125"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 391.520437] systemd[1]: var-lib-kubelet-pods-d406ef3d\x2d111a\x2d419d\x2db6f5\x2d37e171bb6125-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 391.522599] systemd[1]: var-lib-kubelet-pods-d406ef3d\x2d111a\x2d419d\x2db6f5\x2d37e171bb6125-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d9zl8t.mount: Deactivated successfully. machine # [ 391.588113] k3s[877]: I0927 14:48:29.247363 877 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zl8t\" (UniqueName: \"kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-kube-api-access-9zl8t\") on node \"machine\" DevicePath \"\"" machine # [ 391.588534] k3s[877]: I0927 14:48:29.247438 877 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/d406ef3d-111a-419d-b6f5-37e171bb6125-job\") on node \"machine\" DevicePath \"\"" machine # [ 391.590116] k3s[877]: I0927 14:48:29.247472 877 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/d406ef3d-111a-419d-b6f5-37e171bb6125-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 392.146148] k3s[877]: I0927 14:48:29.805504 877 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fb46a6838de609dedf4f075b4d4b3d4a45f684618964c6ad2cf45c645cf1b08" machine # [ 392.155247] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podd406ef3d_111a_419d_b6f5_37e171bb6125.slice. machine # [ 392.157314] systemd[1]: kubepods-besteffort-podd406ef3d_111a_419d_b6f5_37e171bb6125.slice: Consumed 1.104s CPU time over 1min 50.522s wall clock time, 123.7M memory peak, 53.9M read from disk, 632K written to disk, 18.1K incoming IP traffic, 44.7K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 111.90 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.14 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp2roaw6xm/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (27s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.13 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 112.96 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.27 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.43 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-zkc2k -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 396.195444] k3s[877]: E0927 14:48:33.854188 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40090: use of closed network connection machine # [ 397.465925] k3s[877]: E0927 14:48:35.125036 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40122: use of closed network connection machine # [ 401.298963] k3s[877]: E0927 14:48:38.957943 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40226: use of closed network connection machine # [ 402.602367] k3s[877]: E0927 14:48:40.261352 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40262: use of closed network connection machine # [ 403.882796] k3s[877]: E0927 14:48:41.541838 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:50998: use of closed network connection machine # [ 405.154272] k3s[877]: E0927 14:48:42.813141 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51016: use of closed network connection machine # [ 405.156349] k3s[877]: E0927 14:48:42.813190 877 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:41144->127.0.0.1:10010: write tcp 127.0.0.1:41144->127.0.0.1:10010: write: broken pipe machine # [ 405.158938] k3s[877]: time="2026-09-27T14:48:42Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:55986->127.0.0.1:10250: read: connection reset by peer" machine # [ 407.797548] k3s[877]: E0927 14:48:45.456048 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51070: use of closed network connection machine # [ 409.104651] k3s[877]: E0927 14:48:46.763756 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51090: use of closed network connection machine # [ 410.410953] k3s[877]: E0927 14:48:48.069685 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51114: use of closed network connection machine # [ 411.696986] k3s[877]: E0927 14:48:49.356113 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51142: use of closed network connection machine # [ 413.016781] k3s[877]: E0927 14:48:50.675903 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46092: use of closed network connection machine # [ 414.348056] k3s[877]: E0927 14:48:52.006556 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46120: use of closed network connection machine # [ 414.705641] postgres[766]: [766] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.205 s, sync=0.063 s, total=104.308 s; sync files=364, longest=0.003 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C74D80, redo lsn=0/1C42AE8 machine # [ 415.651741] k3s[877]: E0927 14:48:53.310365 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46166: use of closed network connection machine # [ 416.938620] k3s[877]: E0927 14:48:54.597472 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46192: use of closed network connection machine # [ 418.248970] k3s[877]: E0927 14:48:55.908000 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46214: use of closed network connection machine # [ 418.254519] k3s[877]: E0927 14:48:55.913954 877 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:42006->127.0.0.1:10010: write tcp 127.0.0.1:42006->127.0.0.1:10010: write: broken pipe machine # [ 419.522334] k3s[877]: E0927 14:48:57.181354 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46228: use of closed network connection machine # [ 420.822361] k3s[877]: E0927 14:48:58.481359 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46246: use of closed network connection machine # [ 422.062771] k3s[877]: E0927 14:48:59.721432 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46278: use of closed network connection machine # [ 423.360675] k3s[877]: E0927 14:49:01.019709 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34920: use of closed network connection machine # [ 424.640400] k3s[877]: E0927 14:49:02.299208 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34936: use of closed network connection machine # [ 425.934105] k3s[877]: E0927 14:49:03.593203 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34966: use of closed network connection machine # [ 427.233902] k3s[877]: E0927 14:49:04.892956 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34986: use of closed network connection machine # [ 428.512352] k3s[877]: E0927 14:49:06.171158 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35010: use of closed network connection machine # [ 429.782324] k3s[877]: E0927 14:49:07.441322 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35032: use of closed network connection machine # [ 431.062977] k3s[877]: E0927 14:49:08.722110 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35058: use of closed network connection machine # [ 431.063304] k3s[877]: E0927 14:49:08.722126 877 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:37458->127.0.0.1:10010: write tcp 127.0.0.1:37458->127.0.0.1:10010: write: broken pipe machine # [ 432.407120] k3s[877]: E0927 14:49:10.065448 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35082: use of closed network connection machine # [ 433.703561] k3s[877]: E0927 14:49:11.362567 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58466: use of closed network connection machine # [ 435.008928] k3s[877]: E0927 14:49:12.667212 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58488: use of closed network connection machine # [ 435.009732] k3s[877]: time="2026-09-27T14:49:12Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:54648->127.0.0.1:10250: write: connection reset by peer" machine # [ 435.010528] k3s[877]: time="2026-09-27T14:49:12Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:6443->127.0.0.1:58502: write: connection reset by peer" machine # [ 436.326851] k3s[877]: E0927 14:49:13.985657 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58516: use of closed network connection machine # [ 437.566586] k3s[877]: E0927 14:49:15.225615 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58540: use of closed network connection machine # [ 438.847776] k3s[877]: E0927 14:49:16.506852 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58574: use of closed network connection machine # [ 440.158086] k3s[877]: E0927 14:49:17.816765 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58614: use of closed network connection machine # [ 441.462412] k3s[877]: E0927 14:49:19.121328 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58648: use of closed network connection machine # [ 442.774068] k3s[877]: E0927 14:49:20.432751 877 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:55592->127.0.0.1:10010: write tcp 127.0.0.1:55592->127.0.0.1:10010: write: broken pipe machine # [ 442.774766] k3s[877]: E0927 14:49:20.432775 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58668: use of closed network connection machine # [ 444.118786] k3s[877]: E0927 14:49:21.777755 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39932: use of closed network connection machine # [ 445.413683] k3s[877]: E0927 14:49:23.072266 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39958: use of closed network connection machine # [ 446.693359] k3s[877]: E0927 14:49:24.352428 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39990: use of closed network connection machine # [ 447.994879] k3s[877]: E0927 14:49:25.653635 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40016: use of closed network connection machine # [ 449.296411] k3s[877]: E0927 14:49:26.955424 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40034: use of closed network connection machine # [ 450.589564] k3s[877]: E0927 14:49:28.248681 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40050: use of closed network connection machine # [ 451.897631] k3s[877]: E0927 14:49:29.556756 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:40076: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-75b44f88dd-zkc2k -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 57.29 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 452.136236] niks3-server[1213]: 2026/09/27 14:49:29 INFO Received push request method=POST path=/api/pushes machine # [ 452.151522] niks3-server[1213]: 2026/09/27 14:49:29 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 452.152271] niks3-server[1213]: 2026/09/27 14:49:29 INFO Signed narinfos id=21 count=1 machine # [ 452.155619] niks3-server[1213]: 2026/09/27 14:49:29 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 452.156989] niks3-server[1213]: 2026/09/27 14:49:29 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 452.171020] niks3-server[1213]: 2026/09/27 14:49:29 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 452.178278] niks3-server[1213]: 2026/09/27 14:49:29 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 476.894688] niks3-server[1213]: 2026/09/27 14:49:54 INFO Received push request method=POST path=/api/pushes machine # [ 476.908668] niks3-server[1213]: 2026/09/27 14:49:54 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 476.910904] niks3-server[1213]: 2026/09/27 14:49:54 INFO Signed narinfos id=22 count=1 machine # [ 476.915925] niks3-server[1213]: 2026/09/27 14:49:54 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 476.921458] niks3-server[1213]: 2026/09/27 14:49:54 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 476.922448] niks3-server[1213]: 2026/09/27 14:49:54 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 476.924565] niks3-server[1213]: 2026/09/27 14:49:54 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 476.925871] niks3-server[1213]: 2026/09/27 14:49:54 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 477.007925] niks3-server[1213]: 2026/09/27 14:49:54 INFO Received push request method=POST path=/api/pushes machine # [ 477.024531] niks3-server[1213]: 2026/09/27 14:49:54 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 477.025337] niks3-server[1213]: 2026/09/27 14:49:54 INFO Signed narinfos id=23 count=1 machine # [ 477.029176] niks3-server[1213]: 2026/09/27 14:49:54 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 477.032465] niks3-server[1213]: 2026/09/27 14:49:54 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 477.034443] niks3-server[1213]: 2026/09/27 14:49:54 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 477.038650] niks3-server[1213]: 2026/09/27 14:49:54 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 501.951819] niks3-server[1213]: 2026/09/27 14:50:19 INFO Received push request method=POST path=/api/pushes machine # [ 501.971158] niks3-server[1213]: 2026/09/27 14:50:19 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 501.974074] niks3-server[1213]: 2026/09/27 14:50:19 INFO Signed narinfos id=24 count=1 machine # [ 501.975670] niks3-server[1213]: 2026/09/27 14:50:19 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 501.979029] niks3-server[1213]: 2026/09/27 14:50:19 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 501.981368] niks3-server[1213]: 2026/09/27 14:50:19 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 501.986924] niks3-server[1213]: 2026/09/27 14:50:19 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 502.060289] niks3-server[1213]: 2026/09/27 14:50:19 INFO Received push request method=POST path=/api/pushes machine # [ 502.070551] niks3-server[1213]: 2026/09/27 14:50:19 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 502.072663] niks3-server[1213]: 2026/09/27 14:50:19 INFO Signed narinfos id=25 count=1 machine # [ 502.076564] niks3-server[1213]: 2026/09/27 14:50:19 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 502.077848] niks3-server[1213]: 2026/09/27 14:50:19 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 502.080961] niks3-server[1213]: 2026/09/27 14:50:19 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 502.084430] niks3-server[1213]: 2026/09/27 14:50:19 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 526.997604] niks3-server[1213]: 2026/09/27 14:50:44 INFO Received push request method=POST path=/api/pushes machine # [ 527.016994] niks3-server[1213]: 2026/09/27 14:50:44 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 527.018144] niks3-server[1213]: 2026/09/27 14:50:44 INFO Signed narinfos id=26 count=1 machine # [ 527.028192] niks3-server[1213]: 2026/09/27 14:50:44 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 527.031329] niks3-server[1213]: 2026/09/27 14:50:44 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 527.033321] niks3-server[1213]: 2026/09/27 14:50:44 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 527.045342] niks3-server[1213]: 2026/09/27 14:50:44 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 527.053257] niks3-server[1213]: 2026/09/27 14:50:44 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.14 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 133.17 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.16 seconds) machine: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c"' machine: (finished: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c"', in 0.02 seconds) (finished: subtest: metrics carry build_info, in 0.19 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 527.445694] k3s[877]: E0927 14:50:45.104742 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37498: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.18 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 527.693771] k3s[877]: E0927 14:50:45.352646 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37518: use of closed network connection machine # [ 527.694512] k3s[877]: E0927 14:50:45.352856 877 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:38232->127.0.0.1:10010: write tcp 127.0.0.1:38232->127.0.0.1:10010: write: broken pipe machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.25 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc -- sh -c 'fallocate -l 11437584384 /nix/fill' machine # [ 527.897319] k3s[877]: E0927 14:50:45.556704 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37544: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc -- sh -c 'fallocate -l 11437584384 /nix/fill', in 0.20 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc --since=30s | grep -q 'store paths deleted', in 8.81 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc -- sh -c 'rm /nix/fill' machine # [ 536.925586] k3s[877]: E0927 14:50:54.584408 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43642: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc -- sh -c 'rm /nix/fill', in 0.22 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.13 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 537.228505] k3s[877]: E0927 14:50:54.887882 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43684: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.17 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 9.96 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 537.251394] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: e5e7f87457614982897c97986de05167 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 537.366258] nix[10641]: don't know how to build these paths: machine # [ 537.366501] nix[10641]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 537.387205] nix[10641]: copying 1 paths to '127.0.0.1:30051'... machine # [ 537.388343] nix[10641]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 537.437891] niks3-server[1213]: 2026/09/27 14:50:55 INFO Received push request method=POST path=/api/pushes machine # [ 537.451483] niks3-server[1213]: 2026/09/27 14:50:55 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 537.454867] niks3-server[1213]: 2026/09/27 14:50:55 INFO Signed narinfos id=27 count=1 machine # [ 537.457406] niks3-server[1213]: 2026/09/27 14:50:55 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 537.459568] niks3-server[1213]: 2026/09/27 14:50:55 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 537.464101] niks3-server[1213]: 2026/09/27 14:50:55 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 537.467992] niks3-server[1213]: 2026/09/27 14:50:55 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 537.477158] nix[10641]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 537.479400] nix[10641]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.16 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 538.493097] nix[10641]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 538.494856] nix[10641]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 538.511370] systemd[1]: cri-containerd-02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2.scope: Deactivated successfully. machine # [ 538.513112] systemd[1]: cri-containerd-02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2.scope: Consumed 5.092s CPU time over 8min 13.463s wall clock time, 47.5M memory peak, 25.4M read from disk, 619K incoming IP traffic, 756K outgoing IP traffic. machine # [ 538.540389] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2-rootfs.mount: Deactivated successfully. machine # [ 538.571545] systemd[1]: cri-containerd-32f41013761ef11f97d237a2637c64c63d7b77f2d8965a13280b2be638bd1120.scope: Deactivated successfully. machine # [ 538.599424] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-32f41013761ef11f97d237a2637c64c63d7b77f2d8965a13280b2be638bd1120-rootfs.mount: Deactivated successfully. machine # [ 538.630682] systemd[1]: Created slice libcontainer container kubepods-besteffort-podfa3a2a39_d6b1_461c_8900_31428dbc6e74.slice. machine # [ 538.638300] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-32f41013761ef11f97d237a2637c64c63d7b77f2d8965a13280b2be638bd1120-shm.mount: Deactivated successfully. machine # [ 538.848727] cni0: port 3(veth392a7af8) entered disabled state machine # [ 538.698378] dhcpcd[683]: veth392a7af8: carrier lost machine # [ 538.851331] veth392a7af8 (unregistering): left allmulticast mode machine # [ 538.852653] veth392a7af8 (unregistering): left promiscuous mode machine # [ 538.854243] cni0: port 3(veth392a7af8) entered disabled state machine # [ 538.724757] k3s[877]: I0927 14:50:56.383961 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/fa3a2a39-d6b1-461c-8900-31428dbc6e74-tls-ca\") pod \"nix-grpc-farm-lb-75b44f88dd-gppvp\" (UID: \"fa3a2a39-d6b1-461c-8900-31428dbc6e74\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-gppvp" machine # [ 538.725185] k3s[877]: I0927 14:50:56.384651 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa3a2a39-d6b1-461c-8900-31428dbc6e74-tmp\") pod \"nix-grpc-farm-lb-75b44f88dd-gppvp\" (UID: \"fa3a2a39-d6b1-461c-8900-31428dbc6e74\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-gppvp" machine # [ 538.725941] systemd[1]: run-netns-cni\x2d3132797d\x2dbb7a\x2d21be\x2df2b6\x2d71e602021026.mount: Deactivated successfully. machine # [ 538.727550] k3s[877]: I0927 14:50:56.385704 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa3a2a39-d6b1-461c-8900-31428dbc6e74-config\") pod \"nix-grpc-farm-lb-75b44f88dd-gppvp\" (UID: \"fa3a2a39-d6b1-461c-8900-31428dbc6e74\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-gppvp" machine # [ 538.728679] k3s[877]: I0927 14:50:56.385744 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/fa3a2a39-d6b1-461c-8900-31428dbc6e74-tls-lb\") pod \"nix-grpc-farm-lb-75b44f88dd-gppvp\" (UID: \"fa3a2a39-d6b1-461c-8900-31428dbc6e74\") " pod="farm/nix-grpc-farm-lb-75b44f88dd-gppvp" machine # [ 538.747378] dhcpcd[683]: veth392a7af8: deleting address fe80::1058:23ff:fec3:cbd9 machine # [ 538.752245] dhcpcd[683]: veth392a7af8: deleting route to 169.254.0.0/16 machine # [ 538.771988] k3s[877]: I0927 14:50:56.431395 877 scope.go:122] "RemoveContainer" containerID="02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2" machine # [ 538.782104] k3s[877]: I0927 14:50:56.441439 877 scope.go:122] "RemoveContainer" containerID="02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2" machine # [ 538.782628] k3s[877]: E0927 14:50:56.442095 877 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2\": not found" containerID="02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2" machine # [ 538.783567] k3s[877]: I0927 14:50:56.443010 877 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2"} err="failed to get container status \"02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2\": rpc error: code = NotFound desc = an error occurred when try to find container \"02d75aa3322f8939978905f84e1357044bd9fbdcd7149a46866356f1457d87a2\": not found" machine # [ 538.826294] dhcpcd[683]: veth392a7af8: removing interface machine # [ 538.826524] k3s[877]: I0927 14:50:56.485893 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-ca\" (UniqueName: \"kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-ca\") pod \"f981501a-0d76-464d-bda0-ec9e0340106b\" (UID: \"f981501a-0d76-464d-bda0-ec9e0340106b\") " machine # [ 538.827059] k3s[877]: I0927 14:50:56.485932 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f981501a-0d76-464d-bda0-ec9e0340106b-config\" (UniqueName: \"kubernetes.io/configmap/f981501a-0d76-464d-bda0-ec9e0340106b-config\") pod \"f981501a-0d76-464d-bda0-ec9e0340106b\" (UID: \"f981501a-0d76-464d-bda0-ec9e0340106b\") " machine # [ 538.827602] k3s[877]: I0927 14:50:56.485962 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-lb\" (UniqueName: \"kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-lb\") pod \"f981501a-0d76-464d-bda0-ec9e0340106b\" (UID: \"f981501a-0d76-464d-bda0-ec9e0340106b\") " machine # [ 538.828271] k3s[877]: I0927 14:50:56.485995 877 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f981501a-0d76-464d-bda0-ec9e0340106b-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f981501a-0d76-464d-bda0-ec9e0340106b-tmp\") pod \"f981501a-0d76-464d-bda0-ec9e0340106b\" (UID: \"f981501a-0d76-464d-bda0-ec9e0340106b\") " machine # [ 538.845080] systemd[1]: var-lib-kubelet-pods-f981501a\x2d0d76\x2d464d\x2dbda0\x2dec9e0340106b-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 538.845442] systemd[1]: var-lib-kubelet-pods-f981501a\x2d0d76\x2d464d\x2dbda0\x2dec9e0340106b-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 538.847182] systemd[1]: var-lib-kubelet-pods-f981501a\x2d0d76\x2d464d\x2dbda0\x2dec9e0340106b-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 538.847657] systemd[1]: var-lib-kubelet-pods-f981501a\x2d0d76\x2d464d\x2dbda0\x2dec9e0340106b-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 538.848316] k3s[877]: I0927 14:50:56.507176 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f981501a-0d76-464d-bda0-ec9e0340106b-tmp" pod "f981501a-0d76-464d-bda0-ec9e0340106b" (UID: "f981501a-0d76-464d-bda0-ec9e0340106b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 538.849089] k3s[877]: I0927 14:50:56.507270 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-ca" pod "f981501a-0d76-464d-bda0-ec9e0340106b" (UID: "f981501a-0d76-464d-bda0-ec9e0340106b"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 538.850056] k3s[877]: I0927 14:50:56.509208 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-lb" pod "f981501a-0d76-464d-bda0-ec9e0340106b" (UID: "f981501a-0d76-464d-bda0-ec9e0340106b"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 538.870696] k3s[877]: I0927 14:50:56.530093 877 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f981501a-0d76-464d-bda0-ec9e0340106b-config" pod "f981501a-0d76-464d-bda0-ec9e0340106b" (UID: "f981501a-0d76-464d-bda0-ec9e0340106b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 538.927111] k3s[877]: I0927 14:50:56.586507 877 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f981501a-0d76-464d-bda0-ec9e0340106b-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 538.927304] k3s[877]: I0927 14:50:56.586557 877 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 538.927741] k3s[877]: I0927 14:50:56.586571 877 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f981501a-0d76-464d-bda0-ec9e0340106b-config\") on node \"machine\" DevicePath \"\"" machine # [ 538.928450] k3s[877]: I0927 14:50:56.586583 877 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/f981501a-0d76-464d-bda0-ec9e0340106b-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 539.111790] cni0: port 2(veth419fdf96) entered blocking state machine # [ 539.112757] cni0: port 2(veth419fdf96) entered disabled state machine # [ 539.113952] veth419fdf96: entered allmulticast mode machine # [ 539.115050] veth419fdf96: entered promiscuous mode machine # [ 538.966403] (udev-worker)[10853]: Network interface NamePolicy= disabled on kernel command line. machine # [ 539.127886] cni0: port 2(veth419fdf96) entered blocking state machine # [ 539.128863] cni0: port 2(veth419fdf96) entered forwarding state machine # [ 538.994524] dhcpcd[683]: veth419fdf96: IAID 02:e4:26:a7 machine # [ 538.994938] dhcpcd[683]: veth419fdf96: adding address fe80::5c88:2ff:fee4:26a7 machine # [ 539.055512] systemd[1]: Started libcontainer container 8aefa704975cb7cd29d7cf688ba08012ab9c0d1159c9f05c6ecd55e435c65929. machine # [ 539.079284] systemd[1]: Removed slice libcontainer container kubepods-besteffort-podf981501a_0d76_464d_bda0_ec9e0340106b.slice. machine # [ 539.080062] systemd[1]: kubepods-besteffort-podf981501a_0d76_464d_bda0_ec9e0340106b.slice: Consumed 5.122s CPU time over 8min 15.238s wall clock time, 47.8M memory peak, 25.4M read from disk, 619K incoming IP traffic, 756K outgoing IP traffic. machine # [ 539.174395] systemd[1]: Started libcontainer container 163e1f92eb7df85ca6d9b0318b27585183b4e8e5b6bd64a45bc4ed99595b8463. machine # [ 539.236940] dhcpcd[683]: veth419fdf96: soliciting a DHCP lease machine # [ 539.562151] systemd[1]: var-lib-kubelet-pods-f981501a\x2d0d76\x2d464d\x2dbda0\x2dec9e0340106b-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 539.563086] systemd[1]: var-lib-kubelet-pods-f981501a\x2d0d76\x2d464d\x2dbda0\x2dec9e0340106b-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 539.809645] k3s[877]: I0927 14:50:57.468239 877 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-75b44f88dd-gppvp" podStartSLOduration=1.468195058 podStartE2EDuration="1.468195058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:50:57.465955947 +0000 UTC m=+522.991008016" watchObservedRunningTime="2026-09-27 14:50:57.468195058 +0000 UTC m=+522.993247128" machine # [ 540.579937] k3s[877]: I0927 14:50:58.239245 877 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f981501a-0d76-464d-bda0-ec9e0340106b" path="/var/lib/kubelet/pods/f981501a-0d76-464d-bda0-ec9e0340106b/volumes" machine # [ 540.994626] nix[10641]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 541.368117] dhcpcd[683]: veth419fdf96: soliciting an IPv6 router machine # [ 542.049107] nix[10641]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 542.050263] nix[10641]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-jmn2c: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 544.238854] dhcpcd[683]: veth419fdf96: probing for an IPv4LL address machine # [ 549.194300] dhcpcd[683]: veth419fdf96: using IPv4LL address 169.254.158.108 machine # [ 549.194733] dhcpcd[683]: veth419fdf96: adding route to 169.254.0.0/16 machine # [ 553.371473] dhcpcd[683]: veth419fdf96: no IPv6 Routers available machine # [ 586.998735] niks3-server[1213]: 2026/09/27 14:51:44 INFO Received push request method=POST path=/api/pushes machine # [ 587.016890] niks3-server[1213]: 2026/09/27 14:51:44 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 587.017713] niks3-server[1213]: 2026/09/27 14:51:44 INFO Signed narinfos id=28 count=1 machine # [ 587.024870] niks3-server[1213]: 2026/09/27 14:51:44 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 587.026622] niks3-server[1213]: 2026/09/27 14:51:44 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 587.032503] niks3-server[1213]: 2026/09/27 14:51:44 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 587.038366] niks3-server[1213]: 2026/09/27 14:51:44 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 587.074250] systemd[1]: vialb.service: Deactivated successfully. machine # [ 587.074994] systemd[1]: vialb.service: Consumed 194ms CPU time over 49.822s wall clock time, 42.5M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.4K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.98 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.20 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.46 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 587.713778] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: b484d69cc2814c3889e5e09777f2c3e2 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.02 seconds) machine # [ 587.849417] nix[11661]: don't know how to build these paths: machine # [ 587.849755] nix[11661]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 587.870259] nix[11661]: copying 1 paths to '127.0.0.1:30051'... machine # [ 587.870620] nix[11661]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 587.908846] niks3-server[1213]: 2026/09/27 14:51:45 INFO Received push request method=POST path=/api/pushes machine # command terminated with exit code 1 machine # [ 587.926711] niks3-server[1213]: 2026/09/27 14:51:45 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 587.927366] niks3-server[1213]: 2026/09/27 14:51:45 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 587.928297] niks3-server[1213]: 2026/09/27 14:51:45 INFO Signed narinfos id=29 count=1 machine # [ 587.934086] niks3-server[1213]: 2026/09/27 14:51:45 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 587.940759] niks3-server[1213]: 2026/09/27 14:51:45 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 587.947478] niks3-server[1213]: 2026/09/27 14:51:45 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 587.952904] nix[11661]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 587.953291] nix[11661]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # command terminated with exit code 1 machine # [ 588.110301] k3s[877]: E0927 14:51:45.769145 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48796: use of closed network connection machine # command terminated with exit code 1 machine # [ 589.455010] k3s[877]: E0927 14:51:47.113797 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48812: use of closed network connection machine # command terminated with exit code 1 machine # [ 589.653616] k3s[877]: E0927 14:51:47.312995 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48830: use of closed network connection machine # command terminated with exit code 1 machine # [ 590.957062] k3s[877]: E0927 14:51:48.615792 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48854: use of closed network connection machine # [ 591.144966] k3s[877]: E0927 14:51:48.804315 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48884: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 592.430180] k3s[877]: E0927 14:51:50.089214 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48912: use of closed network connection machine # [ 592.615929] k3s[877]: E0927 14:51:50.275255 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:48934: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 593.874193] k3s[877]: E0927 14:51:51.533156 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57104: use of closed network connection machine # [ 594.061334] k3s[877]: E0927 14:51:51.720735 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57128: use of closed network connection machine # command terminated with exit code 1 machine # [ 595.329965] k3s[877]: E0927 14:51:52.989090 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57160: use of closed network connection machine # command terminated with exit code 1 machine # [ 595.332536] k3s[877]: time="2026-09-27T14:51:52Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:48672->127.0.0.1:10250: write: broken pipe" machine # [ 595.501346] k3s[877]: E0927 14:51:53.160675 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57198: use of closed network connection machine # command terminated with exit code 1 machine # [ 596.756991] k3s[877]: E0927 14:51:54.416125 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57228: use of closed network connection machine # command terminated with exit code 1 machine # [ 596.939674] k3s[877]: E0927 14:51:54.599075 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57250: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 598.206263] k3s[877]: E0927 14:51:55.865171 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57272: use of closed network connection machine # [ 598.380288] k3s[877]: E0927 14:51:56.039454 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57296: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 599.680283] k3s[877]: E0927 14:51:57.339143 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57312: use of closed network connection machine # [ 599.890947] k3s[877]: E0927 14:51:57.550122 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57338: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 601.170373] k3s[877]: E0927 14:51:58.829238 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57380: use of closed network connection machine # [ 601.350614] k3s[877]: E0927 14:51:59.009987 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57398: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 602.596534] k3s[877]: E0927 14:52:00.255463 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57420: use of closed network connection machine # [ 602.766583] k3s[877]: E0927 14:52:00.425929 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:57466: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 604.024989] k3s[877]: E0927 14:52:01.683994 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41012: use of closed network connection machine # [ 604.187835] k3s[877]: E0927 14:52:01.847266 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41024: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 605.419755] k3s[877]: E0927 14:52:03.077672 877 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:37070->127.0.0.1:10010: write tcp 127.0.0.1:37070->127.0.0.1:10010: write: broken pipe machine # [ 605.425513] k3s[877]: E0927 14:52:03.077815 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41056: use of closed network connection machine # [ 605.587952] k3s[877]: E0927 14:52:03.247357 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41068: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 606.865890] k3s[877]: time="2026-09-27T14:52:04Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:38580->127.0.0.1:10250: write: broken pipe" machine # [ 606.866701] k3s[877]: E0927 14:52:04.524655 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41098: use of closed network connection machine # [ 607.048475] k3s[877]: E0927 14:52:04.707886 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41130: use of closed network connection machine # command terminated with exit code 1 machine # [ 608.332057] k3s[877]: E0927 14:52:05.991183 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41158: use of closed network connection machine # command terminated with exit code 1 machine # [ 608.333352] k3s[877]: E0927 14:52:05.991486 877 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:37116->127.0.0.1:10010: write tcp 127.0.0.1:37116->127.0.0.1:10010: write: broken pipe machine # [ 608.334288] k3s[877]: time="2026-09-27T14:52:05Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:38596->127.0.0.1:10250: read: connection reset by peer" machine # [ 608.334966] k3s[877]: time="2026-09-27T14:52:05Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:38596->127.0.0.1:10250: write: broken pipe" machine # [ 608.509150] k3s[877]: E0927 14:52:06.168453 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41186: use of closed network connection machine # command terminated with exit code 1 machine # [ 609.792072] k3s[877]: E0927 14:52:07.451185 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41210: use of closed network connection machine # command terminated with exit code 1 machine # [ 609.986792] k3s[877]: E0927 14:52:07.646199 877 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:37142->127.0.0.1:10010: write tcp 127.0.0.1:37142->127.0.0.1:10010: write: broken pipe machine # [ 609.987044] k3s[877]: E0927 14:52:07.646364 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41238: use of closed network connection machine # command terminated with exit code 1 machine # [ 610.806049] postgres[766]: [766] LOG: checkpoint starting: time machine # [ 611.242979] k3s[877]: E0927 14:52:08.902122 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41260: use of closed network connection machine # command terminated with exit code 1 machine # [ 611.499994] k3s[877]: E0927 14:52:09.159361 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41282: use of closed network connection machine # command terminated with exit code 1 machine # [ 612.797901] k3s[877]: E0927 14:52:10.457037 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:41320: use of closed network connection machine # command terminated with exit code 1 machine # [ 612.976820] k3s[877]: E0927 14:52:10.636172 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45356: use of closed network connection machine # command terminated with exit code 1 machine # [ 613.339475] postgres[766]: [766] LOG: checkpoint complete: wrote 25 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.511 s, sync=0.008 s, total=2.534 s; sync files=22, longest=0.004 s, average=0.001 s; distance=243 kB, estimate=4505 kB; lsn=0/1C7FA70, redo lsn=0/1C7FA18 machine # [ 614.228190] k3s[877]: E0927 14:52:11.886619 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45376: use of closed network connection machine # [ 614.402731] k3s[877]: E0927 14:52:12.062104 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45390: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-795755579b-5m79c --wait=false, in 0.12 seconds) machine: must succeed: sleep 5.0 machine # [ 614.579717] systemd[1]: cri-containerd-69e51ba64d52597e43d29a646fd74291706329b6c5ee0343523565fe627d494c.scope: Deactivated successfully. machine # [ 614.581606] systemd[1]: cri-containerd-69e51ba64d52597e43d29a646fd74291706329b6c5ee0343523565fe627d494c.scope: Consumed 573ms CPU time over 9min 19.120s wall clock time, 13.4M memory peak, 5.2M read from disk. machine # [ 614.604584] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-69e51ba64d52597e43d29a646fd74291706329b6c5ee0343523565fe627d494c-rootfs.mount: Deactivated successfully. machine # [ 614.630381] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode1d25430_b4eb_42f0_9565_52da69420cf0.slice. machine # [ 614.795488] k3s[877]: I0927 14:52:12.454872 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/e1d25430-b4eb-42f0-9565-52da69420cf0-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw\" (UID: \"e1d25430-b4eb-42f0-9565-52da69420cf0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" machine # [ 614.795772] k3s[877]: I0927 14:52:12.454933 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/e1d25430-b4eb-42f0-9565-52da69420cf0-build\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw\" (UID: \"e1d25430-b4eb-42f0-9565-52da69420cf0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" machine # [ 614.796231] k3s[877]: I0927 14:52:12.454965 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/e1d25430-b4eb-42f0-9565-52da69420cf0-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw\" (UID: \"e1d25430-b4eb-42f0-9565-52da69420cf0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" machine # [ 614.796713] k3s[877]: I0927 14:52:12.454999 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/e1d25430-b4eb-42f0-9565-52da69420cf0-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw\" (UID: \"e1d25430-b4eb-42f0-9565-52da69420cf0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" machine # [ 614.797436] k3s[877]: I0927 14:52:12.455028 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e1d25430-b4eb-42f0-9565-52da69420cf0-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw\" (UID: \"e1d25430-b4eb-42f0-9565-52da69420cf0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" machine # [ 614.798037] k3s[877]: I0927 14:52:12.455059 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnkqq\" (UniqueName: \"kubernetes.io/projected/e1d25430-b4eb-42f0-9565-52da69420cf0-kube-api-access-lnkqq\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw\" (UID: \"e1d25430-b4eb-42f0-9565-52da69420cf0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" machine # [ 614.824160] k3s[877]: I0927 14:52:12.483556 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/e1d25430-b4eb-42f0-9565-52da69420cf0-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw\" (UID: \"e1d25430-b4eb-42f0-9565-52da69420cf0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" machine # [ 614.824503] k3s[877]: I0927 14:52:12.483605 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e1d25430-b4eb-42f0-9565-52da69420cf0-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw\" (UID: \"e1d25430-b4eb-42f0-9565-52da69420cf0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" machine # [ 614.825069] k3s[877]: I0927 14:52:12.483628 877 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/e1d25430-b4eb-42f0-9565-52da69420cf0-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw\" (UID: \"e1d25430-b4eb-42f0-9565-52da69420cf0\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" machine # [ 615.445449] cni0: port 3(veth20746916) entered blocking state machine # [ 615.448004] cni0: port 3(veth20746916) entered disabled state machine # [ 615.450643] veth20746916: entered allmulticast mode machine # [ 615.452879] veth20746916: entered promiscuous mode machine # [ 615.469992] cni0: port 3(veth20746916) entered blocking state machine # [ 615.471667] cni0: port 3(veth20746916) entered forwarding state machine # [ 615.350756] (udev-worker)[13329]: Network interface NamePolicy= disabled on kernel command line. machine # [ 615.378678] dhcpcd[683]: veth20746916: IAID f3:2f:df:21 machine # [ 615.379054] dhcpcd[683]: veth20746916: adding address fe80::186a:f3ff:fe2f:df21 machine # [ 615.413358] systemd[1]: Started libcontainer container f8d571d7302debad0064aab2c96e44313256658fefc683c013958f817d1d7736. machine # [ 615.548383] systemd[1]: Started libcontainer container bfd07dd3b964a6f0d01764def1e726ce8f3fecc8ec0c1809f018d0987d6277f3. machine # [ 616.294877] dhcpcd[683]: veth20746916: soliciting a DHCP lease machine # [ 617.307514] dhcpcd[683]: veth20746916: soliciting an IPv6 router machine # [ 617.965793] systemd[1]: cri-containerd-bfd07dd3b964a6f0d01764def1e726ce8f3fecc8ec0c1809f018d0987d6277f3.scope: Deactivated successfully. machine # [ 617.971370] systemd[1]: cri-containerd-bfd07dd3b964a6f0d01764def1e726ce8f3fecc8ec0c1809f018d0987d6277f3.scope: Consumed 1.067s CPU time over 2.416s wall clock time, 470.3M memory peak, 188.1M read from disk, 168.6M written to disk. machine # [ 618.029645] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-bfd07dd3b964a6f0d01764def1e726ce8f3fecc8ec0c1809f018d0987d6277f3-rootfs.mount: Deactivated successfully. machine # [ 619.226388] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2595290908.mount: Deactivated successfully. machine # [ 619.227382] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount512858905.mount: Deactivated successfully. machine # [ 619.378423] systemd[1]: Started libcontainer container eef5632946aa49cb795ef8d183813dee2af893e7eab127bd6ad11cd0d3f8fb2a. machine # [ 619.529364] systemd[1]: Started libcontainer container 74684dbde80959f259e8f7f9b91cdce53dcc60fc786a1c390a074f756603433a. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 619.753292] k3s[877]: E0927 14:52:17.412319 877 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45434: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 619.797351] systemd[1]: Started libcontainer container c0635f83bb32580c9a5cff38b3e36bf1ef1db38e93744e2c555f7843e06ea3de. machine # [ 620.247236] k3s[877]: I0927 14:52:17.906614 877 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-795755579b-c2gfw" podStartSLOduration=3.5216778250000003 podStartE2EDuration="5.906592667s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.384914842s" isStatefulPod=false podCreationTimestamp="2026-09-27 14:52:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-27 14:52:17.817767411 +0000 UTC m=+603.342815010" watchObservedRunningTime="2026-09-27 14:52:17.906592667 +0000 UTC m=+603.431639987" machine # [ 620.467378] k3s[877]: I0927 14:52:18.126631 877 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 621.297986] dhcpcd[683]: veth20746916: probing for an IPv4LL address machine # [ 625.864524] dhcpcd[683]: veth20746916: using IPv4LL address 169.254.19.49 machine # [ 625.867709] dhcpcd[683]: veth20746916: adding route to 169.254.0.0/16 machine # [ 629.309936] dhcpcd[683]: veth20746916: no IPv6 Routers available machine # [ 633.269231] niks3-server[1213]: 2026/09/27 14:52:30 INFO Received push request method=POST path=/api/pushes machine # [ 633.284436] niks3-server[1213]: 2026/09/27 14:52:30 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 633.285903] niks3-server[1213]: 2026/09/27 14:52:30 INFO Signed narinfos id=30 count=1 machine # [ 633.288359] niks3-server[1213]: 2026/09/27 14:52:30 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 633.289694] niks3-server[1213]: 2026/09/27 14:52:30 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 633.297723] niks3-server[1213]: 2026/09/27 14:52:30 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 633.303831] niks3-server[1213]: 2026/09/27 14:52:30 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 633.342478] systemd[1]: slow.service: Deactivated successfully. machine # [ 633.342817] systemd[1]: slow.service: Consumed 148ms CPU time over 45.628s wall clock time, 42.3M memory peak, 4K written to disk, 5.5K incoming IP traffic, 11.7K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.48 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.03 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.16 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.79 seconds) (finished: run the VM test script, in 635.45 seconds) test script finished in 635.49s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-27T14:52:32Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-27T14:52:32Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-27T14:52:32Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 0.96 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh