tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.XPrUaFh7lu', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: ca7af2b9-8b3e-4b87-b52d-967d3aec1073 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-10-05T09:46:46Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T09:46:46Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T09:46:46Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T09:46:46Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T09:46:46Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T09:46:46Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T09:46:46Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T09:46:46Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T09:46:46Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T09:46:46Z INFO virtiofsd] Client connected, servicing requests machine # [2026-10-05T09:46:46Z INFO virtiofsd] Client connected, servicing requests machine # [2026-10-05T09:46:46Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4749mn6ia08gjs2wdq36i4pcn4nw63nn-nixos-system-machine-test/init regInfo=/nix/.ro-store/4mbdb44jpws7j7zvmsmna03s93mm1gf2-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000001] kvm-clock: using sched offset of 479751263 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000004] tsc: Detected 2400.012 MHz processor machine # [ 0.000804] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000830] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000833] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000871] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002724] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002735] Using GB pages for direct mapping machine # [ 0.002837] RAMDISK: [mem 0x7e364000-0x7ffcffff] machine # [ 0.002844] ACPI: Early table checksum verification disabled machine # [ 0.002847] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002851] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002855] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002861] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002863] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002865] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002866] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002868] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002869] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002871] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002872] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002872] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002873] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002873] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002873] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002874] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003095] No NUMA configuration found machine # [ 0.003096] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003098] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005428] Zone ranges: machine # [ 0.005429] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005431] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005432] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005433] Device empty machine # [ 0.005433] Movable zone start for each node machine # [ 0.005434] Early memory node ranges machine # [ 0.005434] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005435] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005436] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005437] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005456] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005728] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.079669] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.080144] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.080158] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.080189] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.080192] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.080193] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.080194] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.080196] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.080196] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.080199] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.080200] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.080204] TSC deadline timer available machine # [ 0.080209] CPU topo: Max. logical packages: 1 machine # [ 0.080209] CPU topo: Max. logical dies: 1 machine # [ 0.080210] CPU topo: Max. dies per package: 1 machine # [ 0.080213] CPU topo: Max. threads per core: 1 machine # [ 0.080214] CPU topo: Num. cores per package: 4 machine # [ 0.080214] CPU topo: Num. threads per package: 4 machine # [ 0.080215] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.080238] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.080253] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.080256] kvm-guest: setup PV sched yield machine # [ 0.080265] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.080267] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.080268] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.080269] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.080271] Booting paravirtualized kernel on KVM machine # [ 0.080274] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.084748] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.087306] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.087354] kvm-guest: PV spinlocks enabled machine # [ 0.087355] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.087358] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4749mn6ia08gjs2wdq36i4pcn4nw63nn-nixos-system-machine-test/init regInfo=/nix/.ro-store/4mbdb44jpws7j7zvmsmna03s93mm1gf2-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.087453] Unknown kernel command line parameters "regInfo=/nix/.ro-store/4mbdb44jpws7j7zvmsmna03s93mm1gf2-closure-info/registration", will be passed to user space. machine # [ 0.087466] random: crng init done machine # [ 0.087467] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.091821] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.094004] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.094076] software IO TLB: area num 4. machine # [ 0.169863] Fallback order for Node 0: 0 machine # [ 0.169870] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.169872] Policy zone: Normal machine # [ 0.172412] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.179290] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.188747] allocated 8388608 bytes of page_ext machine # [ 0.198780] ftrace: allocating 48798 entries in 192 pages machine # [ 0.198782] ftrace: allocated 192 pages with 2 groups machine # [ 0.199628] Dynamic Preempt: lazy machine # [ 0.199819] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.199819] rcu: RCU event tracing is enabled. machine # [ 0.199820] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.199821] Trampoline variant of Tasks RCU enabled. machine # [ 0.199822] Rude variant of Tasks RCU enabled. machine # [ 0.199822] Tracing variant of Tasks RCU enabled. machine # [ 0.199823] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.199823] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.199839] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.199841] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.199842] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.204260] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.204577] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.204585] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.204697] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.208275] Console: colour VGA+ 80x25 machine # [ 0.208278] printk: legacy console [tty0] enabled machine # [ 0.239798] printk: legacy console [ttyS0] enabled machine # [ 0.352167] ACPI: Core revision 20250807 machine # [ 0.353076] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.354674] APIC: Switch to symmetric I/O mode setup machine # [ 0.355721] x2apic enabled machine # [ 0.356476] APIC: Switched APIC routing to: physical x2apic machine # [ 0.357456] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.358702] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.360283] kvm-guest: setup PV IPIs machine # [ 0.361903] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.362990] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.367371] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.369454] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.370484] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.371369] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.372372] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.374368] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.375368] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.377368] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.378368] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.379368] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.380375] Spectre V2 : Enabling IBPB for BPF machine # [ 0.381369] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.382369] active return thunk: srso_alias_return_thunk machine # [ 0.384086] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.385368] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.386368] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.387368] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.388368] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.389368] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.390368] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.392368] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.393368] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.394368] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.395368] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.396368] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.397368] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.426586] Freeing SMP alternatives memory: 44K machine # [ 0.427371] pid_max: default: 32768 minimum: 301 machine # [ 0.428373] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.429462] landlock: Up and running. machine # [ 0.430111] Yama: becoming mindful. machine # [ 0.431039] LSM support for eBPF active machine # [ 0.431538] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.433369] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.435952] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.436965] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.437373] ... version: 2 machine # [ 0.438117] ... bit width: 48 machine # [ 0.438370] ... generic counters: 6 machine # [ 0.439119] ... generic bitmap: 000000000000003f machine # [ 0.439375] ... fixed-purpose counters: 0 machine # [ 0.440127] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.440370] ... value mask: 0000ffffffffffff machine # [ 0.441284] ... max period: 00007fffffffffff machine # [ 0.442095] ... global_ctrl mask: 000000000000003f machine # [ 0.442486] signal: max sigframe size: 3376 machine # [ 0.443310] rcu: Hierarchical SRCU implementation. machine # [ 0.444032] rcu: Max phase no-delay instances is 400. machine # [ 0.444553] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.449883] smp: Bringing up secondary CPUs ... machine # [ 0.450765] smpboot: x86: Booting SMP configuration: machine # [ 0.451373] .... node #0, CPUs: #1 #2 #3 machine # [ 0.455419] smp: Brought up 1 node, 4 CPUs machine # [ 0.456955] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.457696] Memory: 3957800K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220908K reserved, 0K cma-reserved) machine # [ 0.460371] devtmpfs: initialized machine # [ 0.461455] x86/mm: Memory block size: 128MB machine # [ 0.464485] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.465456] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.466479] pinctrl core: initialized pinctrl subsystem machine # [ 0.467680] PM: RTC time: 09:46:46, date: 2026-10-05 machine # [ 0.471410] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.473190] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.474371] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.475939] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.476382] audit: initializing netlink subsys (disabled) machine # [ 0.477406] audit: type=2000 audit(1791193607.546:1): state=initialized audit_enabled=0 res=1 machine # [ 0.477613] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.479372] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.480371] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.481370] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.482370] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.483386] cpuidle: using governor menu machine # [ 0.485618] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.486623] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.487374] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.488387] PCI: Using configuration type 1 for base access machine # [ 0.489491] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.492438] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.493372] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.494371] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.495370] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.500590] ACPI: Added _OSI(Module Device) machine # [ 0.502379] ACPI: Added _OSI(Processor Device) machine # [ 0.504380] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.513861] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.521314] ACPI: Interpreter enabled machine # [ 0.522460] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.524381] ACPI: Using IOAPIC for interrupt routing machine # [ 0.526653] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.530378] PCI: Using E820 reservations for host bridge windows machine # [ 0.533774] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.545286] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.547385] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.550580] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.553624] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.556124] PCI host bridge to bus 0000:00 machine # [ 0.557397] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.559375] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.561375] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.564375] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.565371] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.567372] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.568371] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.569544] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.571865] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.592476] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.594457] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.597464] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.600199] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.606886] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.617414] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.620392] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.623432] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.626392] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.629756] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.640414] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.642392] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.645431] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.649883] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.657412] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.659389] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.661472] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.664526] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.673430] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.675394] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.678448] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.681395] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.685798] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.692430] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.695442] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.699787] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.708432] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.710419] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.714501] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.720436] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.739247] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.740961] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.744426] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.745423] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.748254] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.753543] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.755148] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.756265] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.758015] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.761414] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.762356] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.764217] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.766948] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.769244] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.770323] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.772209] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.773291] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.776243] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.777327] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.780167] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.781466] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.782672] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.784653] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.787400] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.788332] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.789513] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.792371] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.796665] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.797480] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.798473] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.800499] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.801480] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.802471] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.803470] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.804473] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.805406] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.807390] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.808397] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.809392] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.810387] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.811383] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.812382] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.813383] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.816732] iommu: Default domain type: Translated machine # [ 0.817373] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.818709] ACPI: bus type USB registered machine # [ 0.819456] usbcore: registered new interface driver usbfs machine # [ 0.820387] usbcore: registered new interface driver hub machine # [ 0.821312] usbcore: registered new device driver usb machine # [ 0.823399] NetLabel: Initializing machine # [ 0.824039] NetLabel: domain hash size = 128 machine # [ 0.825372] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.826452] NetLabel: unlabeled traffic allowed by default machine # [ 0.827386] PCI: Using ACPI for IRQ routing machine # [ 0.872413] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.873367] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.873367] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.875377] vgaarb: loaded machine # [ 0.876202] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.877015] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.881506] clocksource: Switched to clocksource kvm-clock machine # [ 0.886657] VFS: Disk quotas dquot_6.6.0 machine # [ 0.887453] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.889138] pnp: PnP ACPI init machine # [ 0.889994] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.891042] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.892695] pnp: PnP ACPI: found 5 devices machine # [ 0.904256] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.908067] clocksource: Switched to clocksource acpi_pm machine # [ 0.910866] NET: Registered PF_INET protocol family machine # [ 0.914574] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.951460] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.953064] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.954490] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.957085] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.958443] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.959748] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.961121] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.962460] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.963887] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.964923] NET: Registered PF_XDP protocol family machine # [ 0.965846] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.966929] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.968006] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.969184] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.970405] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.971591] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.973610] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.975963] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.978141] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.980414] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.982281] PCI: CLS 0 bytes, default 64 machine # [ 0.983190] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.983710] Trying to unpack rootfs image as initramfs... machine # [ 0.984354] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB) machine # [ 0.984508] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 1.008444] Initialise system trusted keyrings machine # [ 1.009693] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 1.021206] Key type asymmetric registered machine # [ 1.021981] Asymmetric key parser 'x509' registered machine # [ 1.022981] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 1.024891] io scheduler mq-deadline registered machine # [ 1.025726] io scheduler kyber registered machine # [ 1.029472] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.030909] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.033434] Linux agpgart interface v0.103 machine # [ 1.034257] ACPI: bus type drm_connector registered machine # [ 1.036590] usbcore: registered new interface driver usbserial_generic machine # [ 1.037731] usbserial: USB Serial support registered for generic machine # [ 1.038827] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.038827] Please enable it if your BIOS has the CPPC option. machine # [ 1.041168] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.042723] drop_monitor: Initializing network drop monitor service machine # [ 1.044035] NET: Registered PF_INET6 protocol family machine # [ 1.045742] Segment Routing with IPv6 machine # [ 1.046474] In-situ OAM (IOAM) with IPv6 machine # [ 1.048410] IPI shorthand broadcast: enabled machine # [ 1.052909] sched_clock: Marking stable (899011476, 153782386)->(1073256903, -20463041) machine # [ 1.054803] registered taskstats version 1 machine # [ 1.055981] Loading compiled-in X.509 certificates machine # [ 1.066510] Demotion targets for Node 0: null machine # [ 1.067715] Key type .fscrypt registered machine # [ 1.068462] Key type fscrypt-provisioning registered machine # [ 1.069489] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.070480] ima: Allocated hash algorithm: sha1 machine # [ 1.071369] ima: No architecture policies found machine # [ 1.072466] PM: Magic number: 14:588:777 machine # [ 1.074309] RAS: Correctable Errors collector initialized. machine # [ 1.078975] clk: Disabling unused clocks machine # [ 1.079750] PM: genpd: Disabling unused power domains machine # [ 1.294456] Freeing initrd memory: 29104K machine # [ 1.298995] Freeing unused decrypted memory: 2028K machine # [ 1.302376] Freeing unused kernel image (initmem) memory: 3656K machine # [ 1.303578] Write protecting the kernel read-only data: 32768k machine # [ 1.305976] Freeing unused kernel image (text/rodata gap) memory: 1172K machine # [ 1.307717] Freeing unused kernel image (rodata/data gap) memory: 684K machine # [ 1.358934] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.360104] Run /init as init process machine # [ 1.375820] systemd[1]: Inserted module 'autofs4' machine # [ 1.404164] fuse: init (API version 7.45) machine # [ 1.413627] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.417222] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.421320] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.424651] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.431145] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.432820] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.441342] virtiofs virtio6: discovered new tag: shared machine # [ 1.454398] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.458607] virtiofs virtio7: discovered new tag: xchg machine # [ 1.460143] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.488826] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.825113] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.836745] systemd[1]: Detected virtualization kvm. machine # [ 1.838986] systemd[1]: Detected architecture x86-64. machine # [ 1.841143] systemd[1]: Running in initrd. machine # [ 1.843695] systemd[1]: Initializing machine ID from random generator. machine # [ 1.846708] systemd[1]: Hostname set to . machine # [ 1.966288] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.012058] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.025582] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.026837] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.028314] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.029494] systemd[1]: Reached target Path Units. machine # [ 2.030424] systemd[1]: Reached target Slice Units. machine # [ 2.031360] systemd[1]: Reached target Swaps. machine # [ 2.032174] systemd[1]: Reached target Timer Units. machine # [ 2.033199] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.034459] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.035674] systemd[1]: Listening on Journal Sockets. machine # [ 2.036710] systemd[1]: Listening on udev Control Socket. machine # [ 2.037818] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.038831] systemd[1]: Reached target Socket Units. machine # [ 2.040951] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.043176] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.046617] systemd[1]: Starting Journal Service... machine # [ 2.056144] systemd[1]: Starting Load Kernel Modules... machine # [ 2.057149] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.065429] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.072526] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.077203] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.081136] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.084642] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.089446] systemd-journald[88]: Collecting audit messages is disabled. machine # [ 2.092041] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.114073] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.116475] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.118283] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.120917] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.122721] systemd[1]: Finished Load Kernel Modules. machine # [ 2.125594] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.131920] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.133414] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.134742] systemd[1]: Reached target Local File Systems. machine # [ 2.137071] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.139219] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.140340] systemd[1]: Started Journal Service. machine # [ 1.986427] systemd-modules-load[89]: Using 4 probe threads machine # [ 1.988499] systemd-modules-load[89]: Inserted module 'virtio_balloon' machine # [ 1.989557] systemd-modules-load[89]: Inserted module 'virtio_gpu' machine # [ 1.990565] systemd-modules-load[89]: Inserted module 'dm_mod' machine # [ 1.994358] systemd[1]: Starting Create System Files and Directories... machine # [ 2.002598] systemd[1]: Finished Create System Files and Directories. machine # [ 2.010551] systemd-udevd[102]: Using default interface naming scheme 'v261'. machine # [ 2.020677] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.024319] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.025413] systemd[1]: Reached target System Initialization. machine # [ 2.026300] systemd[1]: Reached target Basic System. machine # [ 2.274533] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.274855] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.275394] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.280552] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.282831] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.283065] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.284263] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.287165] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.287241] SCSI subsystem initialized machine # [ 2.287502] usb usb1: Product: UHCI Host Controller machine # [ 2.289703] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.290608] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.291648] hub 1-0:1.0: USB hub found machine # [ 2.292557] hub 1-0:1.0: 2 ports detected machine # [ 2.313430] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.314268] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.315636] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.323846] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.325030] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.326169] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.327707] usb usb2: Product: EHCI Host Controller machine # [ 2.328630] usb usb2: Manufacturer: Linux 6.18.53 ehci_hcd machine # [ 2.329539] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.330960] hub 2-0:1.0: USB hub found machine # [ 2.331580] hub 2-0:1.0: 6 ports detected machine # [ 2.180101] systemd[1]: Starting Virtual Console Setup... machine # [ 2.353985] hub 1-0:1.0: USB hub found machine # [ 2.354635] hub 1-0:1.0: 2 ports detected machine # [ 2.355550] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.359765] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.361171] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.363139] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.209639] systemd-vconsole-setup[139]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.367177] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.368041] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.368944] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.370133] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.219473] systemd[1]: Finished Virtual Console Setup. machine # [ 2.375167] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.376559] usb usb3: Product: UHCI Host Controller machine # [ 2.377909] usb usb3: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.379006] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.380273] hub 3-0:1.0: USB hub found machine # [ 2.381170] hub 3-0:1.0: 2 ports detected machine # [ 2.385348] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.386323] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.234617] (udev-worker)[133]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.237341] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line.[ 2.392466] uhci_hcd 0000:00:1d.2: detected 2 ports machine # machine # [ 2.239665] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.241340] systemd[1]: Reached target Initrd Root Device. machine # [ 2.396314] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.243927] (udev-worker)[125]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.397763] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.247280] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.400830] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.400875] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.402277] usb usb4: Product: UHCI Host Controller machine # [ 2.405073] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.406014] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.407384] hub 4-0:1.0: USB hub found machine # [ 2.408105] hub 4-0:1.0: 2 ports detected machine # [ 2.409217] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.410560] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.410568] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.416854] scsi host0: ahci machine # [ 2.420494] scsi host1: ahci machine # [ 2.421617] scsi host2: ahci machine # [ 2.424379] scsi host3: ahci machine # [ 2.425612] scsi host4: ahci machine # [ 2.272768] systemd-fsck[154]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.427844] scsi host5: ahci machine # [ 2.428539] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.430296] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.278549] systemd[1]: Finished File System Check on /dev/di[ 2.432207] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # sk/by-label/nixos. machine # [ 2.434770] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.436710] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.438153] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.573981] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.705421] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.708624] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.711505] usb 2-1: Product: QEMU USB Tablet machine # [ 2.713215] usb 2-1: Manufacturer: QEMU machine # [ 2.714714] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.752008] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.758067] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.760459] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.762884] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.765483] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.767705] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.769858] ata3.00: applying bridge limits machine # [ 2.771702] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.774045] ata3.00: configured for UDMA/100 machine # [ 2.776081] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.778999] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.811862] usbcore: registered new interface driver usbhid machine # [ 2.813952] usbhid: USB HID core driver machine # [ 2.825006] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.829139] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.854358] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.888201] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.916165] systemd[1]: Mounting /sysroot... machine # [ 3.221725] EXT4-fs (vda): mounted filesystem ca7af2b9-8b3e-4b87-b52d-967d3aec1073 r/w with ordered data mode. Quota mode: none. machine # [ 3.073216] systemd[1]: Mounted /sysroot. machine # [ 3.075257] systemd[1]: Reached target Initrd Root File System. machine # [ 3.079541] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.081488] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.084794] systemd[1]: Mounting /sysroot/run... machine # [ 3.094104] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.097341] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.103384] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.105437] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.107194] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.108698] systemd[1]: Mounted /sysroot/run. machine # [ 3.113123] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.122885] systemd-sysroot-fstab-check[189]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.125596] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.127454] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.129167] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.130495] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.131806] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.133080] systemd[1]: Reload requested from client PID 189 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.135092] systemd[1]: Reloading... machine # [ 3.188829] systemd[1]: Reloading finished in 57 ms. machine # [ 3.212477] systemd-sysroot-fstab-check[189]: Requesting initrd-fs.target/start/replace... machine # [ 3.216406] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.221236] systemd-sysroot-fstab-check[189]: Requesting swap.target/start/replace... machine # [ 3.224851] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.227269] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.229522] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.232106] systemd[1]: Reached target Initrd File Systems. machine # [ 3.234132] systemd[1]: Starting Find NixOS closure... machine # [ 3.236061] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.256954] systemd[1]: Finished Find NixOS closure. machine # [ 3.260542] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.263105] systemd[1]: Reached target Initrd Default Target. machine # [ 3.265111] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.285885] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.287931] systemd[1]: Stopped target Basic System. machine # [ 3.289650] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.291476] systemd[1]: Stopped target Path Units. machine # [ 3.293165] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.296075] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.298767] systemd[1]: Stopped target Slice Units. machine # [ 3.300763] systemd[1]: Stopped target Socket Units. machine # [ 3.302436] systemd[1]: Stopped target System Initialization. machine # [ 3.304657] systemd[1]: Stopped target Swaps. machine # [ 3.306100] systemd[1]: Stopped target Timer Units. machine # [ 3.307772] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.310941] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.313180] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.315640] systemd[1]: Stopped Find NixOS closure. machine # [ 3.317400] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.319316] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.321407] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.322867] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.324686] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.326029] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.328055] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.330027] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.331861] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.333413] systemd[1]: Stopped target Local File Systems. machine # [ 3.334810] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.336495] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.338297] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.339711] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.341372] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.342369] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.343116] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.344052] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 3.344934] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.345905] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.346720] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 3.347715] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 3.348848] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 3.349833] systemd[1]: Closed udev Control Socket. machine # [ 3.350533] systemd[1]: Starting Cleanup udev Database... machine # [ 3.351254] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 3.352272] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 3.353154] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 3.354266] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 3.355232] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 3.356172] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 3.357321] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 3.358373] systemd[1]: Finished Cleanup udev Database. machine # [ 3.359139] systemd[1]: Reached target Switch Root. machine # [ 3.360202] systemd[1]: Starting NixOS Activation... machine # [ 3.476031] initrd-nixos-activation-start[236]: booting system configuration /nix/store/4749mn6ia08gjs2wdq36i4pcn4nw63nn-nixos-system-machine-test machine # [ 3.533092] initrd-nixos-activation-start[236]: running activation script... machine # [ 3.847090] initrd-nixos-activation-start[260]: setting up /etc... machine # [ 3.994692] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 3.997910] systemd[1]: Finished NixOS Activation. machine # [ 4.002291] systemd[1]: Starting Switch Root... machine # [ 4.034749] systemd[1]: Switching root. machine # [ 4.255949] systemd-journald[88]: Received SIGTERM from PID 1 (systemd). machine # [ 4.393518] NET: Registered PF_VSOCK protocol family machine # [ 4.780831] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 4.791022] systemd[1]: Detected virtualization kvm. machine # [ 4.792855] systemd[1]: Detected architecture x86-64. machine # [ 4.794855] systemd[1]: Detected first boot. machine # [ 4.799687] systemd[1]: Initializing machine ID from random generator. machine # [ 4.945833] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.036140] systemd[1]: Applying preset policy. machine # [ 5.307595] systemd[1]: Populated /etc with preset unit settings. machine # [ 5.618149] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 5.619811] systemd[1]: Stopped initrd-switch-root.service. machine # [ 5.622347] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 5.624640] systemd[1]: Created slice Slice /system/getty. machine # [ 5.626136] systemd[1]: Created slice User and Session Slice. machine # [ 5.627071] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 5.628385] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 5.629552] systemd[1]: Expecting device /dev/hvc0... machine # [ 5.630365] systemd[1]: Expecting device /dev/ttyS0... machine # [ 5.631199] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 5.632071] systemd[1]: Stopped target initrd-fs.target. machine # [ 5.632899] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 5.633799] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 5.634725] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 5.635898] systemd[1]: Reached target Path Units. machine # [ 5.636695] systemd[1]: Reached target Remote File Systems. machine # [ 5.637637] systemd[1]: Reached target Slice Units. machine # [ 5.638464] systemd[1]: Reached target Swaps. machine # [ 5.640908] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 5.644036] systemd[1]: Listening on Process Core Dump Socket. machine # [ 5.646265] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 5.648579] systemd[1]: Listening on Factory Reset Management. machine # [ 5.649560] systemd[1]: Listening on Hostname Service Socket. machine # [ 5.656057] systemd[1]: Starting Journal Log Access Socket... machine # [ 5.659175] systemd[1]: Listening on Journal Audit Socket. machine # [ 5.664073] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 5.666977] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 5.669922] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 5.673371] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 5.683629] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 5.686395] systemd[1]: Listening on udev Control Socket. machine # [ 5.688738] systemd[1]: Listening on udev Varlink Socket. machine # [ 5.694589] systemd[1]: Mounting Huge Pages File System... machine # [ 5.698968] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 5.710214] systemd[1]: Mounting Kernel Debug File System... machine # [ 5.715532] systemd[1]: Mounting Kernel Trace File System... machine # [ 5.723212] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 5.730186] systemd[1]: Starting Load Kernel Module configfs... machine # [ 5.731174] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 5.732710] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 5.734441] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 5.737939] systemd[1]: Mounting FUSE Control File System... machine # [ 5.738900] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 5.745330] systemd[1]: Starting Journal Service... machine # [ 5.748706] systemd[1]: Starting Load Kernel Modules... machine # [ 5.755042] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 5.757635] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 5.758709] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 5.761507] systemd[1]: Starting Coldplug All udev Devices... machine # [ 5.764378] systemd[1]: Listening on Journal Log Access Socket. machine # [ 5.765522] systemd[1]: Mounted Huge Pages File System. machine # [ 5.767596] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 5.768789] systemd[1]: Mounted Kernel Debug File System. machine # [ 5.769937] systemd[1]: Mounted Kernel Trace File System. machine # [ 5.774626] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 5.778439] systemd[1]: Mounted FUSE Control File System. machine # [ 5.783311] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 5.793890] systemd-journald[330]: Collecting audit messages is enabled. machine # [ 5.795050] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 5.796192] EXT4-fs (vda): re-mounted ca7af2b9-8b3e-4b87-b52d-967d3aec1073. machine # [ 5.796825] systemd[1]: Finished Load Kernel Module configfs. machine # [ 5.800696] loop: module loaded machine # [ 5.800959] systemd[1]: Mounting Kernel Configuration File System... machine # [ 5.659219] systemd[1]: Queued start job for default target Multi-User System. machine # [ 5.812899] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 5.660599] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 5.815940] systemd[1]: Started Journal Service. machine # [ 5.662376] systemd-modules-load[331]: Using 2 probe threads machine # [ 5.664049] systemd-modules-load[331]: Inserted module 'loop' machine # [ 5.665625] systemd[1]: Finished Load Kernel Modules. machine # [ 5.666784] systemd-oomd[332]: No swap; memory pressure usage will be degraded machine # [ 5.672358] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 5.674411] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 5.676698] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 5.677843] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 5.679493] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 5.680979] systemd[1]: Starting Apply Kernel Variables... machine # [ 5.682088] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 5.683496] systemd[1]: Mounted Kernel Configuration File System. machine # [ 5.696857] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 5.699683] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 5.859930] systemd-journald[330]: Received client request to flush runtime journal. machine # [ 5.769208] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 5.770659] systemd[1]: Finished Apply Kernel Variables. machine # [ 5.771802] systemd[1]: Reached target First Boot Complete. machine # [ 5.772781] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 5.773820] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 5.774901] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 5.776146] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 5.782182] systemd-udevd[359]: Using default interface naming scheme 'v261'. machine # [ 5.799310] systemd[1]: Finished Coldplug All udev Devices. machine # [ 5.822643] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 5.904438] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 5.927661] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 5.944316] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 5.949193] (udev-worker)[368]: Network interface NamePolicy= disabled on kernel command line. machine # [ 5.950770] (udev-worker)[370]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 5.953203] (udev-worker)[370]: Network interface NamePolicy= disabled on kernel command line. machine # [ 5.982757] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 5.984206] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 5.986088] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 5.988705] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 5.990290] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 5.991910] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.156421] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.160577] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 machine # [ 6.170936] Console: switching to colour dummy device 80x25 machine # [ 6.173031] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.173522] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.174679] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.175931] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.176657] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.180948] mousedev: PS/2 mouse device common for all mice machine # [ 6.182271] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4 machine # [ 6.196211] Console: switching to colour frame buffer device 160x50 machine # [ 6.198522] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.207324] ACPI: button: Power Button [PWRF] machine # [ 6.228109] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.241106] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.241997] rtc_cmos PNP0B00:00: setting system clock to 2026-10-05T09:46:52 UTC (1791193612) machine # [ 6.243242] systemd-journald[330]: Time jumped backwards, rotating. machine # [ 6.245073] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.247252] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.251089] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.252159] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.252514] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.259550] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.261882] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.177581] systemd[1]: Starting Virtual Console Setup... machine # [ 6.185557] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.187058] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.189127] systemd[1]: Starting Virtual Console Setup... machine # [ 6.358848] ppdev: user-space parallel port driver machine # [ 6.365252] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.366638] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.384853] kvm_amd: TSC scaling supported machine # [ 6.385390] kvm_amd: Nested Virtualization enabled machine # [ 6.386016] kvm_amd: Nested Paging enabled machine # [ 6.386482] kvm_amd: LBR virtualization supported machine # [ 6.387027] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 6.387585] kvm_amd: Virtual GIF supported machine # [ 6.388061] kvm_amd: Virtual NMI enabled machine # [ 6.463013] EDAC MC: Ver: 3.0.0 machine # [ 6.372626] systemd-vconsole-setup[403]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 6.377520] systemd[1]: Finished Virtual Console Setup. machine # [ 6.470282] systemd[1]: Mounting /run/wrappers... machine # [ 6.504303] systemd[1]: Mounted /run/wrappers. machine # [ 6.506442] systemd[1]: Reached target Local File Systems. machine # [ 6.509203] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 6.512402] systemd[1]: Starting register-nix-paths.service... machine # [ 6.515356] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 6.517341] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 6.520781] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 6.524641] systemd[1]: Starting Create System Files and Directories... machine # [ 6.604967] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 6.609803] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 6.617845] systemd[1]: Finished Create System Files and Directories. machine # [ 6.620772] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 6.622875] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 6.650937] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 6.666171] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 6.667936] systemd[1]: Starting Update is Completed... machine # [ 6.693214] systemd[1]: Finished Update is Completed. machine # [ 6.885515] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 6.886839] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.088278] systemd[1]: Finished register-nix-paths.service. machine # [ 7.090292] systemd[1]: Reached target System Initialization. machine # [ 7.092198] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.094425] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.096291] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.098369] systemd[1]: Reached target Timer Units. machine # [ 7.099979] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.105682] systemd[1]: Listening on niks3 server socket. machine # [ 7.107881] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.109786] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.112674] systemd[1]: Reached target Socket Units. machine # [ 7.114483] systemd[1]: Reached target Basic System. machine # [ 7.116322] systemd[1]: Started backdoor.service. machine # [ 7.119254] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.122535] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.125186] systemd[1]: Starting Post-Boot Actions... machine # [ 7.129266] systemd[1]: Started Reset console on configuration changes. machine # [ 7.131568] systemd[1]: Starting resolvconf update... machine # [ 7.135616] systemd[1]: Started rustfs.service. machine # [ 7.139129] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.141297] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.163911] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.201295] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.201773] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.202798] nsncd[488]: Oct 05 09:46:53.611 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.204436] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.205211] systemd[1]: Starting User Login Management... machine # [ 7.232247] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 7.88 seconds) machine: (finished: waiting for the VM to finish booting, in 8.15 seconds) machine # [ 7.258639] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.267794] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' machine # [ 7.269030] dbus-broker-launch[495]: Invalid user-name in /nix/store/bcd7zqqxh9dkf34jz3fznsnn45xd36vp-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.272682] systemd-logind[518]: New seat seat0. machine # [ 7.277926] systemd-logind[518]: Watching system buttons on /dev/input/event3 (Power Button) machine # [ 7.280709] systemd-logind[518]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) machine # [ 7.281051] systemd-logind[518]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.281573] systemd[1]: Started User Login Management. machine # [ 7.282138] systemd[1]: Starting linger-users.service... machine # [ 7.293466] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.308464] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.309149] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.309484] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.310500] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.311427] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.316334] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.316875] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.321751] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.325921] dbus-broker-launch[495]: Ready machine # [ 7.330561] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.330893] systemd[1]: Finished linger-users.service. machine # [ 7.363124] nsncd[589]: Oct 05 09:46:53.773 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.363562] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.364181] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.364704] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.390362] systemd[1]: Finished resolvconf update. machine # [ 7.391575] systemd[1]: Reached target Preparation for Network. machine # [ 7.395217] systemd[1]: Starting DHCP Client... machine # [ 7.398332] systemd[1]: Starting Address configuration of eth1... machine # [ 7.399802] systemd[1]: Starting Extra networking commands.... machine # [ 7.454653] network-addresses-eth1-start[623]: adding address 192.168.1.1/24... done machine # [ 7.469143] network-addresses-eth1-start[623]: adding address 2001:db8:1::1/64... done machine # [ 7.483505] systemd[1]: Finished Address configuration of eth1. machine # [ 7.491892] dhcpcd[635]: dhcpcd-10.3.2 starting machine # [ 7.497154] dhcpcd[689]: dev: loaded udev machine # [ 7.663601] 8021q: 802.1Q VLAN Support v1.8 machine # [ 7.664894] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 7.515729] systemd[1]: Finished Extra networking commands.. machine # [ 7.517295] systemd[1]: Reached target Network. machine # [ 7.521050] systemd[1]: Starting PostgreSQL Server... machine # [ 7.523439] systemd[1]: Starting Permit User Sessions... machine # [ 7.530399] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 7.548942] systemd[1]: Finished Permit User Sessions. machine # [ 7.551804] systemd[1]: Started Getty on tty1. machine # [ 7.552440] systemd[1]: Reached target Login Prompts. machine # [ 7.760970] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 7.783431] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 7.784900] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 7.786808] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 7.788155] cfg80211: failed to load regulatory.db machine # [ 7.666266] postgresql-pre-start[709]: The files belonging to this database system will be owned by user "postgres". machine # [ 7.667149] postgresql-pre-start[709]: This user must also own the server process. machine # [ 7.668203] postgresql-pre-start[709]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 7.668660] postgresql-pre-start[709]: The default database encoding has accordingly been set to "UTF8". machine # [ 7.669241] postgresql-pre-start[709]: The default text search configuration will be set to "english". machine # [ 7.669827] postgresql-pre-start[709]: Data page checksums are enabled. machine # [ 7.670649] postgresql-pre-start[709]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 7.670972] postgresql-pre-start[709]: creating subdirectories ... ok machine # [ 7.671754] postgresql-pre-start[709]: selecting dynamic shared memory implementation ... posix machine # [ 7.834971] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 7.683023] dhcpcd[689]: eth0: waiting for carrier machine # [ 7.752600] postgresql-pre-start[709]: selecting default "max_connections" ... 100 machine # [ 7.814607] postgresql-pre-start[709]: selecting default "shared_buffers" ... 128MB machine # [ 8.492580] dhcpcd[689]: eth0: carrier acquired machine # [ 8.502202] dhcpcd[689]: DUID 00:01:00:01:32:56:2e:8e:52:54:00:12:34:56 machine # [ 8.502452] dhcpcd[689]: eth0: IAID 00:12:34:56 machine # [ 8.503391] dhcpcd[689]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.588183] postgresql-pre-start[709]: selecting default time zone ... UTC machine # [ 8.590960] postgresql-pre-start[709]: creating configuration files ... ok machine # [ 8.778222] postgresql-pre-start[709]: running bootstrap script ... ok machine # [ 9.227744] postgresql-pre-start[709]: performing post-bootstrap initialization ... ok machine # [ 9.381373] postgresql-pre-start[709]: syncing data to disk ... ok machine # [ 9.381844] postgresql-pre-start[709]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.382728] postgresql-pre-start[709]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.383643] postgresql-pre-start[709]: Success. You can now start the database server using: machine # [ 9.384524] postgresql-pre-start[709]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 9.504488] postgres[749]: [749] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 9.508426] postgres[749]: [749] LOG: listening on IPv6 address "::1", port 5432 machine # [ 9.509484] postgres[749]: [749] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 9.511269] postgres[749]: [749] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 9.525574] postgres[764]: [764] LOG: database system was shut down at 2026-10-05 09:46:55 GMT machine # [ 9.534451] postgres[749]: [749] LOG: database system is ready to accept connections machine # [ 9.539773] systemd[1]: Started PostgreSQL Server. machine # [ 9.543544] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 9.791637] postgresql-setup-start[775]: CREATE DATABASE machine # [ 9.840472] postgresql-setup-start[780]: CREATE ROLE machine # [ 9.864990] postgresql-setup-start[782]: ALTER DATABASE machine # [ 9.870595] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 9.871864] systemd[1]: Reached target PostgreSQL. machine # [ 10.250950] dhcpcd[689]: eth0: soliciting a DHCP lease machine # [ 10.425139] NET: Registered PF_PACKET protocol family machine # [ 10.285255] dhcpcd[689]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 10.291956] dhcpcd[689]: eth0: probing address 10.0.2.15/24 machine # [ 11.136268] dhcpcd[689]: eth0: soliciting an IPv6 router machine # [ 11.138460] dhcpcd[689]: eth0: Router Advertisement from fe80::2 machine # [ 11.139181] dhcpcd[689]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 11.140436] dhcpcd[689]: eth0: adding route to fec0::/64 machine # [ 11.142217] dhcpcd[689]: eth0: adding default route via fe80::2 machine # [ 15.235429] dhcpcd[689]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 15.235768] dhcpcd[689]: eth0: adding route to 10.0.2.0/24 machine # [ 15.237335] dhcpcd[689]: eth0: adding default route via 10.0.2.2 machine # [ 15.374878] systemd[1]: Started DHCP Client. machine # [ 15.376826] systemd[1]: Reached target Network is Online. machine # [ 15.380362] systemd[1]: Starting k3s service... machine # [ 15.440588] k3s[893]: time="2026-10-05T09:47:01Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 15.441568] k3s[893]: time="2026-10-05T09:47:01Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709" machine # [ 17.073427] rustfs-bucket-start[908]: mb s3://farm machine # [ 17.079224] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.945971] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)" machine # [ 17.955815] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.956640] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.957494] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.968786] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.969715] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.971694] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.974481] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.975616] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.978583] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.979904] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:04.391234499 +0000 UTC notAfter=2036-10-02 08:47:04.391234499 +0000 UTC" machine # [ 17.980868] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.981670] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.982625] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.983478] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.984294] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.985414] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.986288] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1791193624: notBefore=2026-10-05 08:47:04.39766269 +0000 UTC notAfter=2036-10-02 08:47:04.39766269 +0000 UTC" machine # [ 17.987224] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.988152] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.988867] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.989535] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1791193624: notBefore=2026-10-05 08:47:04.400966741 +0000 UTC notAfter=2036-10-02 08:47:04.400966741 +0000 UTC" machine # [ 17.989988] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.990658] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1791193624: notBefore=2026-10-05 08:47:04.401678284 +0000 UTC notAfter=2036-10-02 08:47:04.401678284 +0000 UTC" machine # [ 17.991542] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.992076] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1791193624: notBefore=2026-10-05 08:47:04.402357979 +0000 UTC notAfter=2036-10-02 08:47:04.402357979 +0000 UTC" machine # [ 17.992575] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 17.993051] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 18.072962] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1791193624: notBefore=2026-10-05 08:47:04 +0000 UTC notAfter=2027-10-05 08:47:04 +0000 UTC" machine # [ 18.073255] k3s[893]: time="2026-10-05T09:47:04Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 18.086331] k3s[893]: time="2026-10-05T09:47:04Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__1112_f746_3e6e_ac9d-d129a1:fec0::1112:f746:3e6e:ac9d listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=4A57A71364B48D8354009E4313D11C21EEE020EA]" machine # [ 19.017420] k3s[893]: time="2026-10-05T09:47:05Z" level=info msg="Password verified locally for node machine" machine # [ 19.021119] k3s[893]: time="2026-10-05T09:47:05Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1791193624: notBefore=2026-10-05 08:47:05 +0000 UTC notAfter=2027-10-05 08:47:05 +0000 UTC" machine # [ 19.278599] k3s[893]: time="2026-10-05T09:47:05Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:05 +0000 UTC notAfter=2027-10-05 08:47:05 +0000 UTC" machine # [ 19.386538] k3s[893]: time="2026-10-05T09:47:05Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:05 +0000 UTC notAfter=2027-10-05 08:47:05 +0000 UTC" machine # [ 19.472707] k3s[893]: time="2026-10-05T09:47:05Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1791193624: notBefore=2026-10-05 08:47:05 +0000 UTC notAfter=2027-10-05 08:47:05 +0000 UTC" machine # [ 19.556674] k3s[893]: time="2026-10-05T09:47:05Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:48412: runtime core not ready" machine # [ 19.667452] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Module overlay was already loaded" machine # [ 19.926014] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.930580] Bridge firewalling registered machine # [ 19.790517] k3s[893]: time="2026-10-05T09:47:06Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.797508] k3s[893]: time="2026-10-05T09:47:06Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.807925] k3s[893]: time="2026-10-05T09:47:06Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.874970] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.875821] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.877451] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.879327] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.881282] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.883208] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.885218] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.887248] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.889200] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Connection to etcd is ready" machine # [ 19.890774] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="ETCD server is now running" machine # [ 19.892177] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.893947] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.894790] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.944693] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.945568] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.946089] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.946754] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.948135] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.948837] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.950180] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Run: k3s kubectl" machine # [ 19.950622] k3s[893]: I1005 09:47:06.299778 893 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.951165] k3s[893]: I1005 09:47:06.302369 893 server.go:158] Version: v1.36.4+k3s1 machine # [ 19.951666] k3s[893]: I1005 09:47:06.302402 893 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.952165] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.952464] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.953051] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.954759] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.955428] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.955933] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 20.007688] k3s[893]: time="2026-10-05T09:47:06Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:48446: runtime core not ready" machine # [ 20.074224] k3s[893]: I1005 09:47:06.484858 893 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 20.076049] k3s[893]: E1005 09:47:06.485462 893 options.go:205] The manifest file is empty, ignoring. machine # [ 20.077907] k3s[893]: I1005 09:47:06.489633 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 20.081246] k3s[893]: I1005 09:47:06.492961 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 20.083026] k3s[893]: I1005 09:47:06.494732 893 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 20.083310] k3s[893]: I1005 09:47:06.494764 893 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 20.083531] k3s[893]: I1005 09:47:06.495101 893 instance.go:240] Using reconciler: lease machine # [ 20.090581] k3s[893]: I1005 09:47:06.502283 893 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 20.091242] k3s[893]: W1005 09:47:06.502313 893 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 20.095574] k3s[893]: I1005 09:47:06.507297 893 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 20.128885] k3s[893]: I1005 09:47:06.539841 893 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 20.129167] k3s[893]: I1005 09:47:06.540067 893 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 20.132222] k3s[893]: time="2026-10-05T09:47:06Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 20.169236] k3s[893]: I1005 09:47:06.579494 893 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 20.219463] k3s[893]: I1005 09:47:06.631116 893 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 20.219748] k3s[893]: W1005 09:47:06.631175 893 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 20.220176] k3s[893]: W1005 09:47:06.631190 893 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 20.220523] k3s[893]: I1005 09:47:06.631625 893 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 20.221229] k3s[893]: W1005 09:47:06.631650 893 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.221569] k3s[893]: I1005 09:47:06.632375 893 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 20.222093] k3s[893]: I1005 09:47:06.633050 893 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 20.222581] k3s[893]: I1005 09:47:06.634100 893 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 20.223139] k3s[893]: W1005 09:47:06.634121 893 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 20.224238] k3s[893]: I1005 09:47:06.634919 893 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 20.224882] k3s[893]: W1005 09:47:06.634938 893 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 20.225617] k3s[893]: W1005 09:47:06.634950 893 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 20.226094] k3s[893]: I1005 09:47:06.635386 893 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 20.226603] k3s[893]: W1005 09:47:06.635405 893 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 20.227190] k3s[893]: W1005 09:47:06.635416 893 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 20.227528] k3s[893]: I1005 09:47:06.635923 893 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 20.228025] k3s[893]: W1005 09:47:06.635939 893 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 20.228738] k3s[893]: I1005 09:47:06.637452 893 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 20.229219] k3s[893]: W1005 09:47:06.637472 893 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 20.229675] k3s[893]: I1005 09:47:06.637856 893 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 20.230206] k3s[893]: W1005 09:47:06.637872 893 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 20.230756] k3s[893]: W1005 09:47:06.637883 893 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 20.231393] k3s[893]: I1005 09:47:06.638361 893 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 20.231915] k3s[893]: W1005 09:47:06.638377 893 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 20.232606] k3s[893]: I1005 09:47:06.639477 893 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 20.233112] k3s[893]: W1005 09:47:06.639495 893 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 20.233631] k3s[893]: W1005 09:47:06.639507 893 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 20.234149] k3s[893]: I1005 09:47:06.639955 893 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 20.234484] k3s[893]: W1005 09:47:06.639973 893 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 20.234966] k3s[893]: W1005 09:47:06.639983 893 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 20.235709] k3s[893]: I1005 09:47:06.641671 893 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 20.236237] k3s[893]: W1005 09:47:06.641695 893 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 20.236742] k3s[893]: W1005 09:47:06.641707 893 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 20.237399] k3s[893]: I1005 09:47:06.642500 893 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 20.237902] k3s[893]: W1005 09:47:06.642525 893 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 20.238590] k3s[893]: W1005 09:47:06.642546 893 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 20.239486] k3s[893]: W1005 09:47:06.642559 893 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 20.240047] k3s[893]: I1005 09:47:06.645327 893 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 20.240548] k3s[893]: W1005 09:47:06.645350 893 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 20.241089] k3s[893]: W1005 09:47:06.645362 893 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 20.241626] k3s[893]: I1005 09:47:06.647575 893 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 20.242096] k3s[893]: W1005 09:47:06.647601 893 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.242600] k3s[893]: W1005 09:47:06.647614 893 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 20.243104] k3s[893]: I1005 09:47:06.648102 893 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 20.243601] k3s[893]: W1005 09:47:06.648118 893 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 20.244486] k3s[893]: I1005 09:47:06.649732 893 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 20.246222] k3s[893]: W1005 09:47:06.649751 893 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 20.287028] k3s[893]: W1005 09:47:06.649763 893 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 20.287604] k3s[893]: W1005 09:47:06.649773 893 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 20.288159] k3s[893]: I1005 09:47:06.654775 893 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 20.288634] k3s[893]: W1005 09:47:06.654825 893 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.650793] k3s[893]: I1005 09:47:07.062391 893 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.651153] k3s[893]: I1005 09:47:07.062541 893 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.651647] k3s[893]: I1005 09:47:07.062413 893 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.657445] k3s[893]: I1005 09:47:07.069131 893 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 20.658189] k3s[893]: I1005 09:47:07.069900 893 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 20.658610] k3s[893]: I1005 09:47:07.069978 893 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.662077] k3s[893]: I1005 09:47:07.071045 893 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.662377] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.662540] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.663097] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.663620] k3s[893]: I1005 09:47:07.073074 893 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.664185] k3s[893]: I1005 09:47:07.073103 893 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.664725] k3s[893]: I1005 09:47:07.073372 893 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 20.665381] k3s[893]: I1005 09:47:07.073391 893 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.665594] k3s[893]: I1005 09:47:07.073454 893 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.666122] k3s[893]: I1005 09:47:07.073503 893 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.666635] k3s[893]: I1005 09:47:07.073604 893 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.667155] k3s[893]: I1005 09:47:07.073687 893 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.667645] k3s[893]: I1005 09:47:07.073709 893 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.668235] k3s[893]: I1005 09:47:07.074134 893 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 20.668689] k3s[893]: I1005 09:47:07.074360 893 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.669186] k3s[893]: I1005 09:47:07.074378 893 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.669714] k3s[893]: I1005 09:47:07.075056 893 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 20.689134] k3s[893]: I1005 09:47:07.098833 893 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.689593] k3s[893]: I1005 09:47:07.099487 893 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.690039] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.690770] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 20.691448] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.691979] k3s[893]: I1005 09:47:07.099836 893 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.692685] k3s[893]: I1005 09:47:07.099969 893 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.693222] k3s[893]: I1005 09:47:07.100112 893 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.693790] k3s[893]: I1005 09:47:07.100138 893 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.697153] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.697876] k3s[893]: I1005 09:47:07.102978 893 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.698552] k3s[893]: I1005 09:47:07.103817 893 controller.go:142] Starting OpenAPI controller machine # [ 20.699122] k3s[893]: I1005 09:47:07.103887 893 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.699606] k3s[893]: I1005 09:47:07.103920 893 naming_controller.go:305] Starting NamingConditionController machine # [ 20.700122] k3s[893]: I1005 09:47:07.104065 893 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.700639] k3s[893]: I1005 09:47:07.104097 893 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.701170] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 20.763452] k3s[893]: I1005 09:47:07.173865 893 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.763714] k3s[893]: I1005 09:47:07.173916 893 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.764679] k3s[893]: I1005 09:47:07.173865 893 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.765242] k3s[893]: I1005 09:47:07.173941 893 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.765567] k3s[893]: I1005 09:47:07.173999 893 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 20.766089] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.766574] k3s[893]: I1005 09:47:07.174220 893 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.767100] k3s[893]: I1005 09:47:07.174484 893 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.774584] k3s[893]: I1005 09:47:07.186295 893 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 20.778858] k3s[893]: I1005 09:47:07.190587 893 shared_informer.go:409] "Caches are synced" machine # [ 20.779471] k3s[893]: I1005 09:47:07.190629 893 policy_source.go:248] refreshing policies machine # [ 20.781393] k3s[893]: I1005 09:47:07.193100 893 shared_informer.go:409] "Caches are synced" machine # [ 20.781689] k3s[893]: I1005 09:47:07.193182 893 policy_source.go:248] refreshing policies machine # [ 20.787297] k3s[893]: E1005 09:47:07.199006 893 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 20.789470] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.790884] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.792193] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 20.793814] k3s[893]: I1005 09:47:07.200213 893 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 20.795395] k3s[893]: I1005 09:47:07.200281 893 aggregator.go:187] initial CRD sync complete... machine # [ 20.796695] k3s[893]: I1005 09:47:07.200296 893 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.798175] k3s[893]: I1005 09:47:07.200310 893 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.799719] k3s[893]: I1005 09:47:07.200323 893 cache.go:39] Caches are synced for autoregister controller machine # [ 20.801176] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.802457] k3s[893]: I1005 09:47:07.207572 893 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.804113] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 20.805814] k3s[893]: I1005 09:47:07.216368 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.817710] k3s[893]: E1005 09:47:07.229379 893 controller.go:95] Unable to perform initial Kubernetes service initialization: namespaces "default" not found machine # [ 20.919180] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="containerd is now running" machine # [ 20.937079] k3s[893]: time="2026-10-05T09:47:07Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/3hnnljh5f21n70j9hhvddmmanbqwxn7l-nix-grpc-farm.tar" machine # [ 20.992892] k3s[893]: I1005 09:47:07.404547 893 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 21.670960] k3s[893]: I1005 09:47:08.082259 893 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.675686] k3s[893]: I1005 09:47:08.087408 893 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.678091] k3s[893]: I1005 09:47:08.087429 893 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 21.885686] k3s[893]: time="2026-10-05T09:47:08Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 22.590797] k3s[893]: I1005 09:47:09.002455 893 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.638518] k3s[893]: I1005 09:47:09.050204 893 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 22.728028] k3s[893]: I1005 09:47:09.138906 893 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 22.731689] k3s[893]: W1005 09:47:09.143406 893 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 22.733279] k3s[893]: I1005 09:47:09.145026 893 controller.go:667] quota admission added evaluator for: endpoints machine # [ 22.737851] k3s[893]: I1005 09:47:09.149585 893 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 23.885945] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Waiting for untainted node" machine # [ 23.887565] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.888946] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Kube API server is now running" machine # [ 23.890177] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="k3s is up and running" machine # [ 23.891796] systemd[1]: Started k3s service. machine # [ 23.892526] systemd[1]: Starting niks3 server... machine # [ 23.898064] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.904628] k3s[893]: E1005 09:47:10.316312 893 options.go:205] The manifest file is empty, ignoring. machine # [ 23.906878] k3s[893]: I1005 09:47:10.316639 893 controllermanager.go:204] "Starting" version="v1.36.4+k3s1" machine # [ 23.908739] k3s[893]: I1005 09:47:10.316659 893 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.910351] k3s[893]: I1005 09:47:10.320012 893 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.911982] k3s[893]: I1005 09:47:10.320137 893 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 23.913442] k3s[893]: I1005 09:47:10.320117 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.914719] k3s[893]: I1005 09:47:10.320275 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.916869] k3s[893]: I1005 09:47:10.320292 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.918292] k3s[893]: I1005 09:47:10.320323 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.920623] k3s[893]: I1005 09:47:10.320338 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.921943] k3s[893]: I1005 09:47:10.320565 893 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.925202] k3s[893]: I1005 09:47:10.320644 893 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.926815] k3s[893]: I1005 09:47:10.326638 893 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 23.927121] k3s[893]: I1005 09:47:10.326659 893 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 23.929261] k3s[893]: I1005 09:47:10.340975 893 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.932854] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.943743] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.948794] k3s[893]: I1005 09:47:10.360484 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 23.951300] k3s[893]: I1005 09:47:10.363040 893 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # [ 23.956116] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.958621] k3s[893]: I1005 09:47:10.370363 893 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.964977] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.978629] k3s[893]: I1005 09:47:10.390357 893 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 24.011577] k3s[893]: I1005 09:47:10.423239 893 shared_informer.go:409] "Caches are synced" machine # [ 24.013954] k3s[893]: I1005 09:47:10.424658 893 shared_informer.go:409] "Caches are synced" machine # [ 24.015778] k3s[893]: I1005 09:47:10.424723 893 shared_informer.go:409] "Caches are synced" machine # [ 24.018541] k3s[893]: I1005 09:47:10.430262 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 24.036895] k3s[893]: I1005 09:47:10.448483 893 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.050266] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.065514] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.065877] k3s[893]: time="2026-10-05T09:47:10Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.085910] k3s[893]: W1005 09:47:10.497611 893 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 24.097945] k3s[893]: I1005 09:47:10.509660 893 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 24.119603] k3s[893]: I1005 09:47:10.531209 893 shared_informer.go:409] "Caches are synced" machine: (finished: waiting for unit k3s.service, in 25.07 seconds) machine: waiting for success: kubectl get ns farm machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.591631] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.591893] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 24.595314] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 24.597533] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.597979] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.600606] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.602473] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.603000] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.603834] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.772132] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::1112:f746:3e6e:ac9d 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.772378] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 25.075292] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__1112_f746_3e6e_ac9d-d129a1:fec0::1112:f746:3e6e:ac9d listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=4A57A71364B48D8354009E4313D11C21EEE020EA]" machine # [ 25.090806] k3s[893]: time="2026-10-05T09:47:11Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=239) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__1112_f746_3e6e_ac9d-d129a1:fec0::1112:f746:3e6e:ac9d listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=4A57A71364B48D8354009E4313D11C21EEE020EA]" machine # [ 25.471696] k3s[893]: I1005 09:47:11.883368 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 25.471941] k3s[893]: I1005 09:47:11.883407 893 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.650275] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0" machine # [ 25.654116] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:eb15c3b2d6270297fcf72020be80e93b538d6087e674f05559db197cc6ad0072" machine # [ 25.979551] k3s[893]: I1005 09:47:12.391160 893 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 25.983675] k3s[893]: I1005 09:47:12.395265 893 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 25.987502] k3s[893]: I1005 09:47:12.395349 893 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 26.081636] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 26.082115] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Creating deploy event broadcaster" machine # [ 26.086420] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/3hnnljh5f21n70j9hhvddmmanbqwxn7l-nix-grpc-farm.tar in 5.149414799s" machine # [ 26.088260] k3s[893]: I1005 09:47:12.498488 893 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 26.089280] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/4v14fxahlxhgjlfn1jf5zd1cj1prhvgs-nix-grpc-farm-client.tar" machine # [ 26.094396] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 26.112026] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 26.113932] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 26.117240] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.126068] k3s[893]: time="2026-10-05T09:47:12Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 26.520451] k3s[893]: I1005 09:47:12.932092 893 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 26.675478] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 26.690647] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # Error from server (NotFound): namespaces "farm" not found machine # [ 26.976695] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 26.989074] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 27.055097] k3s[893]: I1005 09:47:13.466626 893 serving.go:417] Generated self-signed cert in-memory machine # [ 27.116691] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.125122] k3s[893]: I1005 09:47:13.536775 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 27.130646] k3s[893]: I1005 09:47:13.536854 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 27.135063] k3s[893]: I1005 09:47:13.536887 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 27.138155] k3s[893]: I1005 09:47:13.536912 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 27.141559] k3s[893]: I1005 09:47:13.536953 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 27.144113] k3s[893]: I1005 09:47:13.536998 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 27.146471] k3s[893]: I1005 09:47:13.537029 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 27.148891] k3s[893]: I1005 09:47:13.537064 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 27.151644] k3s[893]: I1005 09:47:13.537092 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 27.154041] k3s[893]: I1005 09:47:13.537119 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 27.156673] k3s[893]: I1005 09:47:13.537170 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 27.159147] k3s[893]: I1005 09:47:13.537214 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 27.161402] k3s[893]: I1005 09:47:13.537243 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 27.163962] k3s[893]: I1005 09:47:13.537267 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 27.166369] k3s[893]: I1005 09:47:13.537322 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 27.168556] k3s[893]: I1005 09:47:13.537352 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 27.171586] k3s[893]: I1005 09:47:13.537388 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 27.174137] k3s[893]: I1005 09:47:13.537417 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 27.176423] k3s[893]: I1005 09:47:13.537443 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 27.178844] k3s[893]: I1005 09:47:13.537472 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 27.181350] k3s[893]: I1005 09:47:13.537508 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 27.183953] k3s[893]: I1005 09:47:13.537551 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 27.186700] k3s[893]: I1005 09:47:13.537577 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 27.189152] k3s[893]: I1005 09:47:13.537605 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 27.191720] k3s[893]: I1005 09:47:13.563033 893 serving.go:417] Generated self-signed cert in-memory machine # [ 27.223406] k3s[893]: I1005 09:47:13.635086 893 controllermanager.go:163] Version: v1.36.4+k3s1 machine # [ 27.229155] k3s[893]: I1005 09:47:13.638118 893 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 27.229356] k3s[893]: I1005 09:47:13.638124 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 27.229875] k3s[893]: I1005 09:47:13.638158 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.230819] k3s[893]: I1005 09:47:13.638159 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.231691] k3s[893]: I1005 09:47:13.638214 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 27.232574] k3s[893]: I1005 09:47:13.638276 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.233431] k3s[893]: I1005 09:47:13.638702 893 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 27.234166] k3s[893]: I1005 09:47:13.639478 893 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 27.234926] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 27.327132] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 27.331163] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 27.331838] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 27.332455] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 27.336105] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 27.338883] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 27.339215] k3s[893]: time="2026-10-05T09:47:13Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 27.427113] k3s[893]: I1005 09:47:13.838240 893 shared_informer.go:409] "Caches are synced" machine # [ 27.427389] k3s[893]: I1005 09:47:13.838379 893 shared_informer.go:409] "Caches are synced" machine # [ 27.427502] k3s[893]: I1005 09:47:13.838609 893 shared_informer.go:409] "Caches are synced" machine # [ 27.622730] k3s[893]: I1005 09:47:14.034132 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 27.623034] k3s[893]: I1005 09:47:14.034172 893 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 27.631809] k3s[893]: time="2026-10-05T09:47:14Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 27.637792] k3s[893]: time="2026-10-05T09:47:14Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 27.644711] k3s[893]: time="2026-10-05T09:47:14Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 27.649887] k3s[893]: W1005 09:47:14.061598 893 controllermanager.go:315] "node-route-controller" is disabled machine # [ 27.650253] k3s[893]: time="2026-10-05T09:47:14Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 27.653629] k3s[893]: I1005 09:47:14.064878 893 controllermanager.go:338] Started "cloud-node-controller" machine # [ 27.653938] k3s[893]: I1005 09:47:14.065026 893 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 27.654632] k3s[893]: I1005 09:47:14.065155 893 node_controller.go:179] Sending events to api server. machine # [ 27.655152] k3s[893]: I1005 09:47:14.065239 893 node_lifecycle_controller.go:112] Sending events to api server machine # [ 27.655650] k3s[893]: I1005 09:47:14.065302 893 node_controller.go:188] Waiting for informer caches to sync machine # [ 27.660271] k3s[893]: I1005 09:47:14.071906 893 controllermanager.go:338] Started "service-lb-controller" machine # [ 27.662228] k3s[893]: I1005 09:47:14.073867 893 controller.go:235] Starting service controller machine # [ 27.662353] k3s[893]: I1005 09:47:14.073904 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 27.862367] k3s[893]: I1005 09:47:14.274022 893 shared_informer.go:409] "Caches are synced" machine: (finished: waiting for success: kubectl get ns farm, in 3.72 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 27.983771] k3s[893]: I1005 09:47:14.395344 893 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 28.060983] k3s[893]: I1005 09:47:14.472340 893 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 28.063784] k3s[893]: time="2026-10-05T09:47:14Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 28.117217] k3s[893]: time="2026-10-05T09:47:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.171382] k3s[893]: I1005 09:47:14.582886 893 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.19 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 28.320326] k3s[893]: I1005 09:47:14.731920 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 28.323873] k3s[893]: I1005 09:47:14.731960 893 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 28.326444] k3s[893]: I1005 09:47:14.731975 893 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 28.328834] k3s[893]: I1005 09:47:14.731989 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 28.331902] k3s[893]: I1005 09:47:14.732000 893 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.18 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.621421] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 28.625524] k3s[893]: I1005 09:47:15.034904 893 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.627157] k3s[893]: I1005 09:47:15.034934 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.629237] k3s[893]: I1005 09:47:15.040958 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.630784] k3s[893]: I1005 09:47:15.041027 893 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 28.632569] k3s[893]: I1005 09:47:15.041043 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.634026] k3s[893]: I1005 09:47:15.041082 893 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.635658] k3s[893]: I1005 09:47:15.041096 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.637113] k3s[893]: I1005 09:47:15.041135 893 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 28.639077] k3s[893]: I1005 09:47:15.041333 893 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 28.640571] k3s[893]: I1005 09:47:15.041347 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.641982] k3s[893]: I1005 09:47:15.041379 893 disruption.go:453] "Sending events to api server." machine # [ 28.643415] k3s[893]: I1005 09:47:15.041417 893 disruption.go:460] "Starting disruption controller" machine # [ 28.644861] k3s[893]: I1005 09:47:15.041428 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.646289] k3s[893]: I1005 09:47:15.041535 893 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 28.647920] k3s[893]: I1005 09:47:15.041550 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.649298] k3s[893]: I1005 09:47:15.041598 893 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.651042] k3s[893]: I1005 09:47:15.041612 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.652432] k3s[893]: I1005 09:47:15.041694 893 controller.go:753] "Starting resource claim controller" machine # [ 28.653887] k3s[893]: I1005 09:47:15.041707 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.655280] k3s[893]: I1005 09:47:15.041742 893 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.657261] k3s[893]: I1005 09:47:15.041756 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.658665] k3s[893]: I1005 09:47:15.041817 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.659990] k3s[893]: I1005 09:47:15.041891 893 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 28.661719] k3s[893]: I1005 09:47:15.041905 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.663091] k3s[893]: I1005 09:47:15.041949 893 gc_controller.go:98] "Starting GC controller" machine # [ 28.664398] k3s[893]: I1005 09:47:15.041962 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.665825] k3s[893]: I1005 09:47:15.042035 893 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 28.667527] k3s[893]: I1005 09:47:15.042048 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.668919] k3s[893]: I1005 09:47:15.042082 893 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.670227] k3s[893]: I1005 09:47:15.042094 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.671547] k3s[893]: I1005 09:47:15.042138 893 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.672948] k3s[893]: I1005 09:47:15.042155 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.674321] k3s[893]: I1005 09:47:15.042190 893 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.675873] k3s[893]: I1005 09:47:15.042244 893 taint_eviction.go:288] "Sending events to API server" machine # [ 28.677279] k3s[893]: I1005 09:47:15.042256 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.678677] k3s[893]: I1005 09:47:15.042335 893 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 28.680196] k3s[893]: I1005 09:47:15.042349 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.681756] k3s[893]: I1005 09:47:15.042382 893 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.681894] k3s[893]: I1005 09:47:15.042396 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.682582] k3s[893]: I1005 09:47:15.042428 893 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.683144] k3s[893]: I1005 09:47:15.042485 893 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.683649] k3s[893]: I1005 09:47:15.042501 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.684273] k3s[893]: I1005 09:47:15.042605 893 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.684972] k3s[893]: I1005 09:47:15.042621 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.685698] k3s[893]: I1005 09:47:15.042691 893 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 28.686197] k3s[893]: I1005 09:47:15.042718 893 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 28.686721] k3s[893]: I1005 09:47:15.042729 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.687416] k3s[893]: I1005 09:47:15.042846 893 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.687953] k3s[893]: I1005 09:47:15.042861 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.688472] k3s[893]: I1005 09:47:15.042904 893 horizontal.go:204] "Starting HPA controller" machine # [ 28.689101] k3s[893]: I1005 09:47:15.042917 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.689634] k3s[893]: I1005 09:47:15.042974 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.690174] k3s[893]: I1005 09:47:15.042989 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.690711] k3s[893]: I1005 09:47:15.043019 893 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.691410] k3s[893]: I1005 09:47:15.043034 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.692034] k3s[893]: I1005 09:47:15.043078 893 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.692725] k3s[893]: I1005 09:47:15.043093 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.693447] k3s[893]: I1005 09:47:15.043182 893 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.693990] k3s[893]: I1005 09:47:15.043196 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.694668] k3s[893]: I1005 09:47:15.043267 893 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 28.695228] k3s[893]: I1005 09:47:15.043282 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.695811] k3s[893]: I1005 09:47:15.043520 893 job_controller.go:336] "Starting job controller" machine # [ 28.696539] k3s[893]: I1005 09:47:15.043544 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.697527] k3s[893]: I1005 09:47:15.043626 893 stateful_set.go:234] "Starting stateful set controller" machine # [ 28.698139] k3s[893]: I1005 09:47:15.043641 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.698675] k3s[893]: I1005 09:47:15.043671 893 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.698859] k3s[893]: I1005 09:47:15.043685 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.699631] k3s[893]: I1005 09:47:15.043721 893 expand_controller.go:328] "Starting expand controller" machine # [ 28.700414] k3s[893]: I1005 09:47:15.043734 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.700966] k3s[893]: I1005 09:47:15.043962 893 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 28.701769] k3s[893]: I1005 09:47:15.043976 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.702647] k3s[893]: I1005 09:47:15.044045 893 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.703189] k3s[893]: I1005 09:47:15.044059 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.703679] k3s[893]: I1005 09:47:15.044127 893 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 28.704038] k3s[893]: I1005 09:47:15.044140 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.704622] k3s[893]: I1005 09:47:15.044209 893 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 28.705774] k3s[893]: I1005 09:47:15.044221 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.706451] k3s[893]: I1005 09:47:15.044772 893 device_taint_eviction.go:823] "Sending events to api server" machine # [ 28.706849] k3s[893]: I1005 09:47:15.044910 893 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 28.707479] k3s[893]: I1005 09:47:15.045103 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.708079] k3s[893]: I1005 09:47:15.045118 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.708674] k3s[893]: I1005 09:47:15.045154 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.709395] k3s[893]: I1005 09:47:15.045170 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.709974] k3s[893]: I1005 09:47:15.045212 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.710646] k3s[893]: I1005 09:47:15.045225 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.711137] k3s[893]: I1005 09:47:15.045263 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.711626] k3s[893]: I1005 09:47:15.045404 893 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.712475] k3s[893]: I1005 09:47:15.045420 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.713048] k3s[893]: I1005 09:47:15.045607 893 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.713581] k3s[893]: I1005 09:47:15.045663 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.714152] k3s[893]: I1005 09:47:15.046315 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.714713] k3s[893]: I1005 09:47:15.046390 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.715427] k3s[893]: I1005 09:47:15.046458 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.716724] k3s[893]: I1005 09:47:15.046710 893 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.717867] k3s[893]: I1005 09:47:15.046867 893 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 28.719210] k3s[893]: I1005 09:47:15.070266 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.720722] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 28.731671] k3s[893]: I1005 09:47:15.143371 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.993452] k3s[893]: I1005 09:47:15.405068 893 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 28.995812] k3s[893]: I1005 09:47:15.407214 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 28.996469] k3s[893]: I1005 09:47:15.407579 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.997650] k3s[893]: I1005 09:47:15.408883 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 28.998360] k3s[893]: I1005 09:47:15.409502 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 29.003902] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 29.009873] k3s[893]: I1005 09:47:15.421589 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 29.010567] k3s[893]: I1005 09:47:15.421920 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 29.011090] k3s[893]: I1005 09:47:15.422049 893 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 29.021075] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 29.025781] k3s[893]: I1005 09:47:15.437476 893 shared_informer.go:409] "Caches are synced" machine # [ 29.029316] k3s[893]: I1005 09:47:15.441033 893 shared_informer.go:409] "Caches are synced" machine # [ 29.029661] k3s[893]: I1005 09:47:15.441103 893 shared_informer.go:409] "Caches are synced" machine # [ 29.032065] k3s[893]: I1005 09:47:15.443657 893 shared_informer.go:409] "Caches are synced" machine # [ 29.032696] k3s[893]: I1005 09:47:15.443727 893 shared_informer.go:409] "Caches are synced" machine # [ 29.033238] k3s[893]: I1005 09:47:15.443777 893 shared_informer.go:409] "Caches are synced" machine # [ 29.036860] k3s[893]: I1005 09:47:15.448143 893 shared_informer.go:409] "Caches are synced" machine # [ 29.037157] k3s[893]: I1005 09:47:15.448188 893 shared_informer.go:409] "Caches are synced" machine # [ 29.037687] k3s[893]: I1005 09:47:15.448246 893 shared_informer.go:409] "Caches are synced" machine # [ 29.038220] k3s[893]: I1005 09:47:15.448282 893 shared_informer.go:409] "Caches are synced" machine # [ 29.038767] k3s[893]: I1005 09:47:15.448423 893 shared_informer.go:409] "Caches are synced" machine # [ 29.039884] k3s[893]: I1005 09:47:15.448461 893 shared_informer.go:409] "Caches are synced" machine # [ 29.040752] k3s[893]: I1005 09:47:15.448600 893 shared_informer.go:409] "Caches are synced" machine # [ 29.045179] k3s[893]: I1005 09:47:15.456900 893 shared_informer.go:409] "Caches are synced" machine # [ 29.045686] k3s[893]: I1005 09:47:15.456956 893 shared_informer.go:409] "Caches are synced" machine # [ 29.047825] k3s[893]: I1005 09:47:15.459547 893 shared_informer.go:409] "Caches are synced" machine # [ 29.048474] k3s[893]: I1005 09:47:15.459618 893 shared_informer.go:409] "Caches are synced" machine # [ 29.049450] k3s[893]: I1005 09:47:15.460893 893 shared_informer.go:409] "Caches are synced" machine # [ 29.049917] k3s[893]: I1005 09:47:15.460952 893 shared_informer.go:409] "Caches are synced" machine # [ 29.050642] k3s[893]: I1005 09:47:15.461003 893 shared_informer.go:409] "Caches are synced" machine # [ 29.052031] k3s[893]: I1005 09:47:15.461054 893 shared_informer.go:409] "Caches are synced" machine # [ 29.052674] k3s[893]: I1005 09:47:15.461093 893 shared_informer.go:409] "Caches are synced" machine # [ 29.053206] k3s[893]: I1005 09:47:15.461167 893 shared_informer.go:409] "Caches are synced" machine # [ 29.053762] k3s[893]: I1005 09:47:15.461197 893 shared_informer.go:409] "Caches are synced" machine # [ 29.055523] k3s[893]: I1005 09:47:15.461243 893 range_allocator.go:177] "Sending events to api server" machine # [ 29.057026] k3s[893]: I1005 09:47:15.461275 893 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 29.057912] k3s[893]: I1005 09:47:15.461285 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 29.058602] k3s[893]: I1005 09:47:15.461297 893 shared_informer.go:409] "Caches are synced" machine # [ 29.061110] k3s[893]: I1005 09:47:15.461362 893 shared_informer.go:409] "Caches are synced" machine # [ 29.061833] k3s[893]: I1005 09:47:15.461453 893 shared_informer.go:409] "Caches are synced" machine # [ 29.062535] k3s[893]: I1005 09:47:15.461573 893 shared_informer.go:409] "Caches are synced" machine # [ 29.063079] k3s[893]: I1005 09:47:15.461617 893 shared_informer.go:409] "Caches are synced" machine # [ 29.063607] k3s[893]: I1005 09:47:15.461660 893 shared_informer.go:409] "Caches are synced" machine # [ 29.064408] k3s[893]: I1005 09:47:15.461690 893 shared_informer.go:409] "Caches are synced" machine # [ 29.065166] k3s[893]: I1005 09:47:15.462102 893 shared_informer.go:409] "Caches are synced" machine # [ 29.065711] k3s[893]: I1005 09:47:15.462149 893 shared_informer.go:409] "Caches are synced" machine # [ 29.067113] k3s[893]: I1005 09:47:15.462258 893 shared_informer.go:409] "Caches are synced" machine # [ 29.067698] k3s[893]: I1005 09:47:15.462421 893 shared_informer.go:409] "Caches are synced" machine # [ 29.068220] k3s[893]: I1005 09:47:15.462468 893 shared_informer.go:409] "Caches are synced" machine # [ 29.068781] k3s[893]: I1005 09:47:15.462510 893 shared_informer.go:409] "Caches are synced" machine # [ 29.070445] k3s[893]: I1005 09:47:15.462719 893 shared_informer.go:409] "Caches are synced" machine # [ 29.070970] k3s[893]: I1005 09:47:15.462762 893 shared_informer.go:409] "Caches are synced" machine # [ 29.071485] k3s[893]: I1005 09:47:15.462825 893 shared_informer.go:409] "Caches are synced" machine # [ 29.072056] k3s[893]: I1005 09:47:15.462862 893 shared_informer.go:409] "Caches are synced" machine # [ 29.072636] k3s[893]: I1005 09:47:15.462912 893 shared_informer.go:409] "Caches are synced" machine # [ 29.073561] k3s[893]: I1005 09:47:15.470373 893 shared_informer.go:409] "Caches are synced" machine # [ 29.090133] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 29.115988] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 29.117403] k3s[893]: I1005 09:47:15.528770 893 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 29.172931] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 29.193873] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 29.206201] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 29.381407] k3s[893]: I1005 09:47:15.791823 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.384256] k3s[893]: I1005 09:47:15.795930 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 29.433562] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 29.574513] k3s[893]: I1005 09:47:15.986188 893 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 29.578124] k3s[893]: time="2026-10-05T09:47:15Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 29.648335] k3s[893]: time="2026-10-05T09:47:16Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.032425] k3s[893]: I1005 09:47:16.444039 893 shared_informer.go:409] "Caches are synced" machine # [ 30.035072] k3s[893]: I1005 09:47:16.446482 893 shared_informer.go:409] "Caches are synced" machine # [ 30.035227] k3s[893]: I1005 09:47:16.446564 893 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 30.035775] k3s[893]: I1005 09:47:16.446576 893 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 30.116714] k3s[893]: time="2026-10-05T09:47:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.706563] niks3-server[1198]: 2026/10/05 09:47:17 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.706868] niks3-server[1198]: 2026/10/05 09:47:17 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.708218] niks3-server[1198]: 2026/10/05 09:47:17 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.752074] niks3-server[1198]: 2026/10/05 09:47:17 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.752289] niks3-server[1198]: 2026/10/05 09:47:17 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.754486] systemd[1]: Started niks3 server. machine # [ 30.755144] niks3-server[1198]: 2026/10/05 09:47:17 INFO systemd watchdog enabled interval=15s machine # [ 30.755667] niks3-server[1198]: 2026/10/05 09:47:17 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.756197] systemd[1]: Reached target Multi-User System. machine # [ 30.756772] systemd[1]: Startup finished in 1.211s (kernel) + 2.981s (initrd) + 26.561s (userspace) = 30.754s. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.116626] k3s[893]: time="2026-10-05T09:47:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.119473] k3s[893]: time="2026-10-05T09:47:18Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.989823] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 32.990172] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 32.991752] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.992352] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 32.993314] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 32.993798] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Handling backend connection request [machine]" machine # [ 32.994530] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 32.995076] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 33.115178] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.141417] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0" machine # [ 33.145075] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:9c3dcc833a5ba1552c4cc4f19c1a2e6583b06db84654f9c6be1bb8a45f18e2bf" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.448932] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/4v14fxahlxhgjlfn1jf5zd1cj1prhvgs-nix-grpc-farm-client.tar in 7.362231791s" machine # [ 33.449391] k3s[893]: time="2026-10-05T09:47:19Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/djnarcp7bpn4whbzn22i5vvf30pdwipi-nix-grpc-farm-lb.tar" machine # [ 34.116560] k3s[893]: time="2026-10-05T09:47:20Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.117671] k3s[893]: time="2026-10-05T09:47:21Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 35.179796] k3s[893]: time="2026-10-05T09:47:21Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0" machine # [ 35.182666] k3s[893]: time="2026-10-05T09:47:21Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 35.241225] k3s[893]: time="2026-10-05T09:47:21Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/djnarcp7bpn4whbzn22i5vvf30pdwipi-nix-grpc-farm-lb.tar in 1.79186405s" machine # [ 35.245838] k3s[893]: time="2026-10-05T09:47:21Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst" machine # [ 35.441680] k3s[893]: time="2026-10-05T09:47:21Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::1112:f746:3e6e:ac9d --node-labels= --read-only-port=0" machine # [ 35.455177] k3s[893]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 35.475828] k3s[893]: I1005 09:47:21.887382 893 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1" machine # [ 35.478872] k3s[893]: I1005 09:47:21.887439 893 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.480084] k3s[893]: I1005 09:47:21.887503 893 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 35.481180] k3s[893]: I1005 09:47:21.887549 893 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 35.482426] k3s[893]: I1005 09:47:21.890607 893 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 35.488238] k3s[893]: I1005 09:47:21.899893 893 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 35.498071] k3s[893]: I1005 09:47:21.909671 893 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 35.499063] k3s[893]: I1005 09:47:21.909740 893 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 35.505329] k3s[893]: I1005 09:47:21.916985 893 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 35.506390] k3s[893]: I1005 09:47:21.917063 893 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 35.508183] k3s[893]: I1005 09:47:21.917478 893 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 35.509182] k3s[893]: I1005 09:47:21.917509 893 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 35.510141] k3s[893]: I1005 09:47:21.917683 893 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 35.511267] k3s[893]: I1005 09:47:21.922961 893 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 35.511976] k3s[893]: I1005 09:47:21.923571 893 kubelet.go:485] "Attempting to sync node with API server" machine # [ 35.512648] k3s[893]: I1005 09:47:21.923611 893 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 35.513454] k3s[893]: I1005 09:47:21.923673 893 kubelet.go:397] "Adding apiserver pod source" machine # [ 35.517093] k3s[893]: I1005 09:47:21.923716 893 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 35.517854] k3s[893]: I1005 09:47:21.928051 893 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 35.518630] k3s[893]: I1005 09:47:21.930382 893 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 35.519563] k3s[893]: I1005 09:47:21.931245 893 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 35.525833] k3s[893]: I1005 09:47:21.937541 893 server.go:1280] "Started kubelet" machine # [ 35.526878] k3s[893]: I1005 09:47:21.938249 893 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 35.528204] k3s[893]: I1005 09:47:21.939867 893 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 35.528968] k3s[893]: I1005 09:47:21.939945 893 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 35.529785] k3s[893]: I1005 09:47:21.940117 893 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 35.530672] k3s[893]: I1005 09:47:21.940985 893 server.go:354] "Adding debug handlers to kubelet server" machine # [ 35.531666] k3s[893]: I1005 09:47:21.943253 893 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 35.532724] k3s[893]: I1005 09:47:21.944355 893 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 35.533690] k3s[893]: I1005 09:47:21.944605 893 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 35.536719] k3s[893]: E1005 09:47:21.948436 893 kubelet.go:1725] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 35.538250] k3s[893]: I1005 09:47:21.949956 893 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 35.539063] k3s[893]: I1005 09:47:21.950643 893 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 35.539564] k3s[893]: I1005 09:47:21.950943 893 reconciler.go:29] "Reconciler: start to sync state" machine # [ 35.540523] k3s[893]: I1005 09:47:21.952268 893 factory.go:222] Registration of the systemd container factory successfully machine # [ 35.541046] k3s[893]: I1005 09:47:21.952400 893 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 35.542451] k3s[893]: E1005 09:47:21.954184 893 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 35.544340] k3s[893]: I1005 09:47:21.955989 893 factory.go:222] Registration of the containerd container factory successfully machine # [ 35.564941] k3s[893]: E1005 09:47:21.976633 893 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 35.571451] k3s[893]: E1005 09:47:21.983130 893 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 35.585358] k3s[893]: I1005 09:47:21.996988 893 cpu_manager.go:235] "Starting" policy="none" machine # [ 35.587033] k3s[893]: I1005 09:47:21.997146 893 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 35.587317] k3s[893]: I1005 09:47:21.997172 893 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 35.591904] k3s[893]: I1005 09:47:22.003653 893 policy_none.go:50] "Start" machine # [ 35.592317] k3s[893]: I1005 09:47:22.004060 893 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 35.593069] k3s[893]: I1005 09:47:22.004653 893 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 35.598587] k3s[893]: I1005 09:47:22.010282 893 policy_none.go:44] "Start" machine # [ 35.603842] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 35.616109] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 35.619657] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 35.621844] k3s[893]: I1005 09:47:22.033564 893 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 35.626061] k3s[893]: I1005 09:47:22.037756 893 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 35.627924] k3s[893]: I1005 09:47:22.037825 893 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 35.629529] k3s[893]: I1005 09:47:22.037870 893 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 35.631036] k3s[893]: E1005 09:47:22.037915 893 kubelet.go:2646] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" machine # [ 35.633842] k3s[893]: E1005 09:47:22.043151 893 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 35.635947] k3s[893]: I1005 09:47:22.043294 893 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 35.637415] k3s[893]: I1005 09:47:22.043312 893 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 35.639273] k3s[893]: I1005 09:47:22.043756 893 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 35.640780] k3s[893]: E1005 09:47:22.051173 893 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 35.643427] k3s[893]: E1005 09:47:22.051216 893 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 35.665530] k3s[893]: E1005 09:47:22.077224 893 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 35.733926] k3s[893]: I1005 09:47:22.145520 893 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 35.740144] k3s[893]: I1005 09:47:22.151881 893 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 35.742064] k3s[893]: E1005 09:47:22.152240 893 kubelet_node_status.go:479] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 35.743973] k3s[893]: time="2026-10-05T09:47:22Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 35.746028] k3s[893]: I1005 09:47:22.157733 893 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.746517] k3s[893]: I1005 09:47:22.157812 893 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.747024] k3s[893]: I1005 09:47:22.157781 893 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 35.753614] k3s[893]: E1005 09:47:22.157834 893 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.756549] k3s[893]: I1005 09:47:22.168272 893 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.758069] k3s[893]: I1005 09:47:22.168323 893 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 35.758428] k3s[893]: E1005 09:47:22.168342 893 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 35.764369] k3s[893]: time="2026-10-05T09:47:22Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 35.765245] k3s[893]: time="2026-10-05T09:47:22Z" level=info msg="Starting flannel with backend vxlan" machine # [ 35.767524] k3s[893]: I1005 09:47:22.178849 893 node_controller.go:432] Initializing node machine with cloud provider machine # [ 35.771915] k3s[893]: time="2026-10-05T09:47:22Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 35.776296] k3s[893]: I1005 09:47:22.187991 893 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 35.778408] k3s[893]: I1005 09:47:22.190127 893 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 35.780618] k3s[893]: I1005 09:47:22.192336 893 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 35.795705] k3s[893]: time="2026-10-05T09:47:22Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 35.798974] k3s[893]: time="2026-10-05T09:47:22Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 35.799586] k3s[893]: I1005 09:47:22.211298 893 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 35.801165] k3s[893]: I1005 09:47:22.211335 893 kube.go:537] Starting kube subnet manager machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.866090] k3s[893]: I1005 09:47:22.277387 893 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 35.866304] k3s[893]: I1005 09:47:22.277519 893 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 35.871521] k3s[893]: E1005 09:47:22.283061 893 options.go:205] The manifest file is empty, ignoring. machine # [ 35.879856] k3s[893]: I1005 09:47:22.291499 893 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1" machine # [ 35.881537] k3s[893]: I1005 09:47:22.291532 893 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 35.883613] k3s[893]: I1005 09:47:22.295292 893 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 35.884229] k3s[893]: I1005 09:47:22.295311 893 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 35.884942] k3s[893]: I1005 09:47:22.295338 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.885700] k3s[893]: I1005 09:47:22.295418 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 35.886268] k3s[893]: I1005 09:47:22.295439 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.886766] k3s[893]: I1005 09:47:22.295440 893 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 35.887662] k3s[893]: I1005 09:47:22.295477 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 35.888193] k3s[893]: I1005 09:47:22.295496 893 shared_informer.go:402] "Waiting for caches to sync" machine # [ 35.897853] k3s[893]: I1005 09:47:22.295601 893 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 35.905728] k3s[893]: I1005 09:47:22.317271 893 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 35.912560] k3s[893]: I1005 09:47:22.324276 893 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 35.984165] k3s[893]: I1005 09:47:22.395662 893 shared_informer.go:409] "Caches are synced" machine # [ 35.984383] k3s[893]: I1005 09:47:22.395743 893 shared_informer.go:409] "Caches are synced" machine # [ 35.998097] k3s[893]: I1005 09:47:22.409730 893 shared_informer.go:409] "Caches are synced" machine # [ 36.119227] k3s[893]: time="2026-10-05T09:47:22Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 36.121153] k3s[893]: I1005 09:47:22.531773 893 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::1112:f746:3e6e:ac9d"] machine # [ 36.123065] k3s[893]: E1005 09:47:22.534175 893 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 36.156065] k3s[893]: I1005 09:47:22.565917 893 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 36.157907] k3s[893]: I1005 09:47:22.565969 893 server_linux.go:137] "Using iptables Proxier" machine # [ 36.178677] k3s[893]: I1005 09:47:22.590365 893 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 36.191326] k3s[893]: I1005 09:47:22.602968 893 server.go:539] "Version info" version="v1.36.4+k3s1" machine # [ 36.193346] k3s[893]: I1005 09:47:22.603009 893 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 36.195211] k3s[893]: I1005 09:47:22.605234 893 config.go:200] "Starting service config controller" machine # [ 36.196595] k3s[893]: I1005 09:47:22.605253 893 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 36.198197] k3s[893]: I1005 09:47:22.605296 893 config.go:106] "Starting endpoint slice config controller" machine # [ 36.199630] k3s[893]: I1005 09:47:22.605312 893 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 36.201345] k3s[893]: I1005 09:47:22.605347 893 config.go:403] "Starting serviceCIDR config controller" machine # [ 36.202857] k3s[893]: I1005 09:47:22.605360 893 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 36.204669] k3s[893]: I1005 09:47:22.607931 893 config.go:309] "Starting node config controller" machine # [ 36.206064] k3s[893]: I1005 09:47:22.607972 893 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 36.207763] k3s[893]: I1005 09:47:22.607988 893 shared_informer.go:388] "Caches are synced" controller="node config" machine # [ 36.513978] k3s[893]: I1005 09:47:22.925627 893 apiserver.go:51] "Watching apiserver" machine # [ 36.801814] k3s[893]: I1005 09:47:23.213283 893 kube.go:163] Node controller sync successful machine # [ 36.802644] k3s[893]: I1005 09:47:23.213418 893 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 36.807901] k3s[893]: I1005 09:47:23.219506 893 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::1112:f746:3e6e:ac9d", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::1112:f746:3e6e:ac9d", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 36.854232] (udev-worker)[1342]: Network interface NamePolicy= disabled on kernel command line. machine # [ 36.868070] k3s[893]: I1005 09:47:23.279712 893 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 36.870654] k3s[893]: I1005 09:47:23.282337 893 iptables.go:50] Starting flannel in iptables mode... machine # [ 36.871171] k3s[893]: time="2026-10-05T09:47:23Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 36.872408] k3s[893]: time="2026-10-05T09:47:23Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 36.873620] k3s[893]: time="2026-10-05T09:47:23Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 36.874589] k3s[893]: time="2026-10-05T09:47:23Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 36.878889] k3s[893]: I1005 09:47:23.282456 893 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 36.896545] systemd[1]: Created slice libcontainer container kubepods-burstable-pod9b1876a0_2383_4291_80a3_d9721fe860ea.slice. machine # [ 36.900101] k3s[893]: I1005 09:47:23.311776 893 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 36.904021] k3s[893]: I1005 09:47:23.311873 893 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 36.906270] k3s[893]: time="2026-10-05T09:47:23Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 36.907847] k3s[893]: I1005 09:47:23.313781 893 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # [ 36.919476] dhcpcd[689]: flannel.1: IAID 68:5e:e6:d1 machine # [ 36.920444] dhcpcd[689]: flannel.1: adding address fe80::c89f:68ff:fe5e:e6d1 machine # [ 36.925129] systemd[1]: Created slice libcontainer container kubepods-burstable-podecdf7794_e337_4c33_92eb_27d372196aad.slice. machine # [ 36.951096] k3s[893]: I1005 09:47:23.362650 893 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 37.015833] k3s[893]: I1005 09:47:23.427493 893 iptables.go:111] Setting up masking rules machine # [ 37.034230] k3s[893]: I1005 09:47:23.445914 893 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 37.045798] k3s[893]: time="2026-10-05T09:47:23Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 37.046024] k3s[893]: time="2026-10-05T09:47:23Z" level=info msg="Running flannel backend" machine # [ 37.046555] k3s[893]: I1005 09:47:23.457505 893 vxlan_network.go:68] watching for new subnet leases machine # [ 37.047353] k3s[893]: I1005 09:47:23.457547 893 vxlan_network.go:115] starting vxlan device watcher machine # [ 37.048270] k3s[893]: I1005 09:47:23.458232 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hltq\" (UniqueName: \"kubernetes.io/projected/9b1876a0-2383-4291-80a3-d9721fe860ea-kube-api-access-8hltq\") pod \"coredns-54996dc9b4-5snx8\" (UID: \"9b1876a0-2383-4291-80a3-d9721fe860ea\") " pod="kube-system/coredns-54996dc9b4-5snx8" machine # [ 37.049308] k3s[893]: I1005 09:47:23.458378 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-helm\") pod \"helm-install-nix-grpc-farm-vc8hx\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " pod="kube-system/helm-install-nix-grpc-farm-vc8hx" machine # [ 37.050275] k3s[893]: I1005 09:47:23.458462 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-config\") pod \"helm-install-nix-grpc-farm-vc8hx\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " pod="kube-system/helm-install-nix-grpc-farm-vc8hx" machine # [ 37.050826] k3s[893]: I1005 09:47:23.458595 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-tmp\") pod \"helm-install-nix-grpc-farm-vc8hx\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " pod="kube-system/helm-install-nix-grpc-farm-vc8hx" machine # [ 37.051240] k3s[893]: I1005 09:47:23.458627 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-values\") pod \"helm-install-nix-grpc-farm-vc8hx\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " pod="kube-system/helm-install-nix-grpc-farm-vc8hx" machine # [ 37.051834] k3s[893]: I1005 09:47:23.458686 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/ecdf7794-e337-4c33-92eb-27d372196aad-content\") pod \"helm-install-nix-grpc-farm-vc8hx\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " pod="kube-system/helm-install-nix-grpc-farm-vc8hx" machine # [ 37.052595] k3s[893]: I1005 09:47:23.458764 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9b1876a0-2383-4291-80a3-d9721fe860ea-config-volume\") pod \"coredns-54996dc9b4-5snx8\" (UID: \"9b1876a0-2383-4291-80a3-d9721fe860ea\") " pod="kube-system/coredns-54996dc9b4-5snx8" machine # [ 37.053560] k3s[893]: I1005 09:47:23.458895 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-cache\") pod \"helm-install-nix-grpc-farm-vc8hx\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " pod="kube-system/helm-install-nix-grpc-farm-vc8hx" machine # [ 37.054587] k3s[893]: I1005 09:47:23.458946 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czt7p\" (UniqueName: \"kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-kube-api-access-czt7p\") pod \"helm-install-nix-grpc-farm-vc8hx\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " pod="kube-system/helm-install-nix-grpc-farm-vc8hx" machine # [ 37.055168] k3s[893]: I1005 09:47:23.458974 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b1876a0-2383-4291-80a3-d9721fe860ea-custom-config-volume\") pod \"coredns-54996dc9b4-5snx8\" (UID: \"9b1876a0-2383-4291-80a3-d9721fe860ea\") " pod="kube-system/coredns-54996dc9b4-5snx8" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.179376] k3s[893]: I1005 09:47:23.589886 893 iptables.go:358] bootstrap done machine # [ 37.247051] k3s[893]: I1005 09:47:23.658724 893 iptables.go:358] bootstrap done machine # [ 37.299371] (udev-worker)[1361]: Network interface NamePolicy= disabled on kernel command line. machine # [ 37.469435] cni0: port 1(vetha427d1bb) entered blocking state machine # [ 37.470287] cni0: port 1(vetha427d1bb) entered disabled state machine # [ 37.471040] vetha427d1bb: entered allmulticast mode machine # [ 37.471778] vetha427d1bb: entered promiscuous mode machine # [ 37.472754] cni0: port 2(veth7ca09287) entered blocking state machine # [ 37.473449] cni0: port 2(veth7ca09287) entered disabled state machine # [ 37.474446] veth7ca09287: entered allmulticast mode machine # [ 37.475215] veth7ca09287: entered promiscuous mode machine # [ 37.323946] (udev-worker)[1512]: Network interface NamePolicy= disabled on kernel command line. machine # [ 37.326374] (udev-worker)[1511]: Network interface NamePolicy= disabled on kernel command line. machine # [ 37.486960] cni0: port 2(veth7ca09287) entered blocking state machine # [ 37.487616] cni0: port 2(veth7ca09287) entered forwarding state machine # [ 37.490353] cni0: port 1(vetha427d1bb) entered blocking state machine # [ 37.491154] cni0: port 1(vetha427d1bb) entered forwarding state machine # [ 37.362485] dhcpcd[689]: vetha427d1bb: IAID 46:6d:b3:29 machine # [ 37.363597] dhcpcd[689]: vetha427d1bb: adding address fe80::b0b0:46ff:fe6d:b329 machine # [ 37.380405] dhcpcd[689]: veth7ca09287: IAID 9d:dc:22:80 machine # [ 37.380611] dhcpcd[689]: veth7ca09287: adding address fe80::2072:9dff:fedc:2280 machine # [ 37.426841] dhcpcd[689]: vetha427d1bb: soliciting a DHCP lease machine # [ 37.618279] cni0: port 1(vetha427d1bb) entered disabled state machine # [ 37.464798] dhcpcd[689]: vetha427d1bb: carrier lost machine # [ 37.620504] vetha427d1bb (unregistering): left allmulticast mode machine # [ 37.621324] vetha427d1bb (unregistering): left promiscuous mode machine # [ 37.622192] cni0: port 1(vetha427d1bb) entered disabled state machine # [ 37.630036] cni0: port 2(veth7ca09287) entered disabled state machine # [ 37.632026] veth7ca09287 (unregistering): left allmulticast mode machine # [ 37.632881] veth7ca09287 (unregistering): left promiscuous mode machine # [ 37.633668] cni0: port 2(veth7ca09287) entered disabled state machine # [ 37.502238] k3s[893]: E1005 09:47:23.913906 893 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 37.507875] k3s[893]: E1005 09:47:23.914127 893 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-5snx8" machine # [ 37.513866] k3s[893]: E1005 09:47:23.914161 893 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-5snx8" machine # [ 37.519715] k3s[893]: E1005 09:47:23.914278 893 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-54996dc9b4-5snx8_kube-system(9b1876a0-2383-4291-80a3-d9721fe860ea)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-54996dc9b4-5snx8_kube-system(9b1876a0-2383-4291-80a3-d9721fe860ea)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/coredns-54996dc9b4-5snx8" podUID="9b1876a0-2383-4291-80a3-d9721fe860ea" machine # [ 37.528911] dhcpcd[689]: vetha427d1bb: deleting address fe80::b0b0:46ff:fe6d:b329 machine # [ 37.533371] k3s[893]: E1005 09:47:23.945079 893 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 37.538978] k3s[893]: E1005 09:47:23.945164 893 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-vc8hx" machine # [ 37.544917] k3s[893]: E1005 09:47:23.945198 893 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-vc8hx" machine # [ 37.550872] k3s[893]: E1005 09:47:23.945307 893 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-vc8hx_kube-system(ecdf7794-e337-4c33-92eb-27d372196aad)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-vc8hx_kube-system(ecdf7794-e337-4c33-92eb-27d372196aad)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/helm-install-nix-grpc-farm-vc8hx" podUID="ecdf7794-e337-4c33-92eb-27d372196aad" machine # [ 37.571477] dhcpcd[689]: vetha427d1bb: removing interface machine # [ 37.588634] dhcpcd[689]: veth7ca09287: removing interface machine # [ 37.606161] dhcpcd[689]: veth7ca09287: deleting address fe80::2072:9dff:fedc:2280 machine # [ 37.888959] dhcpcd[689]: flannel.1: soliciting a DHCP lease machine # [ 37.990898] k3s[893]: time="2026-10-05T09:47:24Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 37.991274] k3s[893]: I1005 09:47:24.402660 893 network_policy_controller.go:164] Starting network policy controller machine # [ 38.267135] k3s[893]: I1005 09:47:24.677069 893 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.731192] dhcpcd[689]: flannel.1: soliciting an IPv6 router machine # [ 39.051813] k3s[893]: I1005 09:47:25.463305 893 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 39.052608] k3s[893]: I1005 09:47:25.463433 893 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 39.053328] k3s[893]: I1005 09:47:25.463578 893 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 39.171291] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 39.175268] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 39.175761] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 39.178666] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 39.179145] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 39.185716] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 39.186106] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 39.189982] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 39.190563] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 39.196093] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 39.196633] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 39.199991] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 39.202323] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 39.206590] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 39.206880] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 39.213283] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.451182] k3s[893]: time="2026-10-05T09:47:25Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 4.209351467s" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 42.890510] dhcpcd[689]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.874973] dhcpcd[689]: flannel.1: using IPv4LL address 169.254.46.232 machine # [ 47.877687] dhcpcd[689]: flannel.1: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.830164] cni0: port 1(vethc4a40715) entered blocking state machine # [ 48.831440] cni0: port 1(vethc4a40715) entered disabled state machine # [ 48.833055] vethc4a40715: entered allmulticast mode machine # [ 48.834924] vethc4a40715: entered promiscuous mode machine # [ 48.854510] cni0: port 1(vethc4a40715) entered blocking state machine # [ 48.855766] cni0: port 1(vethc4a40715) entered forwarding state machine # [ 48.759420] (udev-worker)[1997]: Network interface NamePolicy= disabled on kernel command line. machine # [ 48.780910] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2702459209.mount: Deactivated successfully. machine # [ 48.791976] dhcpcd[689]: vethc4a40715: IAID 21:13:59:4f machine # [ 48.792381] dhcpcd[689]: vethc4a40715: adding address fe80::d4a6:21ff:fe13:594f machine # [ 48.858313] systemd[1]: Started libcontainer container 19fc9708039f4e52af83169a7fef2ffc6aabcf3084580ca21373d256197ce62a. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.323891] dhcpcd[689]: vethc4a40715: soliciting a DHCP lease machine # [ 49.805131] systemd[1]: Started libcontainer container 115ab2a7b4b069ef987fed0e524b555b8c9ae32ef2751c9b595d424243cc1630. machine # [ 49.933414] k3s[893]: I1005 09:47:36.344141 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-vc8hx" podStartSLOduration=20.34411901 podStartE2EDuration="20.34411901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 09:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 09:47:36.34394301 +0000 UTC m=+32.139695964" watchObservedRunningTime="2026-10-05 09:47:36.34411901 +0000 UTC m=+32.139871685" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.536171] k3s[893]: I1005 09:47:36.947853 893 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.87.216"} machine # [ 50.583713] systemd[1]: cri-containerd-115ab2a7b4b069ef987fed0e524b555b8c9ae32ef2751c9b595d424243cc1630.scope: Deactivated successfully. machine # [ 50.583945] systemd[1]: cri-containerd-115ab2a7b4b069ef987fed0e524b555b8c9ae32ef2751c9b595d424243cc1630.scope: Consumed 668ms CPU time over 778ms wall clock time, 32.3M memory peak, 2.6M incoming IP traffic, 146.8K outgoing IP traffic. machine # [ 50.617455] k3s[893]: E1005 09:47:37.029133 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5845f9d694\" failed with read version: 440 is not as new as written version: 456 for group resource replicasets.apps" logger="UnhandledError" machine # [ 50.637988] k3s[893]: I1005 09:47:37.049697 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-lb\") pod \"nix-grpc-farm-lb-5845f9d694-6qfds\" (UID: \"7c0577dd-86ad-445f-8999-a3fd81b73b95\") " pod="farm/nix-grpc-farm-lb-5845f9d694-6qfds" machine # [ 50.640123] k3s[893]: I1005 09:47:37.049745 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c0577dd-86ad-445f-8999-a3fd81b73b95-config\") pod \"nix-grpc-farm-lb-5845f9d694-6qfds\" (UID: \"7c0577dd-86ad-445f-8999-a3fd81b73b95\") " pod="farm/nix-grpc-farm-lb-5845f9d694-6qfds" machine # [ 50.640823] k3s[893]: I1005 09:47:37.049774 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-ca\") pod \"nix-grpc-farm-lb-5845f9d694-6qfds\" (UID: \"7c0577dd-86ad-445f-8999-a3fd81b73b95\") " pod="farm/nix-grpc-farm-lb-5845f9d694-6qfds" machine # [ 50.641533] k3s[893]: I1005 09:47:37.049830 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c0577dd-86ad-445f-8999-a3fd81b73b95-tmp\") pod \"nix-grpc-farm-lb-5845f9d694-6qfds\" (UID: \"7c0577dd-86ad-445f-8999-a3fd81b73b95\") " pod="farm/nix-grpc-farm-lb-5845f9d694-6qfds" machine # [ 50.642120] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod7c0577dd_86ad_445f_8999_a3fd81b73b95.slice. machine # [ 50.674716] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf61420cb_1547_4229_a1e6_ebf65ac0c6f9.slice. machine # [ 50.677217] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-115ab2a7b4b069ef987fed0e524b555b8c9ae32ef2751c9b595d424243cc1630-rootfs.mount: Deactivated successfully. machine # [ 50.695236] k3s[893]: E1005 09:47:37.106883 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5\" failed with read version: 464 is not as new as written version: 473 for group resource replicasets.apps" logger="UnhandledError" machine # [ 50.713379] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod09f0fb95_6d61_449d_8bd8_c6eca436bdad.slice. machine # [ 50.719723] k3s[893]: E1005 09:47:37.131455 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5\" failed with read version: 473 is not as new as written version: 475 for group resource replicasets.apps" logger="UnhandledError" machine # [ 50.734328] dhcpcd[689]: flannel.1: no IPv6 Routers available machine # [ 50.744976] k3s[893]: I1005 09:47:37.150899 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f61420cb-1547-4229-a1e6-ebf65ac0c6f9-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj\" (UID: \"f61420cb-1547-4229-a1e6-ebf65ac0c6f9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" machine # [ 50.746047] k3s[893]: I1005 09:47:37.150933 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/09f0fb95-6d61-449d-8bd8-c6eca436bdad-tls\") pod \"nix-grpc-farm-scheduler-586f48856c-z66r4\" (UID: \"09f0fb95-6d61-449d-8bd8-c6eca436bdad\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-z66r4" machine # [ 50.746747] k3s[893]: I1005 09:47:37.150981 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/f61420cb-1547-4229-a1e6-ebf65ac0c6f9-build\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj\" (UID: \"f61420cb-1547-4229-a1e6-ebf65ac0c6f9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" machine # [ 50.747390] k3s[893]: I1005 09:47:37.151012 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/f61420cb-1547-4229-a1e6-ebf65ac0c6f9-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj\" (UID: \"f61420cb-1547-4229-a1e6-ebf65ac0c6f9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" machine # [ 50.747926] k3s[893]: I1005 09:47:37.151039 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/09f0fb95-6d61-449d-8bd8-c6eca436bdad-niks3-token\") pod \"nix-grpc-farm-scheduler-586f48856c-z66r4\" (UID: \"09f0fb95-6d61-449d-8bd8-c6eca436bdad\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-z66r4" machine # [ 50.749613] k3s[893]: I1005 09:47:37.151063 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/09f0fb95-6d61-449d-8bd8-c6eca436bdad-oidc\") pod \"nix-grpc-farm-scheduler-586f48856c-z66r4\" (UID: \"09f0fb95-6d61-449d-8bd8-c6eca436bdad\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-z66r4" machine # [ 50.750637] k3s[893]: I1005 09:47:37.151103 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/f61420cb-1547-4229-a1e6-ebf65ac0c6f9-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj\" (UID: \"f61420cb-1547-4229-a1e6-ebf65ac0c6f9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" machine # [ 50.751556] k3s[893]: I1005 09:47:37.151130 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f61420cb-1547-4229-a1e6-ebf65ac0c6f9-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj\" (UID: \"f61420cb-1547-4229-a1e6-ebf65ac0c6f9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" machine # [ 50.752609] k3s[893]: I1005 09:47:37.151175 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwrvx\" (UniqueName: \"kubernetes.io/projected/09f0fb95-6d61-449d-8bd8-c6eca436bdad-kube-api-access-vwrvx\") pod \"nix-grpc-farm-scheduler-586f48856c-z66r4\" (UID: \"09f0fb95-6d61-449d-8bd8-c6eca436bdad\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-z66r4" machine # [ 50.753683] k3s[893]: I1005 09:47:37.151202 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/f61420cb-1547-4229-a1e6-ebf65ac0c6f9-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj\" (UID: \"f61420cb-1547-4229-a1e6-ebf65ac0c6f9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" machine # [ 50.754760] k3s[893]: I1005 09:47:37.151227 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skk65\" (UniqueName: \"kubernetes.io/projected/f61420cb-1547-4229-a1e6-ebf65ac0c6f9-kube-api-access-skk65\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj\" (UID: \"f61420cb-1547-4229-a1e6-ebf65ac0c6f9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" machine # [ 50.755662] k3s[893]: I1005 09:47:37.151252 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/09f0fb95-6d61-449d-8bd8-c6eca436bdad-ca\") pod \"nix-grpc-farm-scheduler-586f48856c-z66r4\" (UID: \"09f0fb95-6d61-449d-8bd8-c6eca436bdad\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-z66r4" machine # [ 50.756718] k3s[893]: I1005 09:47:37.151304 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/f61420cb-1547-4229-a1e6-ebf65ac0c6f9-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj\" (UID: \"f61420cb-1547-4229-a1e6-ebf65ac0c6f9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" machine # [ 50.759821] k3s[893]: I1005 09:47:37.151331 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/f61420cb-1547-4229-a1e6-ebf65ac0c6f9-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj\" (UID: \"f61420cb-1547-4229-a1e6-ebf65ac0c6f9\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" machine # [ 50.830402] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod93450071_daa6_424e_a2ff_b1d9b0afe15f.slice. machine # [ 50.839954] k3s[893]: I1005 09:47:37.251630 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/93450071-daa6-424e-a2ff-b1d9b0afe15f-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8\" (UID: \"93450071-daa6-424e-a2ff-b1d9b0afe15f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" machine # [ 50.840218] k3s[893]: I1005 09:47:37.251838 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/93450071-daa6-424e-a2ff-b1d9b0afe15f-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8\" (UID: \"93450071-daa6-424e-a2ff-b1d9b0afe15f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" machine # [ 50.841745] k3s[893]: I1005 09:47:37.251894 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4z84\" (UniqueName: \"kubernetes.io/projected/93450071-daa6-424e-a2ff-b1d9b0afe15f-kube-api-access-v4z84\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8\" (UID: \"93450071-daa6-424e-a2ff-b1d9b0afe15f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" machine # [ 50.842629] k3s[893]: I1005 09:47:37.252061 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/93450071-daa6-424e-a2ff-b1d9b0afe15f-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8\" (UID: \"93450071-daa6-424e-a2ff-b1d9b0afe15f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" machine # [ 50.843837] k3s[893]: I1005 09:47:37.252089 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/93450071-daa6-424e-a2ff-b1d9b0afe15f-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8\" (UID: \"93450071-daa6-424e-a2ff-b1d9b0afe15f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" machine # [ 50.844731] k3s[893]: I1005 09:47:37.252160 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/93450071-daa6-424e-a2ff-b1d9b0afe15f-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8\" (UID: \"93450071-daa6-424e-a2ff-b1d9b0afe15f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" machine # [ 50.845388] k3s[893]: I1005 09:47:37.252203 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/93450071-daa6-424e-a2ff-b1d9b0afe15f-build\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8\" (UID: \"93450071-daa6-424e-a2ff-b1d9b0afe15f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" machine # [ 50.845955] k3s[893]: I1005 09:47:37.252263 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/93450071-daa6-424e-a2ff-b1d9b0afe15f-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8\" (UID: \"93450071-daa6-424e-a2ff-b1d9b0afe15f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" machine # [ 50.846906] k3s[893]: I1005 09:47:37.252288 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/93450071-daa6-424e-a2ff-b1d9b0afe15f-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8\" (UID: \"93450071-daa6-424e-a2ff-b1d9b0afe15f\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" machine # [ 51.121603] cni0: port 2(veth178d975f) entered blocking state machine # [ 51.122554] cni0: port 2(veth178d975f) entered disabled state machine # [ 51.123376] veth178d975f: entered allmulticast mode machine # [ 51.124178] veth178d975f: entered promiscuous mode machine # [ 50.973456] (udev-worker)[2002]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.133619] cni0: port 2(veth178d975f) entered blocking state machine # [ 51.134373] cni0: port 2(veth178d975f) entered forwarding state machine # [ 51.009374] dhcpcd[689]: veth178d975f: IAID b3:b8:80:1c machine # [ 51.009706] dhcpcd[689]: veth178d975f: adding address fe80::48cd:b3ff:feb8:801c machine # [ 51.184015] cni0: port 3(vethc3fca123) entered blocking state machine # [ 51.185231] cni0: port 3(vethc3fca123) entered disabled state machine # [ 51.186501] vethc3fca123: entered allmulticast mode machine # [ 51.187248] vethc3fca123: entered promiscuous mode machine # [ 51.205970] cni0: port 3(vethc3fca123) entered blocking state machine # [ 51.206870] cni0: port 3(vethc3fca123) entered forwarding state machine # [ 51.052436] (udev-worker)[2006]: Network interface NamePolicy= disabled on kernel command line.[ 51.209833] cni0: port 4(veth94c9760e) entered blocking state machine # [ 51.210490] cni0: port 4(veth94c9760e) entered disabled state machine # machine # [ 51.211595] veth94c9760e: entered allmulticast mode machine # [ 51.058761] (udev-worker)[2003]: Network inte[ 51.212517] veth94c9760e: entered promiscuous mode machine # rface NamePolicy= disabled on kernel command line. machine # [ 51.215686] cni0: port 5(vethca68f59d) entered blocking state machine # [ 51.218812] cni0: port 5(vethca68f59d) entered disabled state machine # [ 51.220609] vethca68f59d: entered allmulticast mode machine # [ 51.221919] vethca68f59d: entered promiscuous mode machine # [ 51.233611] cni0: port 4(veth94c9760e) entered blocking state machine # [ 51.235080] cni0: port 4(veth94c9760e) entered forwarding state machine # [ 51.242873] cni0: port 5(vethca68f59d) entered blocking state machine # [ 51.244283] cni0: port 5(vethca68f59d) entered forwarding state machine # [ 51.094675] dhcpcd[689]: vethc3fca123: waiting for carrier machine # [ 51.107563] dhcpcd[689]: vethca68f59d: IAID fb:b5:1b:db machine # [ 51.108544] dhcpcd[689]: vethca68f59d: adding address fe80::40ef:fbff:feb5:1bdb machine # [ 51.120337] dhcpcd[689]: veth94c9760e: IAID 72:72:0a:ea machine # [ 51.121358] dhcpcd[689]: veth94c9760e: adding address fe80::a87e:72ff:fe72:aea machine # [ 51.122588] dhcpcd[689]: veth94c9760e: old hardware address: aa:7e:72:72:0a:ea machine # [ 51.123781] dhcpcd[689]: veth94c9760e: new hardware address: 96:c5:b4:17:26:81 machine # [ 51.125029] dhcpcd[689]: veth94c9760e: carrier lost machine # [ 51.134923] systemd[1]: Started libcontainer container 6af2f2afdf87f87355eaf02d8754afeda873df1d5ec8bf8d8ce5ab5bbcd41ae6. machine # [ 51.152939] dhcpcd[689]: veth94c9760e: deleting address fe80::a87e:72ff:fe72:aea machine # [ 51.154541] dhcpcd[689]: vethca68f59d: carrier lost machine # [ 51.186670] dhcpcd[689]: vethca68f59d: deleting address fe80::40ef:fbff:feb5:1bdb machine # [ 51.188511] dhcpcd[689]: vethc3fca123: carrier acquired machine # [ 51.193641] dhcpcd[689]: vethc3fca123: IAID 3d:2d:19:61 machine # [ 51.194502] dhcpcd[689]: vethc3fca123: adding address fe80::e4b3:3dff:fe2d:1961 machine # [ 51.195673] dhcpcd[689]: veth94c9760e: carrier acquired machine # [ 51.203407] dhcpcd[689]: veth94c9760e: IAID b4:17:26:81 machine # [ 51.204662] dhcpcd[689]: veth94c9760e: adding address fe80::94c5:b4ff:fe17:2681 machine # [ 51.205622] dhcpcd[689]: vethca68f59d: carrier acquired machine # [ 51.210273] dhcpcd[689]: vethca68f59d: IAID fb:b5:1b:db machine # [ 51.210867] dhcpcd[689]: vethca68f59d: adding address fe80::40ef:fbff:feb5:1bdb machine # [ 51.218560] systemd[1]: Started libcontainer container 693e89820d4a2c2b4bbc6430bad8c919b5797209c35be60de15a20541a6c5b01. machine # [ 51.256814] systemd[1]: Started libcontainer container 7ff518b5f2ebe70c454b9663fbfd4b1fe7914e8b3365997683273b5b535d3092. machine # [ 51.266102] dhcpcd[689]: vethc3fca123: soliciting a DHCP lease machine # [ 51.289202] dhcpcd[689]: vethc4a40715: soliciting an IPv6 router machine # [ 51.292137] dhcpcd[689]: veth178d975f: soliciting a DHCP lease machine # [ 51.306511] systemd[1]: Started libcontainer container 2cff38c33437b08437301ee9565e039929befa76d1b820044de93e5280a5e89d. machine # [ 52.573500] dhcpcd[689]: vethca68f59d: soliciting a DHCP lease machine # [ 52.842131] cni0: port 6(veth68bd7e8a) entered blocking state machine # [ 52.843288] cni0: port 6(veth68bd7e8a) entered disabled state machine # [ 52.844354] veth68bd7e8a: entered allmulticast mode machine # [ 52.845599] veth68bd7e8a: entered promiscuous mode machine # [ 52.692156] dhcpcd[689]: veth94c9760e: soliciting an IPv6 router machine # [ 52.854056] cni0: port 6(veth68bd7e8a) entered blocking state machine # [ 52.855482] cni0: port 6(veth68bd7e8a) entered forwarding state machine # [ 52.745492] systemd[1]: Started libcontainer container 9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee. machine # [ 52.758275] systemd[1]: cri-containerd-19fc9708039f4e52af83169a7fef2ffc6aabcf3084580ca21373d256197ce62a.scope: Deactivated successfully. machine # [ 52.777601] (udev-worker)[2793]: Network interface NamePolicy= disabled on kernel command line. machine # [ 52.809821] dhcpcd[689]: veth68bd7e8a: IAID df:a0:cd:8d machine # [ 52.811110] dhcpcd[689]: veth68bd7e8a: adding address fe80::9850:dfff:fea0:cd8d machine # [ 52.812655] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-19fc9708039f4e52af83169a7fef2ffc6aabcf3084580ca21373d256197ce62a-rootfs.mount: Deactivated successfully. machine # [ 52.909153] dhcpcd[689]: vethca68f59d: soliciting an IPv6 router machine # [ 52.984833] dhcpcd[689]: vethc3fca123: soliciting an IPv6 router machine # [ 53.019620] systemd[1]: Started libcontainer container a403e922a3885e703b0ff501100b1bf391e2fddf4cf5f6d17880017fbd955d73. machine # [ 53.050825] dhcpcd[689]: veth94c9760e: soliciting a DHCP lease machine # [ 53.051281] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-19fc9708039f4e52af83169a7fef2ffc6aabcf3084580ca21373d256197ce62a-shm.mount: Deactivated successfully. machine # [ 53.262112] cni0: port 1(vethc4a40715) entered disabled state machine # [ 53.110236] dhcpcd[689]: vethc4a40715: carrier lost machine # [ 53.267404] vethc4a40715 (unregistering): left allmulticast mode machine # [ 53.268568] vethc4a40715 (unregistering): left promiscuous mode machine # [ 53.271241] cni0: port 1(vethc4a40715) entered disabled state machine # [ 53.130682] k3s[893]: I1005 09:47:39.541942 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5845f9d694-6qfds" podStartSLOduration=2.541914818 podStartE2EDuration="2.541914818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 09:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 09:47:39.337205002 +0000 UTC m=+35.132958236" watchObservedRunningTime="2026-10-05 09:47:39.541914818 +0000 UTC m=+35.337667494" machine # [ 53.154684] dhcpcd[689]: vethc4a40715: deleting address fe80::d4a6:21ff:fe13:594f machine # [ 53.199421] dhcpcd[689]: vethc4a40715: removing interface machine # [ 53.267100] k3s[893]: I1005 09:47:39.677989 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-config\") pod \"ecdf7794-e337-4c33-92eb-27d372196aad\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " machine # [ 53.267296] k3s[893]: I1005 09:47:39.678067 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-tmp\") pod \"ecdf7794-e337-4c33-92eb-27d372196aad\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " machine # [ 53.268531] k3s[893]: I1005 09:47:39.678105 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-values\" (UniqueName: \"kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-values\") pod \"ecdf7794-e337-4c33-92eb-27d372196aad\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " machine # [ 53.269772] k3s[893]: I1005 09:47:39.678133 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-kube-api-access-czt7p\" (UniqueName: \"kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-kube-api-access-czt7p\") pod \"ecdf7794-e337-4c33-92eb-27d372196aad\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " machine # [ 53.270657] k3s[893]: I1005 09:47:39.678166 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ecdf7794-e337-4c33-92eb-27d372196aad-content\" (UniqueName: \"kubernetes.io/configmap/ecdf7794-e337-4c33-92eb-27d372196aad-content\") pod \"ecdf7794-e337-4c33-92eb-27d372196aad\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " machine # [ 53.271224] k3s[893]: I1005 09:47:39.678200 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-helm\") pod \"ecdf7794-e337-4c33-92eb-27d372196aad\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " machine # [ 53.271794] k3s[893]: I1005 09:47:39.678229 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-cache\") pod \"ecdf7794-e337-4c33-92eb-27d372196aad\" (UID: \"ecdf7794-e337-4c33-92eb-27d372196aad\") " machine # [ 53.273250] k3s[893]: I1005 09:47:39.680183 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecdf7794-e337-4c33-92eb-27d372196aad-content" pod "ecdf7794-e337-4c33-92eb-27d372196aad" (UID: "ecdf7794-e337-4c33-92eb-27d372196aad"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 53.310184] k3s[893]: I1005 09:47:39.721660 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-tmp" pod "ecdf7794-e337-4c33-92eb-27d372196aad" (UID: "ecdf7794-e337-4c33-92eb-27d372196aad"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.310572] k3s[893]: I1005 09:47:39.721778 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-config" pod "ecdf7794-e337-4c33-92eb-27d372196aad" (UID: "ecdf7794-e337-4c33-92eb-27d372196aad"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.311124] k3s[893]: I1005 09:47:39.721780 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-values" pod "ecdf7794-e337-4c33-92eb-27d372196aad" (UID: "ecdf7794-e337-4c33-92eb-27d372196aad"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 53.311847] k3s[893]: I1005 09:47:39.722448 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-cache" pod "ecdf7794-e337-4c33-92eb-27d372196aad" (UID: "ecdf7794-e337-4c33-92eb-27d372196aad"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.312919] k3s[893]: I1005 09:47:39.722497 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-helm" pod "ecdf7794-e337-4c33-92eb-27d372196aad" (UID: "ecdf7794-e337-4c33-92eb-27d372196aad"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 53.313601] k3s[893]: I1005 09:47:39.722693 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-kube-api-access-czt7p" pod "ecdf7794-e337-4c33-92eb-27d372196aad" (UID: "ecdf7794-e337-4c33-92eb-27d372196aad"). InnerVolumeSpecName "kube-api-access-czt7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 53.367209] k3s[893]: I1005 09:47:39.778851 893 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 53.367619] k3s[893]: I1005 09:47:39.778894 893 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 53.368257] k3s[893]: I1005 09:47:39.778908 893 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 53.368884] k3s[893]: I1005 09:47:39.778923 893 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecdf7794-e337-4c33-92eb-27d372196aad-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 53.369708] k3s[893]: I1005 09:47:39.778945 893 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-values\") on node \"machine\" DevicePath \"\"" machine # [ 53.371555] k3s[893]: I1005 09:47:39.778962 893 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czt7p\" (UniqueName: \"kubernetes.io/projected/ecdf7794-e337-4c33-92eb-27d372196aad-kube-api-access-czt7p\") on node \"machine\" DevicePath \"\"" machine # [ 53.372525] k3s[893]: I1005 09:47:39.778984 893 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/ecdf7794-e337-4c33-92eb-27d372196aad-content\") on node \"machine\" DevicePath \"\"" machine # [ 53.638428] systemd[1]: Removed slice libcontainer container kubepods-burstable-podecdf7794_e337_4c33_92eb_27d372196aad.slice. machine # [ 53.639171] systemd[1]: kubepods-burstable-podecdf7794_e337_4c33_92eb_27d372196aad.slice: Consumed 700ms CPU time over 16.712s wall clock time, 33M memory peak, 2.6M incoming IP traffic, 146.8K outgoing IP traffic. machine # [ 53.710177] dhcpcd[689]: veth178d975f: soliciting an IPv6 router machine # [ 53.713375] systemd[1]: run-netns-cni\x2d7e6fe8bc\x2d48eb\x2d2324\x2d7ce8\x2dd2bff359a528.mount: Deactivated successfully. machine # [ 53.713989] systemd[1]: var-lib-kubelet-pods-ecdf7794\x2de337\x2d4c33\x2d92eb\x2d27d372196aad-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dczt7p.mount: Deactivated successfully. machine # [ 53.714705] systemd[1]: var-lib-kubelet-pods-ecdf7794\x2de337\x2d4c33\x2d92eb\x2d27d372196aad-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 53.715511] systemd[1]: var-lib-kubelet-pods-ecdf7794\x2de337\x2d4c33\x2d92eb\x2d27d372196aad-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 53.716627] systemd[1]: var-lib-kubelet-pods-ecdf7794\x2de337\x2d4c33\x2d92eb\x2d27d372196aad-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 53.717582] systemd[1]: var-lib-kubelet-pods-ecdf7794\x2de337\x2d4c33\x2d92eb\x2d27d372196aad-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 53.718206] systemd[1]: var-lib-kubelet-pods-ecdf7794\x2de337\x2d4c33\x2d92eb\x2d27d372196aad-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 53.735097] k3s[893]: E1005 09:47:40.146241 893 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdf7794_e337_4c33_92eb_27d372196aad.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdf7794_e337_4c33_92eb_27d372196aad.slice/memory.max: no such file or directory" podName="helm-install-nix-grpc-farm-vc8hx" machine # [ 53.735463] k3s[893]: E1005 09:47:40.146300 893 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdf7794_e337_4c33_92eb_27d372196aad.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdf7794_e337_4c33_92eb_27d372196aad.slice/cpu.max: no such file or directory" podName="helm-install-nix-grpc-farm-vc8hx" machine # [ 53.735969] k3s[893]: I1005 09:47:40.146907 893 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19fc9708039f4e52af83169a7fef2ffc6aabcf3084580ca21373d256197ce62a" machine # [ 53.888092] dhcpcd[689]: veth68bd7e8a: soliciting an IPv6 router machine # [ 54.176751] systemd[1]: Started libcontainer container 9062e5d6c7a36bbc64ad46240aa40f6464aea6de6bf5c21f6a0b5af16526805b. machine # [ 54.315126] k3s[893]: I1005 09:47:40.726402 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-5snx8" podStartSLOduration=24.726376531 podStartE2EDuration="24.726376531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 09:47:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 09:47:40.726144658 +0000 UTC m=+36.521897612" watchObservedRunningTime="2026-10-05 09:47:40.726376531 +0000 UTC m=+36.522129206" machine # [ 54.726685] dhcpcd[689]: veth68bd7e8a: soliciting a DHCP lease machine # [ 56.267699] dhcpcd[689]: vethc3fca123: probing for an IPv4LL address machine # [ 56.292797] dhcpcd[689]: veth178d975f: probing for an IPv4LL address machine # [ 57.560426] systemd[1]: Started libcontainer container 9d5bc6946d2ccad8841a3c6fd85a42ff3a8a23b920c475a10562a0a66d0b540b. machine # [ 57.574114] dhcpcd[689]: vethca68f59d: probing for an IPv4LL address machine # [ 57.714134] systemd[1]: tmp-ovl\x2didmapped2612583087.mount: Deactivated successfully. machine # [ 57.737394] systemd[1]: Started libcontainer container 1a1624476b8450e35b69c50aecf185e20c0d8652b00b9c0e4d69709e0de0445f. machine # [ 57.761261] systemd[1]: Started libcontainer container 96f1fe9f1155b19a75e878f2675092898ec79747e23f3b93eefd08fc98c3c066. machine # [ 57.855378] k3s[893]: I1005 09:47:44.265940 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-586f48856c-z66r4" podStartSLOduration=7.265904878 podStartE2EDuration="7.265904878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 09:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 09:47:44.05660621 +0000 UTC m=+39.852360003" watchObservedRunningTime="2026-10-05 09:47:44.265904878 +0000 UTC m=+40.061657553" machine # [ 57.897756] niks3-server[1198]: 2026/10/05 09:47:44 INFO lead: acquired remote=10.42.0.5:57898 machine # [ 58.050496] dhcpcd[689]: veth94c9760e: probing for an IPv4LL address machine # [ 58.526475] systemd[1]: tmp-ovl\x2didmapped4080012791.mount: Deactivated successfully. machine # [ 59.406137] systemd[1]: cri-containerd-96f1fe9f1155b19a75e878f2675092898ec79747e23f3b93eefd08fc98c3c066.scope: Deactivated successfully. machine # [ 59.407192] systemd[1]: cri-containerd-96f1fe9f1155b19a75e878f2675092898ec79747e23f3b93eefd08fc98c3c066.scope: Consumed 753ms CPU time over 1.644s wall clock time, 393.7M memory peak, 79.8M read from disk, 219.6M written to disk. machine # [ 59.417337] systemd[1]: cri-containerd-1a1624476b8450e35b69c50aecf185e20c0d8652b00b9c0e4d69709e0de0445f.scope: Deactivated successfully. machine # [ 59.422512] systemd[1]: cri-containerd-1a1624476b8450e35b69c50aecf185e20c0d8652b00b9c0e4d69709e0de0445f.scope: Consumed 790ms CPU time over 1.679s wall clock time, 379M memory peak, 65.4M read from disk, 248.1M written to disk. machine # [ 59.475753] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-96f1fe9f1155b19a75e878f2675092898ec79747e23f3b93eefd08fc98c3c066-rootfs.mount: Deactivated successfully. machine # [ 59.478087] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1a1624476b8450e35b69c50aecf185e20c0d8652b00b9c0e4d69709e0de0445f-rootfs.mount: Deactivated successfully. machine # [ 59.728416] dhcpcd[689]: veth68bd7e8a: probing for an IPv4LL address machine # [ 59.941588] systemd[1]: tmp-ovl\x2didmapped1727945623.mount: Deactivated successfully. machine # [ 59.943078] systemd[1]: tmp-ovl\x2didmapped3337898578.mount: Deactivated successfully. machine # [ 59.957319] systemd[1]: Started libcontainer container 3b104ea8f2aed9017efb7b6842aa15564f05488cdf9c7fc7b3c73220d588a5b1. machine # [ 59.960051] systemd[1]: Started libcontainer container 8955fa8c717fcd1f407a8a7dd9eaad9166232f4273614bc8f5099940cfbc88ba. machine # [ 60.156431] systemd[1]: Started libcontainer container 2b386c904657b2a6b652833b97fefdbf7ea9a35038106ab7105b98e189c77d34. machine # [ 60.159259] systemd[1]: Started libcontainer container 9b5557976f6cccca65bad8a4b61000457d128766ab7db635b9e0749e21a4e6d2. machine # [ 60.390457] systemd[1]: Started libcontainer container 872ca931f22c9ccc6be870e69bb068b09e30ac5256739c4fb46dce62678b421c. machine # [ 60.405371] systemd[1]: Started libcontainer container 05cb45b3bbd9839d824d7d520d090812ba915b82142284c1c71c9ecc29481c9f. machine # [ 60.496111] k3s[893]: I1005 09:47:46.907170 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj" podStartSLOduration=8.317789964 podStartE2EDuration="9.907140007s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.589350043s" isStatefulPod=false podCreationTimestamp="2026-10-05 09:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 09:47:46.891280729 +0000 UTC m=+42.687033404" watchObservedRunningTime="2026-10-05 09:47:46.907140007 +0000 UTC m=+42.702892961" machine # [ 60.994186] k3s[893]: I1005 09:47:47.405081 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8" podStartSLOduration=8.776609171 podStartE2EDuration="10.405030381s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.62842121s" isStatefulPod=false podCreationTimestamp="2026-10-05 09:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 09:47:46.906974343 +0000 UTC m=+42.702727298" watchObservedRunningTime="2026-10-05 09:47:47.405030381 +0000 UTC m=+43.200787805" machine # [ 61.066614] dhcpcd[689]: vethc3fca123: using IPv4LL address 169.254.188.2 machine # [ 61.067540] dhcpcd[689]: vethc3fca123: adding route to 169.254.0.0/16 machine # [ 61.217642] dhcpcd[689]: veth178d975f: using IPv4LL address 169.254.35.123 machine # [ 61.218270] dhcpcd[689]: veth178d975f: adding route to 169.254.0.0/16 machine # error: timed out waiting for the condition machine # [ 62.231972] dhcpcd[689]: veth94c9760e: using IPv4LL address 169.254.210.223 machine # [ 62.232498] dhcpcd[689]: veth94c9760e: adding route to 169.254.0.0/16 machine # [ 62.489243] dhcpcd[689]: vethca68f59d: using IPv4LL address 169.254.56.60 machine # [ 62.489666] dhcpcd[689]: vethca68f59d: adding route to 169.254.0.0/16 machine # [ 64.542215] dhcpcd[689]: veth68bd7e8a: using IPv4LL address 169.254.76.227 machine # [ 64.542678] dhcpcd[689]: veth68bd7e8a: adding route to 169.254.0.0/16 machine # [ 64.694453] dhcpcd[689]: veth94c9760e: no IPv6 Routers available machine # [ 64.912083] dhcpcd[689]: vethca68f59d: no IPv6 Routers available machine # [ 64.987338] dhcpcd[689]: vethc3fca123: no IPv6 Routers available machine # [ 65.714152] dhcpcd[689]: veth178d975f: no IPv6 Routers available machine # [ 65.890439] dhcpcd[689]: veth68bd7e8a: no IPv6 Routers available machine # error: timed out waiting for the condition machine # error: timed out waiting for the condition machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 66.42 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.21 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 0.18 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.03 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: waiting for success: test $(curl -sf 10.42.0.7:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.7:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.09 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.16 seconds) machine: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.5:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 67.35 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.16 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.15 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 133.367351] niks3-server[1198]: 2026/10/05 09:48:59 INFO Received push request method=POST path=/api/pushes machine # [ 133.394985] niks3-server[1198]: 2026/10/05 09:48:59 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 133.396996] niks3-server[1198]: 2026/10/05 09:48:59 INFO Signed narinfos id=1 count=1 machine # [ 133.404686] niks3-server[1198]: 2026/10/05 09:48:59 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 133.410478] niks3-server[1198]: 2026/10/05 09:48:59 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 133.410648] niks3-server[1198]: 2026/10/05 09:48:59 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 133.419253] niks3-server[1198]: 2026/10/05 09:48:59 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 158.139158] niks3-server[1198]: 2026/10/05 09:49:24 INFO Received push request method=POST path=/api/pushes machine # [ 158.165891] niks3-server[1198]: 2026/10/05 09:49:24 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 158.168548] niks3-server[1198]: 2026/10/05 09:49:24 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 158.173728] niks3-server[1198]: 2026/10/05 09:49:24 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 158.176153] niks3-server[1198]: 2026/10/05 09:49:24 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 158.180641] niks3-server[1198]: 2026/10/05 09:49:24 INFO Signed narinfos id=2 count=1 machine # [ 158.191506] niks3-server[1198]: 2026/10/05 09:49:24 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 158.199119] niks3-server[1198]: 2026/10/05 09:49:24 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 158.267684] niks3-server[1198]: 2026/10/05 09:49:24 INFO Received push request method=POST path=/api/pushes machine # [ 158.277829] niks3-server[1198]: 2026/10/05 09:49:24 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 158.279930] niks3-server[1198]: 2026/10/05 09:49:24 INFO Signed narinfos id=3 count=1 machine # [ 158.283362] niks3-server[1198]: 2026/10/05 09:49:24 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 158.287090] niks3-server[1198]: 2026/10/05 09:49:24 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 158.289136] niks3-server[1198]: 2026/10/05 09:49:24 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 158.292929] niks3-server[1198]: 2026/10/05 09:49:24 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 162.077023] hrtimer: interrupt took 16923659 ns machine # [ 183.213040] niks3-server[1198]: 2026/10/05 09:49:49 INFO Received push request method=POST path=/api/pushes machine # [ 183.227548] niks3-server[1198]: 2026/10/05 09:49:49 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 183.230536] niks3-server[1198]: 2026/10/05 09:49:49 INFO Signed narinfos id=4 count=1 machine # [ 183.234488] niks3-server[1198]: 2026/10/05 09:49:49 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 183.234678] niks3-server[1198]: 2026/10/05 09:49:49 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 183.236262] niks3-server[1198]: 2026/10/05 09:49:49 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 183.241588] niks3-server[1198]: 2026/10/05 09:49:49 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 183.253114] niks3-server[1198]: 2026/10/05 09:49:49 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 183.331741] niks3-server[1198]: 2026/10/05 09:49:49 INFO Received push request method=POST path=/api/pushes machine # [ 183.346783] niks3-server[1198]: 2026/10/05 09:49:49 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 183.348407] niks3-server[1198]: 2026/10/05 09:49:49 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 183.353616] niks3-server[1198]: 2026/10/05 09:49:49 INFO Signed narinfos id=5 count=1 machine # [ 183.355331] niks3-server[1198]: 2026/10/05 09:49:49 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 183.360968] niks3-server[1198]: 2026/10/05 09:49:49 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 183.363681] niks3-server[1198]: 2026/10/05 09:49:49 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 208.460454] niks3-server[1198]: 2026/10/05 09:50:14 INFO Received push request method=POST path=/api/pushes machine # [ 208.476288] niks3-server[1198]: 2026/10/05 09:50:14 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 208.478353] niks3-server[1198]: 2026/10/05 09:50:14 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 208.479548] niks3-server[1198]: 2026/10/05 09:50:14 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 208.480750] niks3-server[1198]: 2026/10/05 09:50:14 INFO Signed narinfos id=6 count=1 machine # [ 208.482714] niks3-server[1198]: 2026/10/05 09:50:14 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 208.488396] niks3-server[1198]: 2026/10/05 09:50:14 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 208.490923] niks3-server[1198]: 2026/10/05 09:50:14 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 112.45 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.11 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.18 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 234.085579] niks3-server[1198]: 2026/10/05 09:50:40 INFO Received push request method=POST path=/api/pushes machine # [ 234.108690] niks3-server[1198]: 2026/10/05 09:50:40 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 234.110335] niks3-server[1198]: 2026/10/05 09:50:40 INFO Signed narinfos id=7 count=1 machine # [ 234.113650] niks3-server[1198]: 2026/10/05 09:50:40 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 234.116307] niks3-server[1198]: 2026/10/05 09:50:40 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 234.118936] niks3-server[1198]: 2026/10/05 09:50:40 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 234.125124] niks3-server[1198]: 2026/10/05 09:50:40 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 258.839521] niks3-server[1198]: 2026/10/05 09:51:05 INFO Received push request method=POST path=/api/pushes machine # [ 258.859606] niks3-server[1198]: 2026/10/05 09:51:05 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 258.861729] niks3-server[1198]: 2026/10/05 09:51:05 INFO Signed narinfos id=8 count=1 machine # [ 258.865679] niks3-server[1198]: 2026/10/05 09:51:05 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 258.868072] niks3-server[1198]: 2026/10/05 09:51:05 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 258.869287] niks3-server[1198]: 2026/10/05 09:51:05 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 258.876446] niks3-server[1198]: 2026/10/05 09:51:05 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 258.879650] niks3-server[1198]: 2026/10/05 09:51:05 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 258.955348] niks3-server[1198]: 2026/10/05 09:51:05 INFO Received push request method=POST path=/api/pushes machine # [ 258.968716] niks3-server[1198]: 2026/10/05 09:51:05 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 258.970603] niks3-server[1198]: 2026/10/05 09:51:05 INFO Signed narinfos id=9 count=1 machine # [ 258.973416] niks3-server[1198]: 2026/10/05 09:51:05 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 258.975109] niks3-server[1198]: 2026/10/05 09:51:05 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 258.981051] niks3-server[1198]: 2026/10/05 09:51:05 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 258.985969] niks3-server[1198]: 2026/10/05 09:51:05 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 283.297896] niks3-server[1198]: 2026/10/05 09:51:29 INFO Received push request method=POST path=/api/pushes machine # [ 283.318791] niks3-server[1198]: 2026/10/05 09:51:29 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 283.323699] niks3-server[1198]: 2026/10/05 09:51:29 INFO Signed narinfos id=10 count=1 machine # [ 283.324230] niks3-server[1198]: 2026/10/05 09:51:29 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 283.328971] niks3-server[1198]: 2026/10/05 09:51:29 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 283.330962] niks3-server[1198]: 2026/10/05 09:51:29 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 283.334890] niks3-server[1198]: 2026/10/05 09:51:29 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 283.339120] niks3-server[1198]: 2026/10/05 09:51:29 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 283.403666] niks3-server[1198]: 2026/10/05 09:51:29 INFO Received push request method=POST path=/api/pushes machine # [ 283.416362] niks3-server[1198]: 2026/10/05 09:51:29 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 283.418068] niks3-server[1198]: 2026/10/05 09:51:29 INFO Signed narinfos id=11 count=1 machine # [ 283.421343] niks3-server[1198]: 2026/10/05 09:51:29 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 283.422483] niks3-server[1198]: 2026/10/05 09:51:29 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 283.426854] niks3-server[1198]: 2026/10/05 09:51:29 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 283.430302] niks3-server[1198]: 2026/10/05 09:51:29 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 308.346409] niks3-server[1198]: 2026/10/05 09:51:54 INFO Received push request method=POST path=/api/pushes machine # [ 308.364333] niks3-server[1198]: 2026/10/05 09:51:54 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 308.366467] niks3-server[1198]: 2026/10/05 09:51:54 INFO Signed narinfos id=12 count=1 machine # [ 308.371556] niks3-server[1198]: 2026/10/05 09:51:54 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 308.373645] niks3-server[1198]: 2026/10/05 09:51:54 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 308.375452] niks3-server[1198]: 2026/10/05 09:51:54 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 308.377938] niks3-server[1198]: 2026/10/05 09:51:54 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 308.381448] niks3-server[1198]: 2026/10/05 09:51:54 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 100.62 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.36 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 309.623921] postgres[762]: [762] LOG: checkpoint starting: time machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.19 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.15 seconds) machine: must succeed: kubectl apply -f /nix/store/pzq1y78ar0jx25hvv3v5qh4428dn7jnp-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/pzq1y78ar0jx25hvv3v5qh4428dn7jnp-ci-job.json, in 0.18 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 310.011635] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod5a41ae5a_7144_4244_aefb_64d0cc1ee073.slice. machine # [ 310.063877] k3s[893]: I1005 09:51:56.475153 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/5a41ae5a-7144-4244-aefb-64d0cc1ee073-job\") pod \"ci-9hj77\" (UID: \"5a41ae5a-7144-4244-aefb-64d0cc1ee073\") " pod="ci/ci-9hj77" machine # [ 310.064348] k3s[893]: I1005 09:51:56.475217 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrsbl\" (UniqueName: \"kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-kube-api-access-nrsbl\") pod \"ci-9hj77\" (UID: \"5a41ae5a-7144-4244-aefb-64d0cc1ee073\") " pod="ci/ci-9hj77" machine # [ 310.065055] k3s[893]: I1005 09:51:56.475249 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-nix-grpc-farm\") pod \"ci-9hj77\" (UID: \"5a41ae5a-7144-4244-aefb-64d0cc1ee073\") " pod="ci/ci-9hj77" machine # [ 311.410379] cni0: port 1(veth0b71f6e6) entered blocking state machine # [ 311.413445] cni0: port 1(veth0b71f6e6) entered disabled state machine # [ 311.414441] veth0b71f6e6: entered allmulticast mode machine # [ 311.415378] veth0b71f6e6: entered promiscuous mode machine # [ 311.424151] cni0: port 1(veth0b71f6e6) entered blocking state machine # [ 311.424994] cni0: port 1(veth0b71f6e6) entered forwarding state machine # [ 311.319312] (udev-worker)[5343]: Network interface NamePolicy= disabled on kernel command line. machine # [ 311.353706] dhcpcd[689]: veth0b71f6e6: IAID 1a:ea:fd:bf machine # [ 311.354148] dhcpcd[689]: veth0b71f6e6: adding address fe80::c0ae:1aff:feea:fdbf machine # [ 311.376578] systemd[1]: Started libcontainer container b40613be1349824ae302b3972575278703ef728ef9ccf2a131eca45927177a13. machine # [ 313.119528] dhcpcd[689]: veth0b71f6e6: soliciting a DHCP lease machine # [ 313.237800] dhcpcd[689]: veth0b71f6e6: soliciting an IPv6 router machine # [ 313.361195] systemd[1]: Started libcontainer container b11a954d1b02cd7af552ca212fbde561e68e9c546cccc12bb17e1f6df9cd0d48. machine # [ 314.815443] niks3-server[1198]: 2026/10/05 09:52:01 INFO Received push request method=POST path=/api/pushes machine # [ 314.833670] niks3-server[1198]: 2026/10/05 09:52:01 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 314.835219] niks3-server[1198]: 2026/10/05 09:52:01 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 314.836759] niks3-server[1198]: 2026/10/05 09:52:01 INFO Signed narinfos id=13 count=1 machine # [ 314.839752] niks3-server[1198]: 2026/10/05 09:52:01 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 314.845142] niks3-server[1198]: 2026/10/05 09:52:01 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 314.851557] niks3-server[1198]: 2026/10/05 09:52:01 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 318.121156] dhcpcd[689]: veth0b71f6e6: probing for an IPv4LL address machine # [ 322.792295] dhcpcd[689]: veth0b71f6e6: using IPv4LL address 169.254.152.238 machine # [ 322.792947] dhcpcd[689]: veth0b71f6e6: adding route to 169.254.0.0/16 machine # [ 325.242976] dhcpcd[689]: veth0b71f6e6: no IPv6 Routers available machine # [ 339.766478] niks3-server[1198]: 2026/10/05 09:52:26 INFO Received push request method=POST path=/api/pushes machine # [ 339.788626] niks3-server[1198]: 2026/10/05 09:52:26 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 339.790562] niks3-server[1198]: 2026/10/05 09:52:26 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 339.794434] niks3-server[1198]: 2026/10/05 09:52:26 INFO Signed narinfos id=14 count=1 machine # [ 339.800246] niks3-server[1198]: 2026/10/05 09:52:26 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 339.802818] niks3-server[1198]: 2026/10/05 09:52:26 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 339.805978] niks3-server[1198]: 2026/10/05 09:52:26 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 339.807469] niks3-server[1198]: 2026/10/05 09:52:26 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 339.879457] niks3-server[1198]: 2026/10/05 09:52:26 INFO Received push request method=POST path=/api/pushes machine # [ 339.892529] niks3-server[1198]: 2026/10/05 09:52:26 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 339.895859] niks3-server[1198]: 2026/10/05 09:52:26 INFO Signed narinfos id=15 count=1 machine # [ 339.897750] niks3-server[1198]: 2026/10/05 09:52:26 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 339.900401] niks3-server[1198]: 2026/10/05 09:52:26 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 339.904383] niks3-server[1198]: 2026/10/05 09:52:26 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 339.907692] niks3-server[1198]: 2026/10/05 09:52:26 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 365.200310] niks3-server[1198]: 2026/10/05 09:52:51 INFO Received push request method=POST path=/api/pushes machine # [ 365.222055] niks3-server[1198]: 2026/10/05 09:52:51 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 365.224161] niks3-server[1198]: 2026/10/05 09:52:51 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 365.229795] niks3-server[1198]: 2026/10/05 09:52:51 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 365.231365] niks3-server[1198]: 2026/10/05 09:52:51 INFO Signed narinfos id=16 count=1 machine # [ 365.232654] niks3-server[1198]: 2026/10/05 09:52:51 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 365.239835] niks3-server[1198]: 2026/10/05 09:52:51 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 365.243525] niks3-server[1198]: 2026/10/05 09:52:51 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 365.313634] niks3-server[1198]: 2026/10/05 09:52:51 INFO Received push request method=POST path=/api/pushes machine # [ 365.323495] niks3-server[1198]: 2026/10/05 09:52:51 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 365.325329] niks3-server[1198]: 2026/10/05 09:52:51 INFO Signed narinfos id=17 count=1 machine # [ 365.326769] niks3-server[1198]: 2026/10/05 09:52:51 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 365.328435] niks3-server[1198]: 2026/10/05 09:52:51 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 365.330446] niks3-server[1198]: 2026/10/05 09:52:51 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 365.333949] niks3-server[1198]: 2026/10/05 09:52:51 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 390.029279] niks3-server[1198]: 2026/10/05 09:53:16 INFO Received push request method=POST path=/api/pushes machine # [ 390.044251] niks3-server[1198]: 2026/10/05 09:53:16 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 390.046770] niks3-server[1198]: 2026/10/05 09:53:16 INFO Signed narinfos id=18 count=1 machine # [ 390.049764] niks3-server[1198]: 2026/10/05 09:53:16 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 390.051961] niks3-server[1198]: 2026/10/05 09:53:16 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 390.054418] niks3-server[1198]: 2026/10/05 09:53:16 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 390.056811] niks3-server[1198]: 2026/10/05 09:53:16 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 390.060352] niks3-server[1198]: 2026/10/05 09:53:16 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 392.730577] niks3-server[1198]: 2026/10/05 09:53:19 INFO Received push request method=POST path=/api/pushes machine # [ 392.749548] niks3-server[1198]: 2026/10/05 09:53:19 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 392.751800] niks3-server[1198]: 2026/10/05 09:53:19 INFO Signed narinfos id=19 count=1 machine # [ 392.755563] niks3-server[1198]: 2026/10/05 09:53:19 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 392.758801] niks3-server[1198]: 2026/10/05 09:53:19 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 392.760457] niks3-server[1198]: 2026/10/05 09:53:19 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 392.765282] niks3-server[1198]: 2026/10/05 09:53:19 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 414.125447] postgres[762]: [762] LOG: checkpoint complete: wrote 1039 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.420 s, sync=0.052 s, total=104.502 s; sync files=364, longest=0.004 s, average=0.001 s; distance=5017 kB, estimate=5017 kB; lsn=0/1C7D840, redo lsn=0/1C4C8D0 machine # [ 417.495378] niks3-server[1198]: 2026/10/05 09:53:43 INFO Received push request method=POST path=/api/pushes machine # [ 417.520551] niks3-server[1198]: 2026/10/05 09:53:43 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 417.522471] niks3-server[1198]: 2026/10/05 09:53:43 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 417.528315] niks3-server[1198]: 2026/10/05 09:53:43 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 417.529386] niks3-server[1198]: 2026/10/05 09:53:43 INFO Signed narinfos id=20 count=1 machine # [ 417.534470] niks3-server[1198]: 2026/10/05 09:53:43 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 417.542445] niks3-server[1198]: 2026/10/05 09:53:43 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 417.546090] niks3-server[1198]: 2026/10/05 09:53:43 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 417.711497] systemd[1]: cri-containerd-b11a954d1b02cd7af552ca212fbde561e68e9c546cccc12bb17e1f6df9cd0d48.scope: Deactivated successfully. machine # [ 417.712462] systemd[1]: cri-containerd-b11a954d1b02cd7af552ca212fbde561e68e9c546cccc12bb17e1f6df9cd0d48.scope: Consumed 1.042s CPU time over 1min 44.349s wall clock time, 138M memory peak, 68.7M read from disk, 412K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 417.774491] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b11a954d1b02cd7af552ca212fbde561e68e9c546cccc12bb17e1f6df9cd0d48-rootfs.mount: Deactivated successfully. machine # [ 419.294855] systemd[1]: cri-containerd-b40613be1349824ae302b3972575278703ef728ef9ccf2a131eca45927177a13.scope: Deactivated successfully. machine # [ 419.330803] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b40613be1349824ae302b3972575278703ef728ef9ccf2a131eca45927177a13-rootfs.mount: Deactivated successfully. machine # [ 419.363688] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-b40613be1349824ae302b3972575278703ef728ef9ccf2a131eca45927177a13-shm.mount: Deactivated successfully. machine # [ 419.551849] cni0: port 1(veth0b71f6e6) entered disabled state machine # [ 419.400402] dhcpcd[689]: veth0b71f6e6: carrier lost machine # [ 419.554172] veth0b71f6e6 (unregistering): left allmulticast mode machine # [ 419.555286] veth0b71f6e6 (unregistering): left promiscuous mode machine # [ 419.556400] cni0: port 1(veth0b71f6e6) entered disabled state machine # [ 419.424903] systemd[1]: run-netns-cni\x2d62a38dde\x2d672e\x2db7d5\x2d18b1\x2d5054ad288900.mount: Deactivated successfully. machine # [ 419.430749] dhcpcd[689]: veth0b71f6e6: deleting address fe80::c0ae:1aff:feea:fdbf machine # [ 419.434193] dhcpcd[689]: veth0b71f6e6: deleting route to 169.254.0.0/16 machine # [ 419.506369] dhcpcd[689]: veth0b71f6e6: removing interface machine # [ 419.632966] k3s[893]: I1005 09:53:46.043933 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-nix-grpc-farm\") pod \"5a41ae5a-7144-4244-aefb-64d0cc1ee073\" (UID: \"5a41ae5a-7144-4244-aefb-64d0cc1ee073\") " machine # [ 419.641521] k3s[893]: I1005 09:53:46.044030 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5a41ae5a-7144-4244-aefb-64d0cc1ee073-job\" (UniqueName: \"kubernetes.io/configmap/5a41ae5a-7144-4244-aefb-64d0cc1ee073-job\") pod \"5a41ae5a-7144-4244-aefb-64d0cc1ee073\" (UID: \"5a41ae5a-7144-4244-aefb-64d0cc1ee073\") " machine # [ 419.649166] k3s[893]: I1005 09:53:46.044065 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-kube-api-access-nrsbl\" (UniqueName: \"kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-kube-api-access-nrsbl\") pod \"5a41ae5a-7144-4244-aefb-64d0cc1ee073\" (UID: \"5a41ae5a-7144-4244-aefb-64d0cc1ee073\") " machine # [ 419.653826] k3s[893]: I1005 09:53:46.045177 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a41ae5a-7144-4244-aefb-64d0cc1ee073-job" pod "5a41ae5a-7144-4244-aefb-64d0cc1ee073" (UID: "5a41ae5a-7144-4244-aefb-64d0cc1ee073"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 419.657781] k3s[893]: I1005 09:53:46.053965 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-nix-grpc-farm" pod "5a41ae5a-7144-4244-aefb-64d0cc1ee073" (UID: "5a41ae5a-7144-4244-aefb-64d0cc1ee073"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 419.662115] k3s[893]: I1005 09:53:46.054004 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-kube-api-access-nrsbl" pod "5a41ae5a-7144-4244-aefb-64d0cc1ee073" (UID: "5a41ae5a-7144-4244-aefb-64d0cc1ee073"). InnerVolumeSpecName "kube-api-access-nrsbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 419.666452] systemd[1]: var-lib-kubelet-pods-5a41ae5a\x2d7144\x2d4244\x2daefb\x2d64d0cc1ee073-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dnrsbl.mount: Deactivated successfully. machine # [ 419.668746] systemd[1]: var-lib-kubelet-pods-5a41ae5a\x2d7144\x2d4244\x2daefb\x2d64d0cc1ee073-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 419.733785] k3s[893]: I1005 09:53:46.145350 893 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 419.734490] k3s[893]: I1005 09:53:46.145402 893 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/5a41ae5a-7144-4244-aefb-64d0cc1ee073-job\") on node \"machine\" DevicePath \"\"" machine # [ 419.735268] k3s[893]: I1005 09:53:46.145420 893 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrsbl\" (UniqueName: \"kubernetes.io/projected/5a41ae5a-7144-4244-aefb-64d0cc1ee073-kube-api-access-nrsbl\") on node \"machine\" DevicePath \"\"" machine # [ 420.285814] k3s[893]: I1005 09:53:46.697404 893 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b40613be1349824ae302b3972575278703ef728ef9ccf2a131eca45927177a13" machine # [ 420.303176] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod5a41ae5a_7144_4244_aefb_64d0cc1ee073.slice. machine # [ 420.305701] systemd[1]: kubepods-besteffort-pod5a41ae5a_7144_4244_aefb_64d0cc1ee073.slice: Consumed 1.074s CPU time over 1min 50.289s wall clock time, 138.2M memory peak, 68.7M read from disk, 616K written to disk, 18.2K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 110.56 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.18 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpk7ox127n/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.13 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 111.79 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.28 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.49 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5845f9d694-6qfds -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 422.271933] k3s[893]: E1005 09:53:48.683242 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:60716: use of closed network connection" machine # [ 423.551495] k3s[893]: E1005 09:53:49.962314 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50114: use of closed network connection" machine # [ 424.851809] k3s[893]: E1005 09:53:51.263125 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50122: use of closed network connection" machine # [ 426.096299] k3s[893]: E1005 09:53:52.507582 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50130: use of closed network connection" machine # [ 427.372658] k3s[893]: E1005 09:53:53.783086 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50146: use of closed network connection" machine # [ 428.647659] k3s[893]: E1005 09:53:55.058577 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50148: use of closed network connection" machine # [ 431.250177] k3s[893]: E1005 09:53:57.661047 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50158: use of closed network connection" machine # [ 432.521539] k3s[893]: E1005 09:53:58.931998 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50168: use of closed network connection" machine # [ 433.823123] k3s[893]: E1005 09:54:00.233955 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46476: use of closed network connection" machine # [ 435.110465] k3s[893]: E1005 09:54:01.521411 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46484: use of closed network connection" machine # [ 436.435448] k3s[893]: E1005 09:54:02.846592 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46500: use of closed network connection" machine # [ 437.688949] k3s[893]: E1005 09:54:04.100308 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46516: use of closed network connection" machine # [ 438.994286] k3s[893]: E1005 09:54:05.405545 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46532: use of closed network connection" machine # [ 440.262379] k3s[893]: E1005 09:54:06.673356 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46540: use of closed network connection" machine # [ 441.559872] k3s[893]: E1005 09:54:07.970870 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46552: use of closed network connection" machine # [ 442.878196] k3s[893]: E1005 09:54:09.288864 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:46556: use of closed network connection" machine # [ 444.183874] k3s[893]: E1005 09:54:10.595179 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33366: use of closed network connection" machine # [ 445.475727] k3s[893]: E1005 09:54:11.887014 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33374: use of closed network connection" machine # [ 446.780934] k3s[893]: E1005 09:54:13.192268 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33378: use of closed network connection" machine # [ 448.097550] k3s[893]: E1005 09:54:14.508855 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33392: use of closed network connection" machine # [ 449.438625] k3s[893]: E1005 09:54:15.849435 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33400: use of closed network connection" machine # [ 450.794631] k3s[893]: E1005 09:54:17.205939 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33402: use of closed network connection" machine # [ 452.112565] k3s[893]: E1005 09:54:18.523769 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:33418: use of closed network connection" machine # [ 453.415473] k3s[893]: E1005 09:54:19.826679 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51730: use of closed network connection" machine # [ 454.713093] k3s[893]: E1005 09:54:21.124402 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51738: use of closed network connection" machine # [ 456.015472] k3s[893]: E1005 09:54:22.426293 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51744: use of closed network connection" machine # [ 457.302616] k3s[893]: E1005 09:54:23.713994 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51746: use of closed network connection" machine # [ 458.607986] k3s[893]: E1005 09:54:25.018973 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51754: use of closed network connection" machine # [ 459.909435] k3s[893]: E1005 09:54:26.320748 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51762: use of closed network connection" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-5845f9d694-6qfds -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 37.93 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 460.183198] niks3-server[1198]: 2026/10/05 09:54:26 INFO Received push request method=POST path=/api/pushes machine # [ 460.203559] niks3-server[1198]: 2026/10/05 09:54:26 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 460.205058] niks3-server[1198]: 2026/10/05 09:54:26 INFO Signed narinfos id=21 count=1 machine # [ 460.212407] niks3-server[1198]: 2026/10/05 09:54:26 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 460.212625] niks3-server[1198]: 2026/10/05 09:54:26 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 460.214055] niks3-server[1198]: 2026/10/05 09:54:26 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 460.217657] niks3-server[1198]: 2026/10/05 09:54:26 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 484.942577] niks3-server[1198]: 2026/10/05 09:54:51 INFO Received push request method=POST path=/api/pushes machine # [ 484.963179] niks3-server[1198]: 2026/10/05 09:54:51 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 484.964052] niks3-server[1198]: 2026/10/05 09:54:51 INFO Signed narinfos id=22 count=1 machine # [ 484.967450] niks3-server[1198]: 2026/10/05 09:54:51 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 484.969822] niks3-server[1198]: 2026/10/05 09:54:51 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 484.972346] niks3-server[1198]: 2026/10/05 09:54:51 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 484.975429] niks3-server[1198]: 2026/10/05 09:54:51 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 484.989438] niks3-server[1198]: 2026/10/05 09:54:51 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 485.054567] niks3-server[1198]: 2026/10/05 09:54:51 INFO Received push request method=POST path=/api/pushes machine # [ 485.066919] niks3-server[1198]: 2026/10/05 09:54:51 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 485.070470] niks3-server[1198]: 2026/10/05 09:54:51 INFO Signed narinfos id=23 count=1 machine # [ 485.071542] niks3-server[1198]: 2026/10/05 09:54:51 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 485.073105] niks3-server[1198]: 2026/10/05 09:54:51 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 485.074936] niks3-server[1198]: 2026/10/05 09:54:51 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 485.078646] niks3-server[1198]: 2026/10/05 09:54:51 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 509.609569] niks3-server[1198]: 2026/10/05 09:55:16 INFO Received push request method=POST path=/api/pushes machine # [ 509.634387] niks3-server[1198]: 2026/10/05 09:55:16 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 509.635560] niks3-server[1198]: 2026/10/05 09:55:16 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 509.638087] niks3-server[1198]: 2026/10/05 09:55:16 INFO Signed narinfos id=24 count=1 machine # [ 509.640799] niks3-server[1198]: 2026/10/05 09:55:16 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 509.642579] niks3-server[1198]: 2026/10/05 09:55:16 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 509.649980] niks3-server[1198]: 2026/10/05 09:55:16 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 509.655358] niks3-server[1198]: 2026/10/05 09:55:16 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 509.728420] niks3-server[1198]: 2026/10/05 09:55:16 INFO Received push request method=POST path=/api/pushes machine # [ 509.742072] niks3-server[1198]: 2026/10/05 09:55:16 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 509.743042] niks3-server[1198]: 2026/10/05 09:55:16 INFO Signed narinfos id=25 count=1 machine # [ 509.746396] niks3-server[1198]: 2026/10/05 09:55:16 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 509.748254] niks3-server[1198]: 2026/10/05 09:55:16 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 509.753068] niks3-server[1198]: 2026/10/05 09:55:16 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 509.758605] niks3-server[1198]: 2026/10/05 09:55:16 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 534.281481] niks3-server[1198]: 2026/10/05 09:55:40 INFO Received push request method=POST path=/api/pushes machine # [ 534.314606] niks3-server[1198]: 2026/10/05 09:55:40 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 534.316973] niks3-server[1198]: 2026/10/05 09:55:40 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 534.320543] niks3-server[1198]: 2026/10/05 09:55:40 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 534.325548] niks3-server[1198]: 2026/10/05 09:55:40 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 534.329965] niks3-server[1198]: 2026/10/05 09:55:40 INFO Signed narinfos id=26 count=1 machine # [ 534.338636] niks3-server[1198]: 2026/10/05 09:55:40 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 534.342465] niks3-server[1198]: 2026/10/05 09:55:40 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.43 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 114.17 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.23 seconds) machine: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj"' machine: (finished: must succeed: curl -sf http://10.42.0.6:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj"', in 0.04 seconds) (finished: subtest: metrics carry build_info, in 0.27 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 535.879887] k3s[893]: E1005 09:55:42.291217 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:54410: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.22 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 536.167886] k3s[893]: E1005 09:55:42.579076 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:54414: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.29 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc -- sh -c 'fallocate -l 11442257920 /nix/fill' machine # [ 536.393325] k3s[893]: E1005 09:55:42.804967 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:54426: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc -- sh -c 'fallocate -l 11442257920 /nix/fill', in 0.22 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc --since=30s | grep -q 'store paths deleted', in 5.04 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc -- sh -c 'rm /nix/fill' machine # [ 541.597126] k3s[893]: E1005 09:55:48.008445 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:54450: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc -- sh -c 'rm /nix/fill', in 0.16 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.12 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 541.893965] k3s[893]: E1005 09:55:48.305581 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:54454: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.18 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 6.23 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 541.920744] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 11b2289b8d4442208504691a200425b4 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 542.041791] nix[10265]: don't know how to build these paths: machine # [ 542.042820] nix[10265]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 542.059162] nix[10265]: copying 1 paths to '127.0.0.1:30051'... machine # [ 542.061073] nix[10265]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 542.110424] niks3-server[1198]: 2026/10/05 09:55:48 INFO Received push request method=POST path=/api/pushes machine # [ 542.122650] niks3-server[1198]: 2026/10/05 09:55:48 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 542.126189] niks3-server[1198]: 2026/10/05 09:55:48 INFO Signed narinfos id=27 count=1 machine # [ 542.128676] niks3-server[1198]: 2026/10/05 09:55:48 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 542.132358] niks3-server[1198]: 2026/10/05 09:55:48 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 542.135388] niks3-server[1198]: 2026/10/05 09:55:48 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 542.140169] niks3-server[1198]: 2026/10/05 09:55:48 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 542.150247] nix[10265]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 542.151995] nix[10265]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.04 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.23 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 543.210639] nix[10265]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 543.211256] nix[10265]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 543.231424] systemd[1]: cri-containerd-9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee.scope: Deactivated successfully. machine # [ 543.233171] systemd[1]: cri-containerd-9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee.scope: Consumed 4.571s CPU time over 8min 10.485s wall clock time, 56.5M memory peak, 35.1M read from disk, 603.1K incoming IP traffic, 740.6K outgoing IP traffic. machine # [ 543.258976] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee-rootfs.mount: Deactivated successfully. machine # [ 543.287398] systemd[1]: cri-containerd-7ff518b5f2ebe70c454b9663fbfd4b1fe7914e8b3365997683273b5b535d3092.scope: Deactivated successfully. machine # [ 543.315761] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7ff518b5f2ebe70c454b9663fbfd4b1fe7914e8b3365997683273b5b535d3092-rootfs.mount: Deactivated successfully. machine # [ 543.338947] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-7ff518b5f2ebe70c454b9663fbfd4b1fe7914e8b3365997683273b5b535d3092-shm.mount: Deactivated successfully. machine # [ 543.520715] cni0: port 4(veth94c9760e) entered disabled state machine # [ 543.368961] dhcpcd[689]: veth94c9760e: old hardware address: 96:c5:b4:17:26:81 machine # [ 543.370661] dhcpcd[689]: veth94c9760e: new hardware address: aa:7e:72:72:0a:ea machine # [ 543.371787] dhcpcd[689]: veth94c9760e: carrie[ 543.524061] veth94c9760e (unregistering): left allmulticast mode machine # r lost machine # [ 543.525313] veth94c9760e (unregistering): left promiscuous mode machine # [ 543.526119] cni0: port 4(veth94c9760e) entered disabled state machine # [ 543.389267] dhcpcd[689]: veth94c9760e: deleting address fe80::94c5:b4ff:fe17:2681 machine # [ 543.391497] systemd[1]: run-netns-cni\x2da621ab21\x2dfdd3\x2d6035\x2d46fe\x2d7a8501e4cc54.mount: Deactivated successfully. machine # [ 543.393158] dhcpcd[689]: veth94c9760e: deleting route to 169.254.0.0/16 machine # [ 543.432891] k3s[893]: E1005 09:55:49.844267 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5845f9d694\" failed with read version: 796 is not as new as written version: 822 for group resource replicasets.apps" logger="UnhandledError" machine # [ 543.436393] systemd[1]: Created slice libcontainer container kubepods-besteffort-poddbc206cb_0595_4bc5_a289_f95178e2dbec.slice. machine # [ 543.438870] k3s[893]: E1005 09:55:49.849876 893 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-5845f9d694\" failed with read version: 796 is not as new as written version: 822 for group resource replicasets.apps" logger="UnhandledError" machine # [ 543.462325] dhcpcd[689]: veth94c9760e: removing interface machine # [ 543.529071] k3s[893]: I1005 09:55:49.940756 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-ca\" (UniqueName: \"kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-ca\") pod \"7c0577dd-86ad-445f-8999-a3fd81b73b95\" (UID: \"7c0577dd-86ad-445f-8999-a3fd81b73b95\") " machine # [ 543.529688] k3s[893]: I1005 09:55:49.940831 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7c0577dd-86ad-445f-8999-a3fd81b73b95-tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c0577dd-86ad-445f-8999-a3fd81b73b95-tmp\") pod \"7c0577dd-86ad-445f-8999-a3fd81b73b95\" (UID: \"7c0577dd-86ad-445f-8999-a3fd81b73b95\") " machine # [ 543.530240] k3s[893]: I1005 09:55:49.940862 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-lb\" (UniqueName: \"kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-lb\") pod \"7c0577dd-86ad-445f-8999-a3fd81b73b95\" (UID: \"7c0577dd-86ad-445f-8999-a3fd81b73b95\") " machine # [ 543.530715] k3s[893]: I1005 09:55:49.940905 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c0577dd-86ad-445f-8999-a3fd81b73b95-config\" (UniqueName: \"kubernetes.io/configmap/7c0577dd-86ad-445f-8999-a3fd81b73b95-config\") pod \"7c0577dd-86ad-445f-8999-a3fd81b73b95\" (UID: \"7c0577dd-86ad-445f-8999-a3fd81b73b95\") " machine # [ 543.533727] systemd[1]: var-lib-kubelet-pods-7c0577dd\x2d86ad\x2d445f\x2d8999\x2da3fd81b73b95-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 543.547377] k3s[893]: I1005 09:55:49.940954 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dbc206cb-0595-4bc5-a289-f95178e2dbec-config\") pod \"nix-grpc-farm-lb-5845f9d694-64r7k\" (UID: \"dbc206cb-0595-4bc5-a289-f95178e2dbec\") " pod="farm/nix-grpc-farm-lb-5845f9d694-64r7k" machine # [ 543.547842] k3s[893]: I1005 09:55:49.959168 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/dbc206cb-0595-4bc5-a289-f95178e2dbec-tls-ca\") pod \"nix-grpc-farm-lb-5845f9d694-64r7k\" (UID: \"dbc206cb-0595-4bc5-a289-f95178e2dbec\") " pod="farm/nix-grpc-farm-lb-5845f9d694-64r7k" machine # [ 543.548516] k3s[893]: I1005 09:55:49.959198 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/dbc206cb-0595-4bc5-a289-f95178e2dbec-tls-lb\") pod \"nix-grpc-farm-lb-5845f9d694-64r7k\" (UID: \"dbc206cb-0595-4bc5-a289-f95178e2dbec\") " pod="farm/nix-grpc-farm-lb-5845f9d694-64r7k" machine # [ 543.549241] k3s[893]: I1005 09:55:49.960157 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-ca" pod "7c0577dd-86ad-445f-8999-a3fd81b73b95" (UID: "7c0577dd-86ad-445f-8999-a3fd81b73b95"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 543.558232] k3s[893]: I1005 09:55:49.969963 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-lb" pod "7c0577dd-86ad-445f-8999-a3fd81b73b95" (UID: "7c0577dd-86ad-445f-8999-a3fd81b73b95"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 543.566680] k3s[893]: I1005 09:55:49.978419 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbc206cb-0595-4bc5-a289-f95178e2dbec-tmp\") pod \"nix-grpc-farm-lb-5845f9d694-64r7k\" (UID: \"dbc206cb-0595-4bc5-a289-f95178e2dbec\") " pod="farm/nix-grpc-farm-lb-5845f9d694-64r7k" machine # [ 543.570937] k3s[893]: I1005 09:55:49.982655 893 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 543.571242] k3s[893]: I1005 09:55:49.982679 893 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/7c0577dd-86ad-445f-8999-a3fd81b73b95-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 543.571709] k3s[893]: I1005 09:55:49.979822 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c0577dd-86ad-445f-8999-a3fd81b73b95-tmp" pod "7c0577dd-86ad-445f-8999-a3fd81b73b95" (UID: "7c0577dd-86ad-445f-8999-a3fd81b73b95"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 543.583383] k3s[893]: I1005 09:55:49.995108 893 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c0577dd-86ad-445f-8999-a3fd81b73b95-config" pod "7c0577dd-86ad-445f-8999-a3fd81b73b95" (UID: "7c0577dd-86ad-445f-8999-a3fd81b73b95"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 543.637451] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod7c0577dd_86ad_445f_8999_a3fd81b73b95.slice. machine # [ 543.637846] systemd[1]: kubepods-besteffort-pod7c0577dd_86ad_445f_8999_a3fd81b73b95.slice: Consumed 4.605s CPU time over 8min 12.996s wall clock time, 56.8M memory peak, 35.1M read from disk, 603.1K incoming IP traffic, 740.6K outgoing IP traffic. machine # [ 543.672276] k3s[893]: I1005 09:55:50.083739 893 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7c0577dd-86ad-445f-8999-a3fd81b73b95-config\") on node \"machine\" DevicePath \"\"" machine # [ 543.672448] k3s[893]: I1005 09:55:50.083766 893 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c0577dd-86ad-445f-8999-a3fd81b73b95-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 543.929542] cni0: port 1(veth8fdb2702) entered blocking state machine # [ 543.930585] cni0: port 1(veth8fdb2702) entered disabled state machine # [ 543.931461] veth8fdb2702: entered allmulticast mode machine # [ 543.932571] veth8fdb2702: entered promiscuous mode machine # [ 543.783114] (udev-worker)[10445]: Network interface NamePolicy= disabled on kernel command line. machine # [ 543.942008] cni0: port 1(veth8fdb2702) entered blocking state machine # [ 543.943004] cni0: port 1(veth8fdb2702) entered forwarding state machine # [ 543.815696] dhcpcd[689]: veth8fdb2702: IAID 97:a7:82:4d machine # [ 543.816655] dhcpcd[689]: veth8fdb2702: adding address fe80::fc3f:97ff:fea7:824d machine # [ 543.841340] k3s[893]: I1005 09:55:50.252943 893 scope.go:122] "RemoveContainer" containerID="9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee" machine # [ 543.841548] k3s[893]: E1005 09:55:50.253040 893 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c0577dd_86ad_445f_8999_a3fd81b73b95.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c0577dd_86ad_445f_8999_a3fd81b73b95.slice/memory.max: no such file or directory" podName="nix-grpc-farm-lb-5845f9d694-6qfds" machine # [ 543.842104] k3s[893]: E1005 09:55:50.253114 893 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c0577dd_86ad_445f_8999_a3fd81b73b95.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c0577dd_86ad_445f_8999_a3fd81b73b95.slice/cpu.max: no such file or directory" podName="nix-grpc-farm-lb-5845f9d694-6qfds" machine # [ 543.852245] k3s[893]: I1005 09:55:50.263966 893 scope.go:122] "RemoveContainer" containerID="9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee" machine # [ 543.853601] k3s[893]: E1005 09:55:50.265234 893 remote_runtime.go:569] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee\": not found" containerID="9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee" machine # [ 543.854449] k3s[893]: I1005 09:55:50.265291 893 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee"} err="failed to get container status \"9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee\": rpc error: code = NotFound desc = an error occurred when try to find container \"9e4360d986c6950c11f1e6817b5db1f574b583f83c3a76f9fd666ad2bf972bee\": not found" machine # [ 543.900430] systemd[1]: Started libcontainer container 712fc06ab0405a09d6a724bdc8fbbbcd10c29773744c860e13397cae2ea4b440. machine # [ 544.020354] systemd[1]: Started libcontainer container cd62173e0c1b8a65d17c2735496d806ccdb26bd17d055a679b7ff86efc54050b. machine # [ 544.260726] dhcpcd[689]: veth8fdb2702: soliciting a DHCP lease machine # [ 544.268919] systemd[1]: var-lib-kubelet-pods-7c0577dd\x2d86ad\x2d445f\x2d8999\x2da3fd81b73b95-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 544.269773] systemd[1]: var-lib-kubelet-pods-7c0577dd\x2d86ad\x2d445f\x2d8999\x2da3fd81b73b95-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 544.270805] systemd[1]: var-lib-kubelet-pods-7c0577dd\x2d86ad\x2d445f\x2d8999\x2da3fd81b73b95-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 544.271853] systemd[1]: var-lib-kubelet-pods-7c0577dd\x2d86ad\x2d445f\x2d8999\x2da3fd81b73b95-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 544.272773] systemd[1]: var-lib-kubelet-pods-7c0577dd\x2d86ad\x2d445f\x2d8999\x2da3fd81b73b95-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 544.869952] k3s[893]: I1005 09:55:51.280780 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-5845f9d694-64r7k" podStartSLOduration=2.280740507 podStartE2EDuration="2.280740507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 09:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 09:55:50.499697106 +0000 UTC m=+526.295450061" watchObservedRunningTime="2026-10-05 09:55:51.280740507 +0000 UTC m=+527.076497931" machine # [ 545.551140] dhcpcd[689]: veth8fdb2702: soliciting an IPv6 router machine # [ 545.633185] k3s[893]: I1005 09:55:52.044855 893 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c0577dd-86ad-445f-8999-a3fd81b73b95" path="/var/lib/kubelet/pods/7c0577dd-86ad-445f-8999-a3fd81b73b95/volumes" machine # [ 545.713285] nix[10265]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 546.754359] nix[10265]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 546.754546] nix[10265]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-2dknj: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 549.261588] dhcpcd[689]: veth8fdb2702: probing for an IPv4LL address machine # [ 553.927905] dhcpcd[689]: veth8fdb2702: using IPv4LL address 169.254.87.187 machine # [ 553.929459] dhcpcd[689]: veth8fdb2702: adding route to 169.254.0.0/16 machine # [ 557.556230] dhcpcd[689]: veth8fdb2702: no IPv6 Routers available machine # [ 591.090110] niks3-server[1198]: 2026/10/05 09:56:37 INFO Received push request method=POST path=/api/pushes machine # [ 591.106584] niks3-server[1198]: 2026/10/05 09:56:37 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 591.109370] niks3-server[1198]: 2026/10/05 09:56:37 INFO Signed narinfos id=28 count=1 machine # [ 591.113226] niks3-server[1198]: 2026/10/05 09:56:37 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 591.114519] niks3-server[1198]: 2026/10/05 09:56:37 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 591.123430] niks3-server[1198]: 2026/10/05 09:56:37 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 591.127955] niks3-server[1198]: 2026/10/05 09:56:37 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 591.157484] systemd[1]: vialb.service: Deactivated successfully. machine # [ 591.158694] systemd[1]: vialb.service: Consumed 203ms CPU time over 49.236s wall clock time, 42.5M memory peak, 4K written to disk, 8.5K incoming IP traffic, 17.3K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.76 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.19 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.27 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 592.199747] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 4cbe1253fef54330b3ce8bc5aed80e37 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.03 seconds) machine # [ 592.336783] nix[11276]: don't know how to build these paths: machine # [ 592.337840] nix[11276]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 592.358758] nix[11276]: copying 1 paths to '127.0.0.1:30051'... machine # [ 592.359802] nix[11276]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # command terminated with exit code 1 machine # [ 592.401714] k3s[893]: E1005 09:56:38.811284 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41286: use of closed network connection" machine # [ 592.405947] niks3-server[1198]: 2026/10/05 09:56:38 INFO Received push request method=POST path=/api/pushes machine # [ 592.417423] niks3-server[1198]: 2026/10/05 09:56:38 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 592.419956] niks3-server[1198]: 2026/10/05 09:56:38 INFO Signed narinfos id=29 count=1 machine # [ 592.423427] niks3-server[1198]: 2026/10/05 09:56:38 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 592.425386] niks3-server[1198]: 2026/10/05 09:56:38 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 592.427748] niks3-server[1198]: 2026/10/05 09:56:38 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 592.429793] niks3-server[1198]: 2026/10/05 09:56:38 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 592.443074] nix[11276]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 592.444616] nix[11276]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 592.589688] k3s[893]: E1005 09:56:39.001373 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:41294: use of closed network connection" machine # command terminated with exit code 1 machine # [ 593.874366] k3s[893]: E1005 09:56:40.285626 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51916: use of closed network connection" machine # command terminated with exit code 1 machine # [ 594.087300] k3s[893]: E1005 09:56:40.498954 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51930: use of closed network connection" machine # command terminated with exit code 1 machine # [ 595.403864] k3s[893]: E1005 09:56:41.815214 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51942: use of closed network connection" machine # command terminated with exit code 1 machine # [ 595.620036] k3s[893]: E1005 09:56:42.031600 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51956: use of closed network connection" machine # command terminated with exit code 1 machine # [ 596.941256] k3s[893]: E1005 09:56:43.352532 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51972: use of closed network connection" machine # command terminated with exit code 1 machine # [ 597.143757] k3s[893]: E1005 09:56:43.555422 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51982: use of closed network connection" machine # command terminated with exit code 1 machine # [ 598.365823] k3s[893]: E1005 09:56:44.776964 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51984: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 598.574256] k3s[893]: E1005 09:56:44.985335 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:51994: use of closed network connection" machine # command terminated with exit code 1 machine # [ 599.851031] k3s[893]: E1005 09:56:46.262274 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52002: use of closed network connection" machine # [ 600.062181] k3s[893]: E1005 09:56:46.473852 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52008: use of closed network connection" machine # command terminated with exit code 1 machine # [ 601.353889] k3s[893]: E1005 09:56:47.765215 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52024: use of closed network connection" machine # command terminated with exit code 1 machine # [ 601.558790] k3s[893]: E1005 09:56:47.970389 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52036: use of closed network connection" machine # command terminated with exit code 1 machine # [ 602.793441] k3s[893]: E1005 09:56:49.204738 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:52048: use of closed network connection" machine # command terminated with exit code 1 machine # [ 602.994837] k3s[893]: E1005 09:56:49.406460 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56024: use of closed network connection" machine # command terminated with exit code 1 machine # [ 604.267290] k3s[893]: E1005 09:56:50.678621 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56040: use of closed network connection" machine # command terminated with exit code 1 machine # [ 604.475224] k3s[893]: E1005 09:56:50.886888 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56054: use of closed network connection" machine # command terminated with exit code 1 machine # [ 605.758345] k3s[893]: E1005 09:56:52.169578 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56056: use of closed network connection" machine # command terminated with exit code 1 machine # [ 605.966866] k3s[893]: E1005 09:56:52.378517 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56060: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 607.268364] k3s[893]: E1005 09:56:53.679407 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56062: use of closed network connection" machine # [ 607.482075] k3s[893]: E1005 09:56:53.893702 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56066: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 608.758054] k3s[893]: E1005 09:56:55.168660 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56076: use of closed network connection" machine # [ 608.989630] k3s[893]: E1005 09:56:55.401309 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56092: use of closed network connection" machine # command terminated with exit code 1 machine # [ 610.225727] postgres[762]: [762] LOG: checkpoint starting: time machine # command terminated with exit code 1 machine # [ 610.304077] k3s[893]: E1005 09:56:56.714987 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56100: use of closed network connection" machine # [ 610.494619] k3s[893]: E1005 09:56:56.906211 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56102: use of closed network connection" machine # command terminated with exit code 1 machine # [ 611.787645] k3s[893]: E1005 09:56:58.198900 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56116: use of closed network connection" machine # command terminated with exit code 1 machine # [ 611.996046] k3s[893]: E1005 09:56:58.407697 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:56128: use of closed network connection" machine # command terminated with exit code 1 machine # [ 613.169285] postgres[762]: [762] LOG: checkpoint complete: wrote 29 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.916 s, sync=0.010 s, total=2.944 s; sync files=25, longest=0.003 s, average=0.001 s; distance=284 kB, estimate=4544 kB; lsn=0/1C93BD8, redo lsn=0/1C93B48 machine # [ 613.300977] k3s[893]: E1005 09:56:59.712311 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59856: use of closed network connection" machine # command terminated with exit code 1 machine # [ 613.510043] k3s[893]: E1005 09:56:59.921430 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59866: use of closed network connection" machine # command terminated with exit code 1 machine # [ 614.802887] k3s[893]: E1005 09:57:01.214029 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59870: use of closed network connection" machine # command terminated with exit code 1 machine # [ 615.012778] k3s[893]: E1005 09:57:01.423622 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59880: use of closed network connection" machine # command terminated with exit code 1 machine # [ 616.317611] k3s[893]: E1005 09:57:02.728986 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59890: use of closed network connection" machine # command terminated with exit code 1 machine # [ 616.505416] k3s[893]: E1005 09:57:02.917077 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59900: use of closed network connection" machine # command terminated with exit code 1 machine # [ 617.759119] k3s[893]: E1005 09:57:04.170408 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59914: use of closed network connection" machine # command terminated with exit code 1 machine # [ 617.952778] k3s[893]: E1005 09:57:04.364424 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59922: use of closed network connection" machine # [ 618.141288] k3s[893]: E1005 09:57:04.552948 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59938: use of closed network connection" machine # command terminated with exit code 1 machine # [ 618.326195] k3s[893]: E1005 09:57:04.737789 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:59946: use of closed network connection" machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8 --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-76f879b8c5-lt8f8 --wait=false, in 0.14 seconds) machine: must succeed: sleep 5.0 machine # [ 618.523528] systemd[1]: cri-containerd-05cb45b3bbd9839d824d7d520d090812ba915b82142284c1c71c9ecc29481c9f.scope: Deactivated successfully. machine # [ 618.524229] systemd[1]: cri-containerd-05cb45b3bbd9839d824d7d520d090812ba915b82142284c1c71c9ecc29481c9f.scope: Consumed 534ms CPU time over 9min 18.117s wall clock time, 12.4M memory peak, 5.2M read from disk. machine # [ 618.552579] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod780a39ff_c923_4658_9bf5_21709c9ccf51.slice. machine # [ 618.583272] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-05cb45b3bbd9839d824d7d520d090812ba915b82142284c1c71c9ecc29481c9f-rootfs.mount: Deactivated successfully. machine # [ 618.647171] k3s[893]: I1005 09:57:05.058847 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/780a39ff-c923-4658-9bf5-21709c9ccf51-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f\" (UID: \"780a39ff-c923-4658-9bf5-21709c9ccf51\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" machine # [ 618.647881] k3s[893]: I1005 09:57:05.059365 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdlxm\" (UniqueName: \"kubernetes.io/projected/780a39ff-c923-4658-9bf5-21709c9ccf51-kube-api-access-cdlxm\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f\" (UID: \"780a39ff-c923-4658-9bf5-21709c9ccf51\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" machine # [ 618.649330] k3s[893]: I1005 09:57:05.059405 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/780a39ff-c923-4658-9bf5-21709c9ccf51-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f\" (UID: \"780a39ff-c923-4658-9bf5-21709c9ccf51\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" machine # [ 618.650131] k3s[893]: I1005 09:57:05.060623 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/780a39ff-c923-4658-9bf5-21709c9ccf51-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f\" (UID: \"780a39ff-c923-4658-9bf5-21709c9ccf51\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" machine # [ 618.650823] k3s[893]: I1005 09:57:05.060648 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/780a39ff-c923-4658-9bf5-21709c9ccf51-build\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f\" (UID: \"780a39ff-c923-4658-9bf5-21709c9ccf51\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" machine # [ 618.651750] k3s[893]: I1005 09:57:05.060689 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/780a39ff-c923-4658-9bf5-21709c9ccf51-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f\" (UID: \"780a39ff-c923-4658-9bf5-21709c9ccf51\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" machine # [ 618.652421] k3s[893]: I1005 09:57:05.060732 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/780a39ff-c923-4658-9bf5-21709c9ccf51-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f\" (UID: \"780a39ff-c923-4658-9bf5-21709c9ccf51\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" machine # [ 618.652924] k3s[893]: I1005 09:57:05.060762 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/780a39ff-c923-4658-9bf5-21709c9ccf51-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f\" (UID: \"780a39ff-c923-4658-9bf5-21709c9ccf51\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" machine # [ 618.653700] k3s[893]: I1005 09:57:05.060830 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/780a39ff-c923-4658-9bf5-21709c9ccf51-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f\" (UID: \"780a39ff-c923-4658-9bf5-21709c9ccf51\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" machine # [ 619.088264] cni0: port 4(veth8e2ebaf4) entered blocking state machine # [ 619.090517] cni0: port 4(veth8e2ebaf4) entered disabled state machine # [ 619.092569] veth8e2ebaf4: entered allmulticast mode machine # [ 619.094851] veth8e2ebaf4: entered promiscuous mode machine # [ 619.111979] cni0: port 4(veth8e2ebaf4) entered blocking state machine # [ 619.113282] cni0: port 4(veth8e2ebaf4) entered forwarding state machine # [ 618.991863] (udev-worker)[12955]: Network interface NamePolicy= disabled on kernel command line. machine # [ 619.021683] dhcpcd[689]: veth8e2ebaf4: IAID 9e:b6:c4:28 machine # [ 619.022146] dhcpcd[689]: veth8e2ebaf4: adding address fe80::e42f:9eff:feb6:c428 machine # [ 619.064337] systemd[1]: Started libcontainer container 467acb903cc77c90f25816230701967bfc7ea74e99e8e2b2accdd7df6e411b1d. machine # [ 619.262567] systemd[1]: Started libcontainer container 0944064fca5c6aaea4aecc05052a0e8681db73767d9cd5cbb70c932c6e67b9eb. machine # [ 619.712619] dhcpcd[689]: veth8e2ebaf4: soliciting a DHCP lease machine # [ 620.717680] k3s[893]: I1005 09:57:07.128452 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 621.133596] dhcpcd[689]: veth8e2ebaf4: soliciting an IPv6 router machine # [ 621.716630] systemd[1]: cri-containerd-0944064fca5c6aaea4aecc05052a0e8681db73767d9cd5cbb70c932c6e67b9eb.scope: Deactivated successfully. machine # [ 621.717524] systemd[1]: cri-containerd-0944064fca5c6aaea4aecc05052a0e8681db73767d9cd5cbb70c932c6e67b9eb.scope: Consumed 1.198s CPU time over 2.451s wall clock time, 463.8M memory peak, 177.2M read from disk, 158.2M written to disk. machine # [ 621.776515] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-0944064fca5c6aaea4aecc05052a0e8681db73767d9cd5cbb70c932c6e67b9eb-rootfs.mount: Deactivated successfully. machine # [ 622.343137] systemd[1]: tmp-ovl\x2didmapped275584916.mount: Deactivated successfully. machine # [ 622.364436] systemd[1]: Started libcontainer container 7530013b284bcc573ed8595d67d34228dc95b2304343333f17cc6ec5fc803a27. machine # [ 622.547317] systemd[1]: Started libcontainer container 655ad284e1a33e430d006e2d37486ca35ea86a9af0dbb986dbeaef3672700c03. machine # [ 622.749797] systemd[1]: Started libcontainer container 4be732db413025ea61409651f5608105fffcc5951f5e01dd9dd9c195389a8c16. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 623.758249] k3s[893]: E1005 09:57:10.169357 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42382: use of closed network connection" machine # command terminated with exit code 1 machine # [ 623.891138] k3s[893]: I1005 09:57:10.302513 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-76f879b8c5-dk62f" podStartSLOduration=3.8944388869999997 podStartE2EDuration="6.30249019s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.408051303s" isStatefulPod=false podCreationTimestamp="2026-10-05 09:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 09:57:09.243123427 +0000 UTC m=+605.038876381" watchObservedRunningTime="2026-10-05 09:57:10.30249019 +0000 UTC m=+606.098243144" machine # [ 623.969373] k3s[893]: E1005 09:57:10.381035 893 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:42388: use of closed network connection" machine: waiting for success: ! systemctl is-active slow machine # [ 624.715077] dhcpcd[689]: veth8e2ebaf4: probing for an IPv4LL address machine # [ 629.284897] dhcpcd[689]: veth8e2ebaf4: using IPv4LL address 169.254.99.235 machine # [ 629.286639] dhcpcd[689]: veth8e2ebaf4: adding route to 169.254.0.0/16 machine # [ 633.138563] dhcpcd[689]: veth8e2ebaf4: no IPv6 Routers available machine # [ 636.771852] niks3-server[1198]: 2026/10/05 09:57:23 INFO Received push request method=POST path=/api/pushes machine # [ 636.793604] niks3-server[1198]: 2026/10/05 09:57:23 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 636.794642] niks3-server[1198]: 2026/10/05 09:57:23 INFO Signed narinfos id=30 count=1 machine # [ 636.798495] niks3-server[1198]: 2026/10/05 09:57:23 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 636.804706] niks3-server[1198]: 2026/10/05 09:57:23 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 636.810572] niks3-server[1198]: 2026/10/05 09:57:23 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 636.814970] niks3-server[1198]: 2026/10/05 09:57:23 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 636.849593] systemd[1]: slow.service: Deactivated successfully. machine # [ 636.851560] systemd[1]: slow.service: Consumed 172ms CPU time over 44.649s wall clock time, 42.6M memory peak, 4K written to disk, 5.3K incoming IP traffic, 11.7K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 13.57 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.15 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.62 seconds) (finished: run the VM test script, in 638.70 seconds) test script finished in 638.77s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-10-05T09:57:25Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-10-05T09:57:25Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-10-05T09:57:25Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.25 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh