tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.a7bVNFUDty', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 90bc52e3-caea-4334-8e94-d4f1220db5b4 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-10-05T08:28:13Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T08:28:13Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T08:28:13Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T08:28:13Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T08:28:13Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T08:28:13Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T08:28:13Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-10-05T08:28:13Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-10-05T08:28:13Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-10-05T08:28:13Z INFO virtiofsd] Client connected, servicing requests machine # [2026-10-05T08:28:13Z INFO virtiofsd] Client connected, servicing requests machine # [2026-10-05T08:28:13Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.53 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 21 13:06:06 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2ckszpzvpklrfkgmq385kgp9pqq6rigq-nixos-system-machine-test/init regInfo=/nix/.ro-store/gk5blga2zci8kz73qps2iafxpsbi5cnp-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000001] kvm-clock: using sched offset of 501183776 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000817] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000844] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000846] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000885] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002746] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002757] Using GB pages for direct mapping machine # [ 0.002826] RAMDISK: [mem 0x7e364000-0x7ffcffff] machine # [ 0.002835] ACPI: Early table checksum verification disabled machine # [ 0.002838] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002842] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002846] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002854] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002856] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002857] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002859] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002861] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002862] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002863] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002864] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002865] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002865] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002866] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002866] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002867] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003105] No NUMA configuration found machine # [ 0.003106] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003108] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005629] Zone ranges: machine # [ 0.005630] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005631] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005632] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005633] Device empty machine # [ 0.005634] Movable zone start for each node machine # [ 0.005634] Early memory node ranges machine # [ 0.005635] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005636] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005636] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005637] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005662] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005946] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.077485] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.077968] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.077984] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.078020] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.078023] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.078024] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.078026] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.078027] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.078028] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.078030] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.078031] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.078037] TSC deadline timer available machine # [ 0.078041] CPU topo: Max. logical packages: 1 machine # [ 0.078042] CPU topo: Max. logical dies: 1 machine # [ 0.078043] CPU topo: Max. dies per package: 1 machine # [ 0.078046] CPU topo: Max. threads per core: 1 machine # [ 0.078046] CPU topo: Num. cores per package: 4 machine # [ 0.078047] CPU topo: Num. threads per package: 4 machine # [ 0.078047] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.078073] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.078089] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.078092] kvm-guest: setup PV sched yield machine # [ 0.078102] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.078104] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.078105] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.078106] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.078108] Booting paravirtualized kernel on KVM machine # [ 0.078112] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.082585] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.084756] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.084803] kvm-guest: PV spinlocks enabled machine # [ 0.084805] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.084808] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2ckszpzvpklrfkgmq385kgp9pqq6rigq-nixos-system-machine-test/init regInfo=/nix/.ro-store/gk5blga2zci8kz73qps2iafxpsbi5cnp-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.084908] Unknown kernel command line parameters "regInfo=/nix/.ro-store/gk5blga2zci8kz73qps2iafxpsbi5cnp-closure-info/registration", will be passed to user space. machine # [ 0.084921] random: crng init done machine # [ 0.084921] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.089351] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.091450] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.091524] software IO TLB: area num 4. machine # [ 0.164760] Fallback order for Node 0: 0 machine # [ 0.164769] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.164771] Policy zone: Normal machine # [ 0.167548] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.174544] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.183588] allocated 8388608 bytes of page_ext machine # [ 0.193614] ftrace: allocating 48798 entries in 192 pages machine # [ 0.193617] ftrace: allocated 192 pages with 2 groups machine # [ 0.194478] Dynamic Preempt: lazy machine # [ 0.194638] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.194639] rcu: RCU event tracing is enabled. machine # [ 0.194640] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.194641] Trampoline variant of Tasks RCU enabled. machine # [ 0.194642] Rude variant of Tasks RCU enabled. machine # [ 0.194642] Tracing variant of Tasks RCU enabled. machine # [ 0.194643] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.194644] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.194670] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.194672] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.194673] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.199057] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.199343] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.199349] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.199465] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.203181] Console: colour VGA+ 80x25 machine # [ 0.203185] printk: legacy console [tty0] enabled machine # [ 0.234889] printk: legacy console [ttyS0] enabled machine # [ 0.348488] ACPI: Core revision 20250807 machine # [ 0.349463] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.351176] APIC: Switch to symmetric I/O mode setup machine # [ 0.352190] x2apic enabled machine # [ 0.352952] APIC: Switched APIC routing to: physical x2apic machine # [ 0.353918] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.355193] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.356709] kvm-guest: setup PV IPIs machine # [ 0.358299] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.359355] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.363629] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.365627] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.366755] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.367626] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.368630] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.369626] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.370626] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.371626] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.372626] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.373625] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.375633] Spectre V2 : Enabling IBPB for BPF machine # [ 0.376415] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.377626] active return thunk: srso_alias_return_thunk machine # [ 0.378647] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.379626] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.380626] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.382464] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.383462] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.384625] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.385626] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.386626] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.387626] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.388625] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.389625] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.391442] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.392436] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.422412] Freeing SMP alternatives memory: 44K machine # [ 0.423228] pid_max: default: 32768 minimum: 301 machine # [ 0.423729] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.424732] landlock: Up and running. machine # [ 0.425457] Yama: becoming mindful. machine # [ 0.426840] LSM support for eBPF active machine # [ 0.427763] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.428700] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.432061] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.433200] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.433635] ... version: 2 machine # [ 0.434405] ... bit width: 48 machine # [ 0.434628] ... generic counters: 6 machine # [ 0.435390] ... generic bitmap: 000000000000003f machine # [ 0.435628] ... fixed-purpose counters: 0 machine # [ 0.436379] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.436628] ... value mask: 0000ffffffffffff machine # [ 0.437559] ... max period: 00007fffffffffff machine # [ 0.438373] ... global_ctrl mask: 000000000000003f machine # [ 0.438733] signal: max sigframe size: 3376 machine # [ 0.439582] rcu: Hierarchical SRCU implementation. machine # [ 0.440285] rcu: Max phase no-delay instances is 400. machine # [ 0.440820] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.446232] smp: Bringing up secondary CPUs ... machine # [ 0.447093] smpboot: x86: Booting SMP configuration: machine # [ 0.447631] .... node #0, CPUs: #1 #2 #3 machine # [ 0.450791] smp: Brought up 1 node, 4 CPUs machine # [ 0.452345] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.452898] Memory: 3957548K/4193752K available (17259K kernel code, 2728K rwdata, 13652K rodata, 3656K init, 2968K bss, 220900K reserved, 0K cma-reserved) machine # [ 0.454038] devtmpfs: initialized machine # [ 0.455267] x86/mm: Memory block size: 128MB machine # [ 0.458900] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.459714] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.460729] pinctrl core: initialized pinctrl subsystem machine # [ 0.461918] PM: RTC time: 08:28:13, date: 2026-10-05 machine # [ 0.465772] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.467749] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.468669] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.470230] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.470639] audit: initializing netlink subsys (disabled) machine # [ 0.471691] audit: type=2000 audit(1791188894.208:1): state=initialized audit_enabled=0 res=1 machine # [ 0.472006] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.473629] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.474628] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.475628] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.476628] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.477650] cpuidle: using governor menu machine # [ 0.479845] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.480925] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.481633] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.482660] PCI: Using configuration type 1 for base access machine # [ 0.483811] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.485701] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.486629] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.487629] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.488628] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.492143] ACPI: Added _OSI(Module Device) machine # [ 0.493633] ACPI: Added _OSI(Processor Device) machine # [ 0.494490] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.498848] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.504178] ACPI: Interpreter enabled machine # [ 0.504414] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.505632] ACPI: Using IOAPIC for interrupt routing machine # [ 0.506765] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.507630] PCI: Using E820 reservations for host bridge windows machine # [ 0.509851] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.515932] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.516640] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.518740] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.519788] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.522170] PCI host bridge to bus 0000:00 machine # [ 0.522635] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.523632] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.524631] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.526638] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.527632] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.529632] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.530633] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.531845] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.534167] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.552711] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.554677] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.555657] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.558199] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.560573] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.565668] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.566637] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.568750] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.571653] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.575986] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.587673] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.590651] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.592689] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.598069] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.606653] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.608652] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.610690] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.615303] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.621690] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.623645] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.625676] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.628646] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.631779] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.638690] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.639652] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.642716] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.645675] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.647652] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.650280] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.652676] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.674697] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.677321] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.681493] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.682455] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.684199] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.688676] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.689628] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.690652] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.693215] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.695669] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.696578] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.698468] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.700204] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.702280] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.703848] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.707733] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.710651] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.716718] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.719214] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.724670] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.728254] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.732374] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.736263] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.742730] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.745652] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.748363] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.752609] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.756792] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.757765] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.759737] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.760730] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.761740] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.762733] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.763731] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.764741] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.765685] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.766651] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.768643] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.769644] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.770642] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.771844] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.772653] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.774668] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.781941] iommu: Default domain type: Translated machine # [ 0.783634] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.788005] ACPI: bus type USB registered machine # [ 0.789832] usbcore: registered new interface driver usbfs machine # [ 0.791667] usbcore: registered new interface driver hub machine # [ 0.794656] usbcore: registered new device driver usb machine # [ 0.799901] NetLabel: Initializing machine # [ 0.801635] NetLabel: domain hash size = 128 machine # [ 0.802632] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.805844] NetLabel: unlabeled traffic allowed by default machine # [ 0.807664] PCI: Using ACPI for IRQ routing machine # [ 0.868860] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.869624] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.869624] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.871639] vgaarb: loaded machine # [ 0.872461] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.873275] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.879785] clocksource: Switched to clocksource kvm-clock machine # [ 0.885559] VFS: Disk quotas dquot_6.6.0 machine # [ 0.886350] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.888004] pnp: PnP ACPI init machine # [ 0.888863] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.889865] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.891516] pnp: PnP ACPI: found 5 devices machine # [ 0.901754] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.903379] clocksource: Switched to clocksource acpi_pm machine # [ 0.904452] NET: Registered PF_INET protocol family machine # [ 0.905984] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.923271] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.924872] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.926294] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.929048] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.930396] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.931628] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.932964] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.934141] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.935647] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.936712] NET: Registered PF_XDP protocol family machine # [ 0.937632] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.938710] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.939791] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.940966] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.942104] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.943340] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.945329] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.947600] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.949674] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.951755] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.953542] PCI: CLS 0 bytes, default 64 machine # [ 0.954435] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.954977] Trying to unpack rootfs image as initramfs... machine # [ 0.955551] software IO TLB: mapped [mem 0x000000007a364000-0x000000007e364000] (64MB) machine # [ 0.955744] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.979159] Initialise system trusted keyrings machine # [ 0.980391] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.991597] Key type asymmetric registered machine # [ 0.992359] Asymmetric key parser 'x509' registered machine # [ 0.993267] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.995008] io scheduler mq-deadline registered machine # [ 0.995831] io scheduler kyber registered machine # [ 1.000012] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 1.001386] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 1.003885] Linux agpgart interface v0.103 machine # [ 1.004694] ACPI: bus type drm_connector registered machine # [ 1.007056] usbcore: registered new interface driver usbserial_generic machine # [ 1.008175] usbserial: USB Serial support registered for generic machine # [ 1.009222] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 1.009222] Please enable it if your BIOS has the CPPC option. machine # [ 1.011567] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 1.013063] drop_monitor: Initializing network drop monitor service machine # [ 1.014302] NET: Registered PF_INET6 protocol family machine # [ 1.016016] Segment Routing with IPv6 machine # [ 1.016720] In-situ OAM (IOAM) with IPv6 machine # [ 1.018846] IPI shorthand broadcast: enabled machine # [ 1.023324] sched_clock: Marking stable (868010392, 155275789)->(1048322888, -25036707) machine # [ 1.025179] registered taskstats version 1 machine # [ 1.026290] Loading compiled-in X.509 certificates machine # [ 1.036229] Demotion targets for Node 0: null machine # [ 1.037452] Key type .fscrypt registered machine # [ 1.038174] Key type fscrypt-provisioning registered machine # [ 1.039176] ima: No TPM chip found, activating TPM-bypass! machine # [ 1.040137] ima: Allocated hash algorithm: sha1 machine # [ 1.040981] ima: No architecture policies found machine # [ 1.042077] PM: Magic number: 14:173:472 machine # [ 1.042867] acpi LNXSYSTM:00: hash matches machine # [ 1.044519] RAS: Correctable Errors collector initialized. machine # [ 1.049016] clk: Disabling unused clocks machine # [ 1.049734] PM: genpd: Disabling unused power domains machine # [ 1.271180] Freeing initrd memory: 29104K machine # [ 1.275580] Freeing unused decrypted memory: 2028K machine # [ 1.278597] Freeing unused kernel image (initmem) memory: 3656K machine # [ 1.279799] Write protecting the kernel read-only data: 32768k machine # [ 1.281985] Freeing unused kernel image (text/rodata gap) memory: 1172K machine # [ 1.283682] Freeing unused kernel image (rodata/data gap) memory: 684K machine # [ 1.334634] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.335797] Run /init as init process machine # [ 1.349074] systemd[1]: Inserted module 'autofs4' machine # [ 1.388924] fuse: init (API version 7.45) machine # [ 1.410741] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.417069] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.424273] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.429476] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.437491] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.439162] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.458641] virtiofs virtio6: discovered new tag: shared machine # [ 1.460391] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.464849] virtiofs virtio7: discovered new tag: xchg machine # [ 1.466648] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.493734] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.829715] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.838503] systemd[1]: Detected virtualization kvm. machine # [ 1.841045] systemd[1]: Detected architecture x86-64. machine # [ 1.843570] systemd[1]: Running in initrd. machine # [ 1.846490] systemd[1]: Initializing machine ID from random generator. machine # [ 1.849906] systemd[1]: Hostname set to . machine # [ 1.969954] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 2.012848] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 2.022072] systemd[1]: Created slice Slice /system/modprobe. machine # [ 2.023411] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 2.025003] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 2.026262] systemd[1]: Reached target Path Units. machine # [ 2.027264] systemd[1]: Reached target Slice Units. machine # [ 2.028271] systemd[1]: Reached target Swaps. machine # [ 2.029229] systemd[1]: Reached target Timer Units. machine # [ 2.030405] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 2.031817] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 2.033104] systemd[1]: Listening on Journal Sockets. machine # [ 2.034225] systemd[1]: Listening on udev Control Socket. machine # [ 2.035412] systemd[1]: Listening on udev Kernel Socket. machine # [ 2.036491] systemd[1]: Reached target Socket Units. machine # [ 2.038835] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 2.041182] systemd[1]: Starting Load Kernel Module configfs... machine # [ 2.044364] systemd[1]: Starting Journal Service... machine # [ 2.056243] systemd[1]: Starting Load Kernel Modules... machine # [ 2.058788] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 2.064516] systemd[1]: Starting Coldplug All udev Devices... machine # [ 2.069834] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 2.070043] systemd-journald[89]: Collecting audit messages is disabled. machine # [ 2.072201] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 2.076537] systemd[1]: Finished Load Kernel Module configfs. machine # [ 2.080009] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 2.086509] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 2.109524] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.111943] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.957223] systemd-modules-load[92]: Using 4 probe threads machine # [ 2.113616] systemd[1]: Started Journal Service. machine # [ 1.959812] systemd-modules-load[92]: Inserted module 'virtio_balloon' machine # [ 1.961820] systemd-modules-load[92]: Inserted module 'virtio_gpu' machine # [ 1.962909] systemd-modules-load[92]: Inserted module 'dm_mod' machine # [ 1.963880] systemd[1]: Finished Load Kernel Modules. machine # [ 1.964828] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.968351] systemd[1]: Starting Apply Kernel Variables... machine # [ 1.970539] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.983893] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.986100] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.987682] systemd[1]: Reached target Local File Systems. machine # [ 1.988514] systemd[1]: Starting Create System Files and Directories... machine # [ 1.989412] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.991588] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.998549] systemd[1]: Finished Create System Files and Directories. machine # [ 2.008833] systemd-udevd[107]: Using default interface naming scheme 'v261'. machine # [ 2.018965] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 2.051481] systemd[1]: Finished Coldplug All udev Devices. machine # [ 2.052500] systemd[1]: Reached target System Initialization. machine # [ 2.053404] systemd[1]: Reached target Basic System. machine # [ 2.295405] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.295520] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.296082] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.298670] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.299569] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.300685] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.302069] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.303246] usb usb1: Product: UHCI Host Controller machine # [ 2.303987] usb usb1: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.304841] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.310255] hub 1-0:1.0: USB hub found machine # [ 2.310469] SCSI subsystem initialized machine # [ 2.311530] hub 1-0:1.0: 2 ports detected machine # [ 2.313840] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.318031] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.319697] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.321570] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.329324] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.331248] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.332542] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.333729] usb usb2: Product: EHCI Host Controller machine # [ 2.334720] usb usb2: Manufacturer: Linux 6.18.53 ehci_hcd machine # [ 2.335672] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.337486] hub 2-0:1.0: USB hub found machine # [ 2.338097] hub 2-0:1.0: 6 ports detected machine # [ 2.190875] systemd[1]: Starting Virtual Console Setup... machine # [ 2.360576] hub 1-0:1.0: USB hub found machine # [ 2.361254] hub 1-0:1.0: 2 ports detected machine # [ 2.363007] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.363820] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.364997] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.366654] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.368814] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.369676] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.215354] (udev-worker)[113]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.217899] systemd-vconsole-setup[140]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.374923] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.220770] (udev-worker)[113]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.377912] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.223440] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line.[ 2.379254] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # machine # [ 2.381549] usb usb3: Product: UHCI Host Controller machine # [ 2.382379] usb usb3: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.227294] systemd[1]: Finished Virtual Console Setup. machine # [ 2.383836] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.388613] hub 3-0:1.0: USB hub found machine # [ 2.390076] hub 3-0:1.0: 2 ports detected machine # [ 2.392799] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.393608] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.394752] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.395689] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.240681] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.242389] systemd[1]: Reach[ 2.397036] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # ed target Initrd Root Device. machine # [ 2.399036] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.246688] systemd[1]: Start[ 2.401876] usb usb4: Product: UHCI Host Controller machine # ing File System Check on /dev/disk/by-label/nixos... machine # [ 2.403149] usb usb4: Manufacturer: Linux 6.18.53 uhci_hcd machine # [ 2.404461] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.405681] hub 4-0:1.0: USB hub found machine # [ 2.406356] hub 4-0:1.0: 2 ports detected machine # [ 2.406666] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.420421] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.422042] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.423161] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.426204] scsi host0: ahci machine # [ 2.271898] systemd-fsck[149]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.427139] scsi host1: ahci machine # [ 2.429178] scsi host2: ahci machine # [ 2.430030] scsi host3: ahci machine # [ 2.275692] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.431502] scsi host4: ahci machine # [ 2.433351] scsi host5: ahci machine # [ 2.434037] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.435337] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.436573] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.437923] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.439644] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.441214] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.580483] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.713066] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.716313] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.719023] usb 2-1: Product: QEMU USB Tablet machine # [ 2.720728] usb 2-1: Manufacturer: QEMU machine # [ 2.722251] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.754528] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.756898] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.759226] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.760327] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.762830] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.765630] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.768233] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.770429] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.772537] ata3.00: applying bridge limits machine # [ 2.774423] ata3.00: configured for UDMA/100 machine # [ 2.776988] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.806963] usbcore: registered new interface driver usbhid machine # [ 2.809100] usbhid: USB HID core driver machine # [ 2.819409] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.823550] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.845839] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.877579] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.915392] systemd[1]: Mounting /sysroot... machine # [ 3.211238] EXT4-fs (vda): mounted filesystem 90bc52e3-caea-4334-8e94-d4f1220db5b4 r/w with ordered data mode. Quota mode: none. machine # [ 3.063536] systemd[1]: Mounted /sysroot. machine # [ 3.065469] systemd[1]: Reached target Initrd Root File System. machine # [ 3.067938] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 3.070134] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.079761] systemd[1]: Mounting /sysroot/run... machine # [ 3.084695] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.089501] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.091589] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.096642] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.098490] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.100285] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.103364] systemd[1]: Mounted /sysroot/run. machine # [ 3.106478] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.109284] systemd-sysroot-fstab-check[190]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.112097] systemd[1]: Reload requested from client PID 190 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.115337] systemd[1]: Reloading... machine # [ 3.171264] systemd[1]: Reloading finished in 60 ms. machine # [ 3.199765] systemd-sysroot-fstab-check[190]: Requesting initrd-fs.target/start/replace... machine # [ 3.202341] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.204110] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.206660] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.208766] systemd-sysroot-fstab-check[190]: Requesting swap.target/start/replace... machine # [ 3.211304] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.213325] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.215628] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.217802] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.232210] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.234594] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.916754] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.969854] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.971995] systemd[1]: Reached target Initrd File Systems. machine # [ 3.974152] systemd[1]: Starting Find NixOS closure... machine # [ 3.976124] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 4.000177] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 4.004215] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 4.014319] systemd[1]: Finished Find NixOS closure. machine # [ 4.016216] systemd[1]: Reached target Initrd Default Target. machine # [ 4.018291] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 4.053105] systemd[1]: Stopped target Initrd Default Target. machine # [ 4.055238] systemd[1]: Stopped target Basic System. machine # [ 4.056971] systemd[1]: Stopped target Initrd Root Device. machine # [ 4.058979] systemd[1]: Stopped target Path Units. machine # [ 4.060760] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 4.063730] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 4.066367] systemd[1]: Stopped target Slice Units. machine # [ 4.068130] systemd[1]: Stopped target Socket Units. machine # [ 4.069867] systemd[1]: Stopped target System Initialization. machine # [ 4.072838] systemd[1]: Stopped target Swaps. machine # [ 4.074438] systemd[1]: Stopped target Timer Units. machine # [ 4.077122] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 4.079758] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 4.081937] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 4.084658] systemd[1]: Stopped Find NixOS closure. machine # [ 4.086869] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 4.088820] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 4.090926] systemd[1]: Stopped Apply Kernel Variables. machine # [ 4.092624] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 4.095116] systemd[1]: Stopped Load Kernel Modules. machine # [ 4.096816] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 4.099159] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 4.101255] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 4.103181] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.104740] systemd[1]: Stopped target Local File Systems. machine # [ 4.106137] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.107803] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.109617] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.110952] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.112752] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.114570] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.115845] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.117522] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.118630] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.119661] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.120507] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.121491] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.122496] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.123550] systemd[1]: Closed udev Control Socket. machine # [ 4.124405] systemd[1]: Starting Cleanup udev Database... machine # [ 4.125227] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.126299] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.127179] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.128257] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.129278] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.130327] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.142384] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.143531] systemd[1]: Finished Cleanup udev Database. machine # [ 4.144377] systemd[1]: Reached target Switch Root. machine # [ 4.145240] systemd[1]: Starting NixOS Activation... machine # [ 4.268168] initrd-nixos-activation-start[236]: booting system configuration /nix/store/2ckszpzvpklrfkgmq385kgp9pqq6rigq-nixos-system-machine-test machine # [ 4.319041] initrd-nixos-activation-start[236]: running activation script... machine # [ 4.638658] initrd-nixos-activation-start[259]: setting up /etc... machine # [ 4.786935] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.789829] systemd[1]: Finished NixOS Activation. machine # [ 4.791674] systemd[1]: Starting Switch Root... machine # [ 4.812974] systemd[1]: Switching root. machine # [ 5.020049] systemd-journald[89]: Received SIGTERM from PID 1 (systemd). machine # [ 5.181061] NET: Registered PF_VSOCK protocol family machine # [ 5.572136] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.582502] systemd[1]: Detected virtualization kvm. machine # [ 5.613483] systemd[1]: Detected architecture x86-64. machine # [ 5.615537] systemd[1]: Detected first boot. machine # [ 5.620846] systemd[1]: Initializing machine ID from random generator. machine # [ 5.774244] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.879592] systemd[1]: Applying preset policy. machine # [ 6.086883] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.355021] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.356439] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.358949] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.361233] systemd[1]: Created slice Slice /system/getty. machine # [ 6.362728] systemd[1]: Created slice User and Session Slice. machine # [ 6.363744] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.365007] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.366156] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.366985] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.367963] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.368884] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.369726] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.370741] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.371727] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.372784] systemd[1]: Reached target Path Units. machine # [ 6.373611] systemd[1]: Reached target Remote File Systems. machine # [ 6.374479] systemd[1]: Reached target Slice Units. machine # [ 6.375249] systemd[1]: Reached target Swaps. machine # [ 6.377339] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.380225] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.382368] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.384738] systemd[1]: Listening on Factory Reset Management. machine # [ 6.385729] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.389230] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.390951] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.393668] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.394916] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.396391] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.399949] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.410457] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.413260] systemd[1]: Listening on udev Control Socket. machine # [ 6.415671] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.421793] systemd[1]: Mounting Huge Pages File System... machine # [ 6.426742] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.435783] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.438493] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.441435] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.445586] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.448752] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.452472] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.456466] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.464000] systemd[1]: Mounting FUSE Control File System... machine # [ 6.465074] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.472597] systemd[1]: Starting Journal Service... machine # [ 6.478684] systemd[1]: Starting Load Kernel Modules... machine # [ 6.482220] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.484719] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.485864] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.492648] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.496124] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.497176] systemd[1]: Mounted Huge Pages File System. machine # [ 6.498214] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.499404] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.500459] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.502072] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.503508] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.505062] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.506193] systemd[1]: Mounted FUSE Control File System. machine # [ 6.510547] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.513215] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.526998] EXT4-fs (vda): re-mounted 90bc52e3-caea-4334-8e94-d4f1220db5b4. machine # [ 6.530114] systemd-journald[329]: Collecting audit messages is enabled. machine # [ 6.532164] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.533570] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.534638] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.539879] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.540821] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.543143] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.388789] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.544307] systemd[1]: Started Journal Service. machine # [ 6.390513] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.392237] systemd-modules-load[330]: Using 2 probe threads machine # [ 6.393559] systemd-oomd[332]: No swap; memory pressure usage will be degraded machine # [ 6.551781] loop: module loaded machine # [ 6.397305] systemd-modules-load[330]: Inserted module 'loop' machine # [ 6.398280] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.399412] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.400721] systemd[1]: Finished Load Kernel Modules. machine # [ 6.407207] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.420545] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.421639] systemd[1]: Reached target First Boot Complete. machine # [ 6.425795] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.428985] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.585823] systemd-journald[329]: Received client request to flush runtime journal. machine # [ 6.486451] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.487595] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.488756] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.489770] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.490891] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.508532] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.509720] systemd-udevd[358]: Using default interface naming scheme 'v261'. machine # [ 6.545697] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.611538] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.635468] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.642939] (udev-worker)[373]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.647560] (udev-worker)[375]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.649794] (udev-worker)[375]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.654299] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.677572] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.678820] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.681232] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.683895] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.685590] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.686944] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.858920] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.867314] mousedev: PS/2 mouse device common for all mice machine # [ 6.874135] Console: switching to colour dummy device 80x25 machine # [ 6.875746] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.875748] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.879443] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.880246] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.884922] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.892435] Console: switching to colour frame buffer device 160x50 machine # [ 6.896538] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.900646] ACPI: button: Power Button [PWRF] machine # [ 6.921658] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.929631] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.930635] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.931927] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.933578] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.934263] rtc_cmos PNP0B00:00: setting system clock to 2026-10-05T08:28:20 UTC (1791188900) machine # [ 6.934760] systemd-journald[329]: Time jumped backwards, rotating. machine # [ 6.936327] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.936355] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.969399] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.970501] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.976262] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.978627] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.866103] systemd[1]: Starting Virtual Console Setup... machine # [ 6.880537] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.883673] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.888316] systemd[1]: Starting Virtual Console Setup... machine # [ 6.924620] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.925988] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.930928] systemd[1]: Starting Virtual Console Setup... machine # [ 7.099209] ppdev: user-space parallel port driver machine # [ 7.103917] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.105229] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 7.124073] kvm_amd: TSC scaling supported machine # [ 7.124691] kvm_amd: Nested Virtualization enabled machine # [ 7.125244] kvm_amd: Nested Paging enabled machine # [ 7.125734] kvm_amd: LBR virtualization supported machine # [ 7.126356] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.126911] kvm_amd: Virtual GIF supported machine # [ 7.127947] kvm_amd: Virtual NMI enabled machine # [ 7.197217] EDAC MC: Ver: 3.0.0 machine # [ 7.099587] systemd-vconsole-setup[407]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.103691] systemd[1]: Finished Virtual Console Setup. machine # [ 7.202990] systemd[1]: Mounting /run/wrappers... machine # [ 7.241549] systemd[1]: Mounted /run/wrappers. machine # [ 7.243555] systemd[1]: Reached target Local File Systems. machine # [ 7.245694] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.248216] systemd[1]: Starting register-nix-paths.service... machine # [ 7.250533] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.252795] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.255912] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.258377] systemd[1]: Starting Create System Files and Directories... machine # [ 7.359437] systemd[1]: Finished Create System Files and Directories. machine # [ 7.361966] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.363704] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.397607] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.406383] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.408226] systemd[1]: Starting Update is Completed... machine # [ 7.418765] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.421061] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.437855] systemd[1]: Finished Update is Completed. machine # [ 7.565510] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.566764] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.802054] systemd[1]: Finished register-nix-paths.service. machine # [ 7.803467] systemd[1]: Reached target System Initialization. machine # [ 7.804637] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.805864] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.806951] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.808165] systemd[1]: Reached target Timer Units. machine # [ 7.809194] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.811898] systemd[1]: Listening on niks3 server socket. machine # [ 7.812904] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.813849] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.815312] systemd[1]: Reached target Socket Units. machine # [ 7.816400] systemd[1]: Reached target Basic System. machine # [ 7.817480] systemd[1]: Started backdoor.service. machine # [ 7.818655] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.820661] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.823306] systemd[1]: Starting Post-Boot Actions... machine # [ 7.830118] systemd[1]: Started Reset console on configuration changes. machine # [ 7.832627] systemd[1]: Starting resolvconf update... machine # [ 7.835227] systemd[1]: Started rustfs.service. machine # [ 7.837309] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.841403] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.876041] nsncd[494]: Oct 05 08:28:21.594 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.879225] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.880242] systemd[1]: Reached target Host and Network Name Lookups. machine # connecting to host... machine # [ 7.882239] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.884129] systemd[1]: Starting User Login Management... machine # [ 7.884991] systemd[1]: Finished Post-Boot Actions. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine # [ 7.931340] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: (connecting took 8.59 seconds) machine: (finished: waiting for the VM to finish booting, in 8.87 seconds) machine # [ 7.936706] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.946959] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' machine # [ 7.947648] dbus-broker-launch[501]: Invalid user-name in /nix/store/bcd7zqqxh9dkf34jz3fznsnn45xd36vp-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.962548] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.974033] systemd-logind[522]: New seat seat0. machine # [ 7.979983] systemd-logind[522]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.980383] systemd-logind[522]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.981037] systemd-logind[522]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.981478] systemd[1]: Started User Login Management. machine # [ 7.983769] dbus-broker-launch[501]: Ready machine # [ 7.990118] systemd[1]: Starting linger-users.service... machine # [ 8.001391] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.003221] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.004218] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.005460] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.006431] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.011233] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.012214] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.016388] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.024255] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.027778] systemd[1]: Finished linger-users.service. machine # [ 8.053819] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.055294] nsncd[601]: Oct 05 08:28:21.773 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.055668] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.056220] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.059519] systemd[1]: Finished resolvconf update. machine # [ 8.060767] systemd[1]: Reached target Preparation for Network. machine # [ 8.064601] systemd[1]: Starting DHCP Client... machine # [ 8.067423] systemd[1]: Starting Address configuration of eth1... machine # [ 8.069280] systemd[1]: Starting Extra networking commands.... machine # [ 8.130989] network-addresses-eth1-start[627]: adding address 192.168.1.1/24... done machine # [ 8.141764] network-addresses-eth1-start[627]: adding address 2001:db8:1::1/64... done machine # [ 8.159052] systemd[1]: Finished Address configuration of eth1. machine # [ 8.167181] dhcpcd[637]: dhcpcd-10.3.2 starting machine # [ 8.173250] dhcpcd[685]: dev: loaded udev machine # [ 8.338879] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.340319] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.198144] systemd[1]: Finished Extra networking commands.. machine # [ 8.199133] systemd[1]: Reached target Network. machine # [ 8.201358] systemd[1]: Starting PostgreSQL Server... machine # [ 8.204445] systemd[1]: Starting Permit User Sessions... machine # [ 8.207133] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.236986] systemd[1]: Finished Permit User Sessions. machine # [ 8.239261] systemd[1]: Started Getty on tty1. machine # [ 8.240229] systemd[1]: Reached target Login Prompts. machine # [ 8.441943] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.459393] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.460555] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.462647] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.464031] cfg80211: failed to load regulatory.db machine # [ 8.502360] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.349665] dhcpcd[685]: eth0: waiting for carrier machine # [ 8.349931] dhcpcd[685]: eth0: carrier acquired machine # [ 8.351888] postgresql-pre-start[713]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.352293] postgresql-pre-start[713]: This user must also own the server process. machine # [ 8.353687] postgresql-pre-start[713]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.353973] postgresql-pre-start[713]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.354809] postgresql-pre-start[713]: The default text search configuration will be set to "english". machine # [ 8.355599] postgresql-pre-start[713]: Data page checksums are enabled. machine # [ 8.356224] postgresql-pre-start[713]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.356654] postgresql-pre-start[713]: creating subdirectories ... ok machine # [ 8.357219] postgresql-pre-start[713]: selecting dynamic shared memory implementation ... posix machine # [ 8.357720] dhcpcd[685]: DUID 00:01:00:01:32:56:1c:26:52:54:00:12:34:56 machine # [ 8.358395] dhcpcd[685]: eth0: IAID 00:12:34:56 machine # [ 8.359461] dhcpcd[685]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 8.417270] postgresql-pre-start[713]: selecting default "max_connections" ... 100 machine # [ 8.466085] postgresql-pre-start[713]: selecting default "shared_buffers" ... 128MB machine # [ 9.201642] postgresql-pre-start[713]: selecting default time zone ... UTC machine # [ 9.204260] postgresql-pre-start[713]: creating configuration files ... ok machine # [ 9.412458] postgresql-pre-start[713]: running bootstrap script ... ok machine # [ 9.705491] dhcpcd[685]: eth0: soliciting a DHCP lease machine # [ 9.879882] NET: Registered PF_PACKET protocol family machine # [ 9.733787] dhcpcd[685]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 9.739766] dhcpcd[685]: eth0: probing address 10.0.2.15/24 machine # [ 9.868184] postgresql-pre-start[713]: performing post-bootstrap initialization ... ok machine # [ 10.041387] postgresql-pre-start[713]: syncing data to disk ... ok machine # [ 10.041792] postgresql-pre-start[713]: initdb: warning: enabling "trust" authentication for local connections machine # [ 10.043233] postgresql-pre-start[713]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 10.044071] postgresql-pre-start[713]: Success. You can now start the database server using: machine # [ 10.045197] postgresql-pre-start[713]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.189331] postgres[752]: [752] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.191460] postgres[752]: [752] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.192165] postgres[752]: [752] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.198839] postgres[752]: [752] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.211945] postgres[770]: [770] LOG: database system was shut down at 2026-10-05 08:28:23 GMT machine # [ 10.221035] postgres[752]: [752] LOG: database system is ready to accept connections machine # [ 10.227289] systemd[1]: Started PostgreSQL Server. machine # [ 10.229091] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.419449] dhcpcd[685]: eth0: soliciting an IPv6 router machine # [ 10.421340] dhcpcd[685]: eth0: Router Advertisement from fe80::2 machine # [ 10.423421] dhcpcd[685]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.425616] dhcpcd[685]: eth0: adding route to fec0::/64 machine # [ 10.427129] dhcpcd[685]: eth0: adding default route via fe80::2 machine # [ 10.500583] postgresql-setup-start[781]: CREATE DATABASE machine # [ 10.549929] postgresql-setup-start[786]: CREATE ROLE machine # [ 10.576139] postgresql-setup-start[788]: ALTER DATABASE machine # [ 10.580504] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.581744] systemd[1]: Reached target PostgreSQL. machine # [ 14.308375] dhcpcd[685]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 14.308769] dhcpcd[685]: eth0: adding route to 10.0.2.0/24 machine # [ 14.310803] dhcpcd[685]: eth0: adding default route via 10.0.2.2 machine # [ 14.465479] systemd[1]: Started DHCP Client. machine # [ 14.468577] systemd[1]: Reached target Network is Online. machine # [ 14.473543] systemd[1]: Starting k3s service... machine # [ 14.537511] k3s[886]: time="2026-10-05T08:28:28Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 14.537879] k3s[886]: time="2026-10-05T08:28:28Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/53c81a1072dac7aebc0a3715f02f26b7ba95e9416f42c7f7aeed55ccb68af709" machine # [ 15.470190] rustfs-bucket-start[893]: mb s3://farm machine # [ 15.477372] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.153263] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Starting k3s 1.36.4+k3s1 (4dedb15b)" machine # [ 17.163524] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.168768] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.172936] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.186101] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.189552] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.191464] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.195227] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.196138] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.200179] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.201633] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:30.922120407 +0000 UTC notAfter=2036-10-02 07:28:30.922120407 +0000 UTC" machine # [ 17.202725] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.203831] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.204937] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.206152] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.206852] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.208337] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.209567] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1791188910: notBefore=2026-10-05 07:28:30.92975378 +0000 UTC notAfter=2036-10-02 07:28:30.92975378 +0000 UTC" machine # [ 17.210240] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.211420] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.213034] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.213772] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1791188910: notBefore=2026-10-05 07:28:30.933685564 +0000 UTC notAfter=2036-10-02 07:28:30.933685564 +0000 UTC" machine # [ 17.214925] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.216763] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1791188910: notBefore=2026-10-05 07:28:30.935574352 +0000 UTC notAfter=2036-10-02 07:28:30.935574352 +0000 UTC" machine # [ 17.218056] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.218894] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1791188910: notBefore=2026-10-05 07:28:30.937325133 +0000 UTC notAfter=2036-10-02 07:28:30.937325133 +0000 UTC" machine # [ 17.220162] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.221124] k3s[886]: time="2026-10-05T08:28:30Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1791188910: notBefore=2026-10-05 07:28:30 +0000 UTC notAfter=2027-10-05 07:28:30 +0000 UTC" machine # [ 17.343678] k3s[886]: time="2026-10-05T08:28:31Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1791188910: notBefore=2026-10-05 07:28:31 +0000 UTC notAfter=2027-10-05 07:28:31 +0000 UTC" machine # [ 17.344636] k3s[886]: time="2026-10-05T08:28:31Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.355265] k3s[886]: time="2026-10-05T08:28:31Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__509d_68b4_dc7d_8f2-427e4a:fec0::509d:68b4:dc7d:8f2 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=3602190D15EEFFA22688A21C1F42EB236DD5AE06]" machine # [ 18.425775] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Password verified locally for node machine" machine # [ 18.426262] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1791188910: notBefore=2026-10-05 07:28:32 +0000 UTC notAfter=2027-10-05 07:28:32 +0000 UTC" machine # [ 18.665055] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:32 +0000 UTC notAfter=2027-10-05 07:28:32 +0000 UTC" machine # [ 18.763681] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:32 +0000 UTC notAfter=2027-10-05 07:28:32 +0000 UTC" machine # [ 18.839930] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1791188910: notBefore=2026-10-05 07:28:32 +0000 UTC notAfter=2027-10-05 07:28:32 +0000 UTC" machine # [ 18.945654] k3s[886]: time="2026-10-05T08:28:32Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:48094: runtime core not ready" machine # [ 19.037430] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Module overlay was already loaded" machine # [ 19.251454] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.256328] Bridge firewalling registered machine # [ 19.115055] k3s[886]: time="2026-10-05T08:28:32Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.125544] k3s[886]: time="2026-10-05T08:28:32Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.135016] k3s[886]: time="2026-10-05T08:28:32Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.206878] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Set sysctl 'net/ipv4/conf/default/forwarding' to 1" machine # [ 19.207319] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.208064] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.211187] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.211629] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.218527] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.220360] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.221893] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.223319] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.224997] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Connection to etcd is ready" machine # [ 19.226224] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="ETCD server is now running" machine # [ 19.227468] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.229513] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.231080] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.231562] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.232535] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.235361] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.236156] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.238878] k3s[886]: time="2026-10-05T08:28:32Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.287716] k3s[886]: I1005 08:28:33.008604 886 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.289458] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.291449] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.291775] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.295058] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.295910] k3s[886]: I1005 08:28:33.016858 886 server.go:158] Version: v1.36.4+k3s1 machine # [ 19.296627] k3s[886]: I1005 08:28:33.016895 886 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.298207] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.298810] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Run: k3s kubectl" machine # [ 19.301026] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.301769] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.312835] k3s[886]: time="2026-10-05T08:28:33Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:48150: runtime core not ready" machine # [ 19.406585] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.428222] k3s[886]: I1005 08:28:33.148806 886 shared_informer.go:381] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.428425] k3s[886]: E1005 08:28:33.149009 886 options.go:205] The manifest file is empty, ignoring. machine # [ 19.431405] k3s[886]: I1005 08:28:33.152196 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 19.433711] k3s[886]: I1005 08:28:33.154587 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 19.435276] k3s[886]: I1005 08:28:33.156249 886 plugins.go:157] Loaded 15 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,PodGroupProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.440172] k3s[886]: I1005 08:28:33.156276 886 plugins.go:160] Loaded 17 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,PodGroupWorkloadExists,NodeDeclaredFeatureValidator,JobValidation,PodResizeValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.446405] k3s[886]: I1005 08:28:33.156603 886 instance.go:240] Using reconciler: lease machine # [ 19.446533] k3s[886]: I1005 08:28:33.163577 886 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.446954] k3s[886]: W1005 08:28:33.163598 886 genericapiserver.go:798] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.449245] k3s[886]: I1005 08:28:33.166745 886 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.474916] k3s[886]: I1005 08:28:33.195845 886 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.476468] k3s[886]: I1005 08:28:33.196013 886 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.499083] k3s[886]: I1005 08:28:33.218891 886 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.534552] k3s[886]: I1005 08:28:33.255452 886 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.536355] k3s[886]: W1005 08:28:33.255487 886 genericapiserver.go:798] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.538220] k3s[886]: W1005 08:28:33.255501 886 genericapiserver.go:798] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.540111] k3s[886]: I1005 08:28:33.255824 886 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.541652] k3s[886]: W1005 08:28:33.255839 886 genericapiserver.go:798] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.543485] k3s[886]: I1005 08:28:33.256421 886 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.544932] k3s[886]: I1005 08:28:33.256876 886 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.546449] k3s[886]: I1005 08:28:33.257713 886 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.547849] k3s[886]: W1005 08:28:33.257730 886 genericapiserver.go:798] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.549424] k3s[886]: I1005 08:28:33.258232 886 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.551041] k3s[886]: W1005 08:28:33.258249 886 genericapiserver.go:798] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.552783] k3s[886]: W1005 08:28:33.258260 886 genericapiserver.go:798] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.554623] k3s[886]: I1005 08:28:33.258720 886 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.556239] k3s[886]: W1005 08:28:33.258740 886 genericapiserver.go:798] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.557986] k3s[886]: W1005 08:28:33.258751 886 genericapiserver.go:798] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.559721] k3s[886]: I1005 08:28:33.259198 886 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.561229] k3s[886]: W1005 08:28:33.259214 886 genericapiserver.go:798] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.562838] k3s[886]: I1005 08:28:33.260660 886 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.564391] k3s[886]: W1005 08:28:33.260677 886 genericapiserver.go:798] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.566295] k3s[886]: I1005 08:28:33.260922 886 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.567829] k3s[886]: W1005 08:28:33.260936 886 genericapiserver.go:798] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.569522] k3s[886]: W1005 08:28:33.260946 886 genericapiserver.go:798] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.571239] k3s[886]: I1005 08:28:33.261450 886 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.572622] k3s[886]: W1005 08:28:33.261479 886 genericapiserver.go:798] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.574226] k3s[886]: I1005 08:28:33.262461 886 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.575840] k3s[886]: W1005 08:28:33.262478 886 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.577657] k3s[886]: W1005 08:28:33.262489 886 genericapiserver.go:798] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.579475] k3s[886]: I1005 08:28:33.262786 886 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.581138] k3s[886]: W1005 08:28:33.262801 886 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.582859] k3s[886]: W1005 08:28:33.262817 886 genericapiserver.go:798] Skipping API scheduling.k8s.io/v1alpha2 because it has no resources. machine # [ 19.584608] k3s[886]: I1005 08:28:33.264228 886 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.586138] k3s[886]: W1005 08:28:33.264245 886 genericapiserver.go:798] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.587795] k3s[886]: W1005 08:28:33.264255 886 genericapiserver.go:798] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.589508] k3s[886]: I1005 08:28:33.265004 886 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.591167] k3s[886]: W1005 08:28:33.265020 886 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.592979] k3s[886]: W1005 08:28:33.265058 886 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.594811] k3s[886]: W1005 08:28:33.265068 886 genericapiserver.go:798] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.596651] k3s[886]: I1005 08:28:33.267261 886 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.598086] k3s[886]: W1005 08:28:33.267280 886 genericapiserver.go:798] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.599737] k3s[886]: W1005 08:28:33.267291 886 genericapiserver.go:798] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.602526] k3s[886]: I1005 08:28:33.268658 886 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.604213] k3s[886]: W1005 08:28:33.268677 886 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.606094] k3s[886]: W1005 08:28:33.268687 886 genericapiserver.go:798] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.608111] k3s[886]: I1005 08:28:33.268981 886 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.609659] k3s[886]: W1005 08:28:33.268995 886 genericapiserver.go:798] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.611306] k3s[886]: I1005 08:28:33.270063 886 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.612774] k3s[886]: W1005 08:28:33.270104 886 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.614488] k3s[886]: W1005 08:28:33.270114 886 genericapiserver.go:798] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.616226] k3s[886]: W1005 08:28:33.270124 886 genericapiserver.go:798] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.617991] k3s[886]: I1005 08:28:33.272426 886 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.619528] k3s[886]: W1005 08:28:33.272445 886 genericapiserver.go:798] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.948513] k3s[886]: I1005 08:28:33.669306 886 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 19.950829] k3s[886]: I1005 08:28:33.669407 886 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.953723] k3s[886]: I1005 08:28:33.669312 886 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 19.955917] k3s[886]: I1005 08:28:33.669712 886 secure_serving.go:214] Serving securely on 127.0.0.1:6444 machine # [ 19.957295] k3s[886]: I1005 08:28:33.669841 886 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 19.958740] k3s[886]: I1005 08:28:33.670605 886 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 19.960321] k3s[886]: I1005 08:28:33.670626 886 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 19.962020] k3s[886]: I1005 08:28:33.670670 886 controller.go:89] "Starting OpenAPI V3 AggregationController" machine # [ 19.963466] k3s[886]: I1005 08:28:33.670857 886 storage_readiness_hook.go:70] Storage is ready for all registered resources machine # [ 19.965019] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 19.966452] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.967796] k3s[886]: I1005 08:28:33.671000 886 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 19.969383] k3s[886]: I1005 08:28:33.671081 886 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 19.970960] k3s[886]: I1005 08:28:33.671321 886 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 19.972447] k3s[886]: I1005 08:28:33.671334 886 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 19.973892] k3s[886]: I1005 08:28:33.671399 886 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 19.975410] k3s[886]: I1005 08:28:33.671470 886 controller.go:87] "Starting OpenAPI AggregationController" machine # [ 19.976833] k3s[886]: I1005 08:28:33.671876 886 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 19.978794] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.980157] k3s[886]: I1005 08:28:33.671953 886 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 19.983059] k3s[886]: I1005 08:28:33.672100 886 aggregator.go:185] waiting for initial CRD sync... machine # [ 19.984397] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 19.985830] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.987159] k3s[886]: I1005 08:28:33.672258 886 remote_available_controller.go:434] Starting RemoteAvailability controller machine # [ 19.988769] k3s[886]: I1005 08:28:33.672270 886 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 19.990324] k3s[886]: I1005 08:28:33.672416 886 repairip.go:210] Starting ipallocator-repair-controller machine # [ 19.991713] k3s[886]: I1005 08:28:33.672428 886 shared_informer.go:381] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 19.993628] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg=Starting controller=kubernetes-service-cidr-controller logger=k3s machine # [ 19.995233] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 19.996559] k3s[886]: I1005 08:28:33.675854 886 controller.go:142] Starting OpenAPI controller machine # [ 19.997863] k3s[886]: I1005 08:28:33.675947 886 controller.go:90] Starting OpenAPI V3 controller machine # [ 19.999115] k3s[886]: I1005 08:28:33.675990 886 naming_controller.go:305] Starting NamingConditionController machine # [ 20.000558] k3s[886]: I1005 08:28:33.676102 886 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.002302] k3s[886]: I1005 08:28:33.676138 886 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.004158] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Starting CRDFinalizer" logger=k3s machine # [ 20.005454] k3s[886]: I1005 08:28:33.671395 886 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.007430] k3s[886]: I1005 08:28:33.676541 886 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.009554] k3s[886]: I1005 08:28:33.676785 886 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.011795] k3s[886]: I1005 08:28:33.684122 886 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.013418] k3s[886]: I1005 08:28:33.684144 886 shared_informer.go:381] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.028209] k3s[886]: I1005 08:28:33.749116 886 shared_informer.go:388] "Caches are synced" controller="node_authorizer" machine # [ 20.031478] k3s[886]: I1005 08:28:33.752361 886 shared_informer.go:409] "Caches are synced" machine # [ 20.031931] k3s[886]: I1005 08:28:33.752413 886 policy_source.go:248] refreshing policies machine # [ 20.033958] k3s[886]: I1005 08:28:33.754859 886 shared_informer.go:409] "Caches are synced" machine # [ 20.034587] k3s[886]: I1005 08:28:33.754892 886 policy_source.go:248] refreshing policies machine # [ 20.050574] k3s[886]: I1005 08:28:33.771494 886 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.051077] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.051585] k3s[886]: I1005 08:28:33.771905 886 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.052092] k3s[886]: I1005 08:28:33.771920 886 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.052569] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.053142] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.053599] k3s[886]: I1005 08:28:33.772338 886 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.059064] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.059483] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Creating default ServiceCIDR" CIDRs="[10.43.0.0/16]" logger=k3s machine # [ 20.060072] k3s[886]: I1005 08:28:33.780624 886 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.060532] k3s[886]: I1005 08:28:33.781020 886 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.061090] k3s[886]: I1005 08:28:33.781096 886 handler_discovery.go:459] Starting ResourceDiscoveryManager machine # [ 20.065684] k3s[886]: I1005 08:28:33.786618 886 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" machine # [ 20.067410] k3s[886]: I1005 08:28:33.787197 886 aggregator.go:187] initial CRD sync complete... machine # [ 20.068693] k3s[886]: I1005 08:28:33.787223 886 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.070146] k3s[886]: I1005 08:28:33.787238 886 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.071593] k3s[886]: I1005 08:28:33.787251 886 cache.go:39] Caches are synced for autoregister controller machine # [ 20.086073] k3s[886]: I1005 08:28:33.806059 886 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.087731] k3s[886]: time="2026-10-05T08:28:33Z" level=info msg="Setting default ServiceCIDR condition Ready to True" logger=k3s machine # [ 20.089459] k3s[886]: I1005 08:28:33.807543 886 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.097770] k3s[886]: I1005 08:28:33.818732 886 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.134781] k3s[886]: I1005 08:28:33.855714 886 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.143754] k3s[886]: W1005 08:28:33.864724 886 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.146907] k3s[886]: I1005 08:28:33.867884 886 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.154084] k3s[886]: I1005 08:28:33.875018 886 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 20.161532] k3s[886]: E1005 08:28:33.882472 886 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 20.311544] k3s[886]: time="2026-10-05T08:28:34Z" level=info msg="containerd is now running" machine # [ 20.325760] k3s[886]: time="2026-10-05T08:28:34Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/4v14fxahlxhgjlfn1jf5zd1cj1prhvgs-nix-grpc-farm-client.tar" machine # [ 20.960657] k3s[886]: I1005 08:28:34.680716 886 storage_scheduling.go:137] created PriorityClass system-node-critical with value 2000001000 machine # [ 20.971276] k3s[886]: I1005 08:28:34.692163 886 storage_scheduling.go:137] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 20.971706] k3s[886]: I1005 08:28:34.692209 886 storage_scheduling.go:153] all system priority classes are created successfully or already exist. machine # [ 21.220140] k3s[886]: time="2026-10-05T08:28:34Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 21.730457] k3s[886]: I1005 08:28:35.451414 886 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 21.769671] k3s[886]: I1005 08:28:35.490588 886 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 23.231690] k3s[886]: time="2026-10-05T08:28:36Z" level=info msg="Kube API server is now running" machine # [ 23.232867] k3s[886]: time="2026-10-05T08:28:36Z" level=info msg="k3s is up and running" machine # [ 23.235169] k3s[886]: time="2026-10-05T08:28:36Z" level=info msg="Waiting for untainted node" machine # [ 23.237861] systemd[1]: Started k3s service. machine # [ 23.243870] systemd[1]: Starting niks3 server... machine # [ 23.245478] k3s[886]: time="2026-10-05T08:28:36Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.246945] k3s[886]: time="2026-10-05T08:28:36Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.265447] k3s[886]: E1005 08:28:36.986405 886 options.go:205] The manifest file is empty, ignoring. machine # [ 23.265983] k3s[886]: I1005 08:28:36.986967 886 controllermanager.go:204] "Starting" version="v1.36.4+k3s1" machine # [ 23.266915] k3s[886]: I1005 08:28:36.987896 886 controllermanager.go:206] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.270983] k3s[886]: I1005 08:28:36.991963 886 secure_serving.go:214] Serving securely on 127.0.0.1:10257 machine # [ 23.272245] k3s[886]: I1005 08:28:36.993198 886 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.272840] k3s[886]: I1005 08:28:36.993338 886 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.273792] k3s[886]: I1005 08:28:36.993357 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.278806] k3s[886]: I1005 08:28:36.993537 886 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.279971] k3s[886]: I1005 08:28:36.993554 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.281231] k3s[886]: I1005 08:28:36.993583 886 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.282182] k3s[886]: I1005 08:28:36.993598 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.283175] k3s[886]: I1005 08:28:36.995238 886 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.291997] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.301341] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.305885] k3s[886]: I1005 08:28:37.026851 886 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.309845] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.317672] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.322040] k3s[886]: I1005 08:28:37.042752 886 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.350558] k3s[886]: I1005 08:28:37.071468 886 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.351796] k3s[886]: I1005 08:28:37.072716 886 node_lifecycle_controller.go:402] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 23.372943] k3s[886]: I1005 08:28:37.093856 886 shared_informer.go:409] "Caches are synced" machine # [ 23.379603] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.387506] k3s[886]: I1005 08:28:37.108386 886 shared_informer.go:409] "Caches are synced" machine # [ 23.387851] k3s[886]: I1005 08:28:37.108500 886 shared_informer.go:409] "Caches are synced" machine # [ 23.394396] k3s[886]: I1005 08:28:37.114952 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 23.394700] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 23.395514] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.399468] k3s[886]: I1005 08:28:37.119957 886 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.423372] k3s[886]: I1005 08:28:37.144307 886 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.457905] k3s[886]: I1005 08:28:37.178837 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.458291] k3s[886]: I1005 08:28:37.178915 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.458748] k3s[886]: I1005 08:28:37.178957 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.464421] k3s[886]: I1005 08:28:37.185342 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.464864] k3s[886]: I1005 08:28:37.185397 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.465564] k3s[886]: I1005 08:28:37.185421 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.466131] k3s[886]: I1005 08:28:37.185451 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.473437] k3s[886]: I1005 08:28:37.194332 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.473856] k3s[886]: I1005 08:28:37.194424 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.474627] k3s[886]: I1005 08:28:37.194453 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.479905] k3s[886]: I1005 08:28:37.200867 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.480519] k3s[886]: I1005 08:28:37.200917 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.484191] k3s[886]: I1005 08:28:37.205109 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.484605] k3s[886]: I1005 08:28:37.205160 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 23.485098] k3s[886]: I1005 08:28:37.205189 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 23.485629] k3s[886]: I1005 08:28:37.205215 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 23.493061] k3s[886]: I1005 08:28:37.213909 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.493666] k3s[886]: I1005 08:28:37.213987 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.494405] k3s[886]: I1005 08:28:37.214016 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.495192] k3s[886]: I1005 08:28:37.214065 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.495652] k3s[886]: I1005 08:28:37.214102 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.496194] k3s[886]: I1005 08:28:37.214127 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.496667] k3s[886]: I1005 08:28:37.214151 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.497233] k3s[886]: I1005 08:28:37.216124 886 shared_informer.go:409] "Caches are synced" machine # [ 23.509350] k3s[886]: I1005 08:28:37.230300 886 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.531650] k3s[886]: W1005 08:28:37.252479 886 probe.go:275] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 23.760817] k3s[886]: I1005 08:28:37.481423 886 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 23.761602] k3s[886]: I1005 08:28:37.481568 886 controllermanager.go:641] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine: (finished: waiting for unit k3s.service, in 24.77 seconds) machine: waiting for success: kubectl get ns farm machine # [ 23.900099] k3s[886]: I1005 08:28:37.620932 886 controllermanager.go:689] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 23.900364] k3s[886]: I1005 08:28:37.620958 886 controllermanager.go:689] "Warning: controller is disabled" controller="node-route-controller" machine # [ 23.912270] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.912700] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 23.913504] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 23.914490] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 23.915081] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 23.915684] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 23.915971] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 23.916661] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 23.917448] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.048769] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.049026] k3s[886]: time="2026-10-05T08:28:37Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::509d:68b4:dc7d:8f2 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.344090] k3s[886]: time="2026-10-05T08:28:38Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__509d_68b4_dc7d_8f2-427e4a:fec0::509d:68b4:dc7d:8f2 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=3602190D15EEFFA22688A21C1F42EB236DD5AE06]" machine # [ 24.353849] k3s[886]: time="2026-10-05T08:28:38Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=238) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__509d_68b4_dc7d_8f2-427e4a:fec0::509d:68b4:dc7d:8f2 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=3602190D15EEFFA22688A21C1F42EB236DD5AE06]" machine # [ 25.099716] k3s[886]: I1005 08:28:38.820086 886 controllermanager.go:641] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 25.100229] k3s[886]: I1005 08:28:38.820114 886 controllermanager.go:689] "Warning: controller is disabled" controller="selinux-warning-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.254899] k3s[886]: time="2026-10-05T08:28:38Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.256703] k3s[886]: time="2026-10-05T08:28:38Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.260072] k3s[886]: time="2026-10-05T08:28:38Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.260565] k3s[886]: time="2026-10-05T08:28:38Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.264860] k3s[886]: time="2026-10-05T08:28:38Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.267214] k3s[886]: time="2026-10-05T08:28:38Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 25.401498] k3s[886]: I1005 08:28:39.121937 886 controllermanager.go:689] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 25.550257] k3s[886]: I1005 08:28:39.271130 886 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 25.550545] k3s[886]: I1005 08:28:39.271163 886 controllermanager.go:641] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 26.149237] k3s[886]: I1005 08:28:39.870154 886 controllermanager.go:689] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 26.262413] k3s[886]: time="2026-10-05T08:28:39Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.372110] k3s[886]: time="2026-10-05T08:28:40Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.377463] k3s[886]: time="2026-10-05T08:28:40Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.380062] k3s[886]: time="2026-10-05T08:28:40Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.380511] k3s[886]: time="2026-10-05T08:28:40Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.382051] k3s[886]: time="2026-10-05T08:28:40Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.382856] k3s[886]: time="2026-10-05T08:28:40Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.385497] k3s[886]: time="2026-10-05T08:28:40Z" level=info msg="Starting /v1, Kind=Secret controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 27.199765] k3s[886]: I1005 08:28:40.920271 886 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 27.258603] k3s[886]: I1005 08:28:40.979531 886 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 27.262095] k3s[886]: time="2026-10-05T08:28:40Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.265882] k3s[886]: time="2026-10-05T08:28:40Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 27.500832] k3s[886]: I1005 08:28:41.220990 886 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podgroup-protection-controller" requiredFeatureGates=["GenericWorkload"] machine # [ 27.503549] k3s[886]: I1005 08:28:41.221021 886 controllermanager.go:641] "Warning: skipping controller" controller="podgroup-protection-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 27.704107] k3s[886]: time="2026-10-05T08:28:41Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 27.714440] k3s[886]: time="2026-10-05T08:28:41Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 27.862897] k3s[886]: time="2026-10-05T08:28:41Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0" machine # [ 27.864688] k3s[886]: time="2026-10-05T08:28:41Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:9c3dcc833a5ba1552c4cc4f19c1a2e6583b06db84654f9c6be1bb8a45f18e2bf" machine # [ 28.003704] k3s[886]: I1005 08:28:41.724480 886 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 28.003935] k3s[886]: I1005 08:28:41.724550 886 controllermanager.go:641] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 28.004255] k3s[886]: I1005 08:28:41.724577 886 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="resourcepoolstatusrequest-controller" requiredFeatureGates=["DRAResourcePoolStatus"] machine # [ 28.005195] k3s[886]: I1005 08:28:41.724599 886 controllermanager.go:641] "Warning: skipping controller" controller="resourcepoolstatusrequest-controller" machine # [ 28.006876] k3s[886]: time="2026-10-05T08:28:41Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 28.008179] k3s[886]: I1005 08:28:41.729089 886 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.008866] k3s[886]: I1005 08:28:41.729141 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.017047] k3s[886]: I1005 08:28:41.737976 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.017729] k3s[886]: I1005 08:28:41.738087 886 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.018251] k3s[886]: I1005 08:28:41.738107 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.018774] k3s[886]: I1005 08:28:41.738176 886 node_lifecycle_controller.go:436] "Sending events to api server" machine # [ 28.019490] k3s[886]: I1005 08:28:41.738223 886 node_lifecycle_controller.go:443] "Starting node controller" machine # [ 28.022085] k3s[886]: I1005 08:28:41.738235 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.022787] k3s[886]: I1005 08:28:41.738274 886 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.023521] k3s[886]: I1005 08:28:41.738290 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.024102] k3s[886]: I1005 08:28:41.738328 886 device_taint_eviction.go:783] "Starting" controller="device-taint-eviction-controller" numWorkers=8 machine # [ 28.024637] k3s[886]: I1005 08:28:41.738509 886 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.026110] k3s[886]: I1005 08:28:41.738575 886 taint_eviction.go:288] "Sending events to API server" machine # [ 28.026743] k3s[886]: I1005 08:28:41.738589 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.027482] k3s[886]: I1005 08:28:41.738674 886 servicecidrs_controller.go:137] "Starting" controller="service-cidr-controller" machine # [ 28.028051] k3s[886]: I1005 08:28:41.738702 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.028626] k3s[886]: I1005 08:28:41.738794 886 deployment_controller.go:180] "Starting controller" controller="deployment" machine # [ 28.031087] k3s[886]: I1005 08:28:41.738811 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.031710] k3s[886]: I1005 08:28:41.739147 886 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.032412] k3s[886]: I1005 08:28:41.739163 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.032941] k3s[886]: I1005 08:28:41.739269 886 attach_detach_controller.go:334] "Starting attach detach controller" machine # [ 28.033624] k3s[886]: I1005 08:28:41.739288 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.034275] k3s[886]: I1005 08:28:41.739319 886 expand_controller.go:328] "Starting expand controller" machine # [ 28.034738] k3s[886]: I1005 08:28:41.739346 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.038110] k3s[886]: I1005 08:28:41.739388 886 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.038729] k3s[886]: I1005 08:28:41.739404 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.039439] k3s[886]: I1005 08:28:41.739451 886 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.039945] k3s[886]: I1005 08:28:41.739467 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.040645] k3s[886]: I1005 08:28:41.739501 886 pvc_protection_controller.go:172] "Starting PVC protection controller" machine # [ 28.041197] k3s[886]: I1005 08:28:41.739517 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.041734] k3s[886]: I1005 08:28:41.739599 886 replica_set.go:285] "Starting controller" name="replicationcontroller" machine # [ 28.042475] k3s[886]: I1005 08:28:41.739625 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.043035] k3s[886]: I1005 08:28:41.739726 886 job_controller.go:336] "Starting job controller" machine # [ 28.043517] k3s[886]: I1005 08:28:41.739744 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.044057] k3s[886]: I1005 08:28:41.739805 886 horizontal.go:204] "Starting HPA controller" machine # [ 28.044521] k3s[886]: I1005 08:28:41.739823 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.045072] k3s[886]: I1005 08:28:41.739859 886 disruption.go:453] "Sending events to api server." machine # [ 28.045559] k3s[886]: I1005 08:28:41.739908 886 disruption.go:460] "Starting disruption controller" machine # [ 28.049094] k3s[886]: I1005 08:28:41.739920 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.049751] k3s[886]: I1005 08:28:41.739955 886 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.050493] k3s[886]: I1005 08:28:41.739988 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.051048] k3s[886]: I1005 08:28:41.740021 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.051538] k3s[886]: I1005 08:28:41.740125 886 stateful_set.go:234] "Starting stateful set controller" machine # [ 28.052082] k3s[886]: I1005 08:28:41.740141 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.052570] k3s[886]: I1005 08:28:41.740175 886 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.053129] k3s[886]: I1005 08:28:41.740190 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.053661] k3s[886]: I1005 08:28:41.740222 886 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.054196] k3s[886]: I1005 08:28:41.740248 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.054649] k3s[886]: I1005 08:28:41.740338 886 controller.go:753] "Starting resource claim controller" machine # [ 28.055417] k3s[886]: I1005 08:28:41.740353 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.055987] k3s[886]: I1005 08:28:41.740442 886 endpointslice_controller.go:280] "Starting endpoint slice controller" machine # [ 28.056698] k3s[886]: I1005 08:28:41.740457 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.057441] k3s[886]: I1005 08:28:41.740497 886 gc_controller.go:98] "Starting GC controller" machine # [ 28.059894] k3s[886]: I1005 08:28:41.740513 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.060733] k3s[886]: I1005 08:28:41.740593 886 daemon_controller.go:364] "Starting daemon sets controller" machine # [ 28.061403] k3s[886]: I1005 08:28:41.740622 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.061876] k3s[886]: I1005 08:28:41.740702 886 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.062562] k3s[886]: I1005 08:28:41.740719 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.063127] k3s[886]: I1005 08:28:41.740752 886 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.063577] k3s[886]: I1005 08:28:41.740767 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.064098] k3s[886]: I1005 08:28:41.741058 886 replica_set.go:285] "Starting controller" name="replicaset" machine # [ 28.064566] k3s[886]: I1005 08:28:41.741073 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.065113] k3s[886]: I1005 08:28:41.741107 886 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.065584] k3s[886]: I1005 08:28:41.741263 886 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.066109] k3s[886]: I1005 08:28:41.741278 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.066602] k3s[886]: I1005 08:28:41.741339 886 clusterroleaggregation_controller.go:176] "Starting ClusterRoleAggregator controller" machine # [ 28.066921] k3s[886]: I1005 08:28:41.741357 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.067635] k3s[886]: I1005 08:28:41.741402 886 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.068234] k3s[886]: I1005 08:28:41.741418 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.068718] k3s[886]: I1005 08:28:41.741495 886 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.069385] k3s[886]: I1005 08:28:41.741528 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.069859] k3s[886]: I1005 08:28:41.741563 886 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.070583] k3s[886]: I1005 08:28:41.741582 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.071086] k3s[886]: I1005 08:28:41.741668 886 pv_controller_base.go:318] "Starting persistent volume controller" machine # [ 28.071565] k3s[886]: I1005 08:28:41.741684 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.072117] k3s[886]: I1005 08:28:41.741716 886 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.072578] k3s[886]: I1005 08:28:41.741733 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.073230] k3s[886]: I1005 08:28:41.742416 886 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.074498] k3s[886]: I1005 08:28:41.742454 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.075657] k3s[886]: I1005 08:28:41.742490 886 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.077416] k3s[886]: I1005 08:28:41.742506 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.078582] k3s[886]: I1005 08:28:41.742547 886 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.080125] k3s[886]: I1005 08:28:41.742567 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.080902] k3s[886]: I1005 08:28:41.742612 886 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.083523] k3s[886]: I1005 08:28:41.742806 886 device_taint_eviction.go:823] "Sending events to api server" machine # [ 28.084726] k3s[886]: I1005 08:28:41.742954 886 device_taint_eviction.go:1023] "Waiting" for="cache and event handler sync" machine # [ 28.086371] k3s[886]: I1005 08:28:41.743114 886 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.087508] k3s[886]: I1005 08:28:41.743145 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.088569] k3s[886]: I1005 08:28:41.743344 886 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.090088] k3s[886]: I1005 08:28:41.743388 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.091068] k3s[886]: I1005 08:28:41.743957 886 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.093548] k3s[886]: I1005 08:28:41.744144 886 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.096076] k3s[886]: I1005 08:28:41.744252 886 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.137064] k3s[886]: I1005 08:28:41.744643 886 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.137777] k3s[886]: I1005 08:28:41.744811 886 graph_builder.go:387] "Running" component="GraphBuilder" machine # [ 28.138431] k3s[886]: I1005 08:28:41.775839 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.138946] k3s[886]: I1005 08:28:41.779687 886 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod" machine # [ 28.142466] k3s[886]: I1005 08:28:41.779724 886 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.Pod + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.143187] k3s[886]: time="2026-10-05T08:28:41Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 28.143865] k3s[886]: I1005 08:28:41.833717 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.144491] k3s[886]: I1005 08:28:41.845458 886 shared_informer.go:409] "Caches are synced" machine # [ 28.145033] k3s[886]: I1005 08:28:41.845527 886 shared_informer.go:409] "Caches are synced" machine # [ 28.145523] k3s[886]: I1005 08:28:41.845540 886 shared_informer.go:409] "Caches are synced" machine # [ 28.200234] k3s[886]: I1005 08:28:41.920569 886 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.203672] k3s[886]: I1005 08:28:41.920631 886 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceSlice" machine # [ 28.206212] k3s[886]: I1005 08:28:41.921788 886 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.DeviceClass" machine # [ 28.212064] k3s[886]: I1005 08:28:41.932429 886 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim" machine # [ 28.214553] k3s[886]: I1005 08:28:41.932904 886 device_taint_eviction.go:1023] "Done waiting" for="cache and event handler sync" instance="SharedIndexInformer *v1.ResourceClaim + event handler k8s.io/kubernetes/pkg/controller/devicetainteviction.(*Controller).Run" machine # [ 28.218139] k3s[886]: I1005 08:28:41.938200 886 shared_informer.go:409] "Caches are synced" machine # [ 28.219479] k3s[886]: I1005 08:28:41.938311 886 shared_informer.go:409] "Caches are synced" machine # [ 28.220987] k3s[886]: I1005 08:28:41.938963 886 shared_informer.go:409] "Caches are synced" machine # [ 28.222579] k3s[886]: I1005 08:28:41.939005 886 shared_informer.go:409] "Caches are synced" machine # [ 28.224101] k3s[886]: I1005 08:28:41.939112 886 shared_informer.go:409] "Caches are synced" machine # [ 28.225626] k3s[886]: I1005 08:28:41.939141 886 shared_informer.go:409] "Caches are synced" machine # [ 28.226368] k3s[886]: I1005 08:28:41.939192 886 shared_informer.go:409] "Caches are synced" machine # [ 28.226952] k3s[886]: I1005 08:28:41.939606 886 shared_informer.go:409] "Caches are synced" machine # [ 28.227705] k3s[886]: I1005 08:28:41.939620 886 shared_informer.go:409] "Caches are synced" machine # [ 28.228526] k3s[886]: I1005 08:28:41.939632 886 shared_informer.go:409] "Caches are synced" machine # [ 28.229465] k3s[886]: I1005 08:28:41.939720 886 shared_informer.go:409] "Caches are synced" machine # [ 28.231566] k3s[886]: I1005 08:28:41.939748 886 shared_informer.go:409] "Caches are synced" machine # [ 28.232447] k3s[886]: I1005 08:28:41.939724 886 shared_informer.go:409] "Caches are synced" machine # [ 28.233472] k3s[886]: I1005 08:28:41.939844 886 shared_informer.go:409] "Caches are synced" machine # [ 28.234526] k3s[886]: I1005 08:28:41.939858 886 shared_informer.go:409] "Caches are synced" machine # [ 28.235593] k3s[886]: I1005 08:28:41.939920 886 shared_informer.go:409] "Caches are synced" machine # [ 28.236631] k3s[886]: I1005 08:28:41.940020 886 shared_informer.go:409] "Caches are synced" machine # [ 28.237670] k3s[886]: I1005 08:28:41.940079 886 shared_informer.go:409] "Caches are synced" machine # [ 28.238690] k3s[886]: I1005 08:28:41.940597 886 shared_informer.go:409] "Caches are synced" machine # [ 28.239549] k3s[886]: I1005 08:28:41.940699 886 shared_informer.go:409] "Caches are synced" machine # [ 28.240557] k3s[886]: I1005 08:28:41.940748 886 shared_informer.go:409] "Caches are synced" machine # [ 28.241406] k3s[886]: I1005 08:28:41.940784 886 shared_informer.go:409] "Caches are synced" machine # [ 28.241842] k3s[886]: I1005 08:28:41.940863 886 shared_informer.go:409] "Caches are synced" machine # [ 28.242544] k3s[886]: I1005 08:28:41.944075 886 shared_informer.go:409] "Caches are synced" machine # [ 28.243120] k3s[886]: I1005 08:28:41.944131 886 shared_informer.go:409] "Caches are synced" machine # [ 28.243570] k3s[886]: I1005 08:28:41.944185 886 shared_informer.go:409] "Caches are synced" machine # [ 28.244104] k3s[886]: I1005 08:28:41.944282 886 shared_informer.go:409] "Caches are synced" machine # [ 28.244715] k3s[886]: I1005 08:28:41.944357 886 shared_informer.go:409] "Caches are synced" machine # [ 28.245422] k3s[886]: I1005 08:28:41.944416 886 range_allocator.go:177] "Sending events to api server" machine # [ 28.245906] k3s[886]: I1005 08:28:41.944445 886 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.246643] k3s[886]: I1005 08:28:41.944456 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.247236] k3s[886]: I1005 08:28:41.944467 886 shared_informer.go:409] "Caches are synced" machine # [ 28.247691] k3s[886]: I1005 08:28:41.944524 886 shared_informer.go:409] "Caches are synced" machine # [ 28.248416] k3s[886]: I1005 08:28:41.944550 886 shared_informer.go:409] "Caches are synced" machine # [ 28.248880] k3s[886]: I1005 08:28:41.944598 886 shared_informer.go:409] "Caches are synced" machine # [ 28.249575] k3s[886]: I1005 08:28:41.944699 886 shared_informer.go:409] "Caches are synced" machine # [ 28.250157] k3s[886]: I1005 08:28:41.944734 886 shared_informer.go:409] "Caches are synced" machine # [ 28.250600] k3s[886]: I1005 08:28:41.944778 886 shared_informer.go:409] "Caches are synced" machine # [ 28.251182] k3s[886]: I1005 08:28:41.944834 886 shared_informer.go:409] "Caches are synced" machine # [ 28.251677] k3s[886]: I1005 08:28:41.944872 886 shared_informer.go:409] "Caches are synced" machine # [ 28.252395] k3s[886]: I1005 08:28:41.944924 886 shared_informer.go:409] "Caches are synced" machine # [ 28.255628] k3s[886]: I1005 08:28:41.976548 886 shared_informer.go:409] "Caches are synced" machine # [ 28.270897] k3s[886]: time="2026-10-05T08:28:41Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.304792] k3s[886]: I1005 08:28:42.025732 886 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.308567] k3s[886]: I1005 08:28:42.029275 886 shared_informer.go:409] "Caches are synced" machine # [ 28.310391] k3s[886]: I1005 08:28:42.031339 886 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.391066] k3s[886]: I1005 08:28:42.111346 886 serving.go:417] Generated self-signed cert in-memory machine # [ 28.501252] k3s[886]: I1005 08:28:42.222080 886 serving.go:417] Generated self-signed cert in-memory machine # [ 28.508126] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/4v14fxahlxhgjlfn1jf5zd1cj1prhvgs-nix-grpc-farm-client.tar in 8.182661203s" machine # [ 28.508706] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/5kp7vafqw9fq3l1i0yrcvwh42vjrvs8s-nix-grpc-farm.tar" machine # [ 28.564645] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 28.611833] k3s[886]: I1005 08:28:42.332670 886 controllermanager.go:163] Version: v1.36.4+k3s1 machine # [ 28.614924] k3s[886]: I1005 08:28:42.335879 886 secure_serving.go:214] Serving securely on 127.0.0.1:10258 machine # [ 28.615296] k3s[886]: I1005 08:28:42.336229 886 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 28.615907] k3s[886]: I1005 08:28:42.336307 886 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 28.616595] k3s[886]: I1005 08:28:42.336323 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.617173] k3s[886]: I1005 08:28:42.336363 886 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 28.617947] k3s[886]: I1005 08:28:42.336389 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.618796] k3s[886]: I1005 08:28:42.336321 886 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 28.619604] k3s[886]: I1005 08:28:42.336426 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 28.620634] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Creating service-lb-controller event broadcaster" machine: (finished: waiting for success: kubectl get ns farm, in 4.93 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.18 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 29.017137] k3s[886]: I1005 08:28:42.737363 886 shared_informer.go:409] "Caches are synced" machine # [ 29.017547] k3s[886]: I1005 08:28:42.737369 886 shared_informer.go:409] "Caches are synced" machine # [ 29.018033] k3s[886]: I1005 08:28:42.738102 886 shared_informer.go:409] "Caches are synced" machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.17 seconds) machine # [ 29.114169] k3s[886]: I1005 08:28:42.835088 886 controller.go:667] quota admission added evaluator for: deployments.apps machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 29.127673] k3s[886]: I1005 08:28:42.848632 886 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 29.157489] k3s[886]: I1005 08:28:42.878415 886 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 29.159514] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 29.164069] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 29.177369] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 29.183060] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 29.188303] k3s[886]: I1005 08:28:42.909268 886 controllermanager.go:338] Started "cloud-node-lifecycle-controller" machine # [ 29.188678] k3s[886]: I1005 08:28:42.909645 886 controllermanager.go:338] Started "service-lb-controller" machine # [ 29.189175] k3s[886]: W1005 08:28:42.909666 886 controllermanager.go:315] "node-route-controller" is disabled machine # [ 29.189666] k3s[886]: I1005 08:28:42.909852 886 controllermanager.go:338] Started "cloud-node-controller" machine # [ 29.190201] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 29.190728] k3s[886]: I1005 08:28:42.910859 886 node_lifecycle_controller.go:112] Sending events to api server machine # [ 29.193087] k3s[886]: I1005 08:28:42.911008 886 node_controller.go:179] Sending events to api server. machine # [ 29.193653] k3s[886]: I1005 08:28:42.911165 886 controller.go:235] Starting service controller machine # [ 29.194210] k3s[886]: I1005 08:28:42.911182 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 29.194705] k3s[886]: I1005 08:28:42.911246 886 node_controller.go:188] Waiting for informer caches to sync machine # [ 29.213629] k3s[886]: I1005 08:28:42.934136 886 shared_informer.go:409] "Caches are synced" machine # [ 29.223462] k3s[886]: I1005 08:28:42.944426 886 shared_informer.go:409] "Caches are synced" machine # [ 29.223826] k3s[886]: I1005 08:28:42.944452 886 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.224499] k3s[886]: I1005 08:28:42.944503 886 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.263054] k3s[886]: time="2026-10-05T08:28:42Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.19 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 29.391054] k3s[886]: I1005 08:28:43.111859 886 shared_informer.go:409] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.095365] postgres[1196]: [1196] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 30.096137] postgres[1196]: [1196] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 30.119467] niks3-server[1188]: 2026/10/05 08:28:43 OK 20241026095416_initial_model.sql (11.52ms) machine # [ 30.125408] niks3-server[1188]: 2026/10/05 08:28:43 OK 20251210153512_drop_unused_gin_index.sql (3.73ms) machine # [ 30.130110] niks3-server[1188]: 2026/10/05 08:28:43 OK 20251218171726_add_pins.sql (4.66ms) machine # [ 30.134719] niks3-server[1188]: 2026/10/05 08:28:43 OK 20260628120000_add_object_size_and_stats.sql (4.54ms) machine # [ 30.137993] niks3-server[1188]: 2026/10/05 08:28:43 OK 20260905000000_add_claims.sql (3.23ms) machine # [ 30.141925] niks3-server[1188]: 2026/10/05 08:28:43 OK 20260920000000_drop_claims.sql (3.89ms) machine # [ 30.145027] niks3-server[1188]: 2026/10/05 08:28:43 OK 20260923120000_add_pushes.sql (3.03ms) machine # [ 30.145327] niks3-server[1188]: 2026/10/05 08:28:43 goose: successfully migrated database to version: 20260923120000 machine # [ 30.150470] niks3-server[1188]: 2026/10/05 08:28:43 OK 1_commit_pending_closure.sql (5.29ms) machine # [ 30.153359] niks3-server[1188]: 2026/10/05 08:28:43 OK 2_object_stats_trigger.sql (2.89ms) machine # [ 30.156839] niks3-server[1188]: 2026/10/05 08:28:43 OK 3_commit_push.sql (3.43ms) machine # [ 30.157448] niks3-server[1188]: 2026/10/05 08:28:43 goose: up to current file version: 3 machine # [ 30.161762] niks3-server[1188]: 2026/10/05 08:28:43 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.163596] niks3-server[1188]: 2026/10/05 08:28:43 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.166863] niks3-server[1188]: 2026/10/05 08:28:43 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.201913] niks3-server[1188]: 2026/10/05 08:28:43 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.202530] niks3-server[1188]: 2026/10/05 08:28:43 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.204259] niks3-server[1188]: 2026/10/05 08:28:43 INFO systemd watchdog enabled interval=15s machine # [ 30.204995] niks3-server[1188]: 2026/10/05 08:28:43 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.205644] systemd[1]: Started niks3 server. machine # [ 30.206257] systemd[1]: Reached target Multi-User System. machine # [ 30.209058] systemd[1]: Startup finished in 1.184s (kernel) + 3.796s (initrd) + 25.228s (userspace) = 30.208s. machine # [ 30.261782] k3s[886]: time="2026-10-05T08:28:43Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.203164] k3s[886]: time="2026-10-05T08:28:44Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 31.222672] k3s[886]: time="2026-10-05T08:28:44Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 31.265123] k3s[886]: time="2026-10-05T08:28:44Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.824423] k3s[886]: I1005 08:28:45.545325 886 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 31.827511] k3s[886]: time="2026-10-05T08:28:45Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 31.834876] k3s[886]: time="2026-10-05T08:28:45Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 32.202343] k3s[886]: time="2026-10-05T08:28:45Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 32.243099] k3s[886]: I1005 08:28:45.964001 886 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 32.246201] k3s[886]: time="2026-10-05T08:28:45Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 32.263657] k3s[886]: time="2026-10-05T08:28:45Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 32.264193] k3s[886]: time="2026-10-05T08:28:45Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.218476] k3s[886]: time="2026-10-05T08:28:46Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 33.248516] k3s[886]: time="2026-10-05T08:28:46Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 33.261990] k3s[886]: time="2026-10-05T08:28:46Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.200103] k3s[886]: time="2026-10-05T08:28:47Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.259203] k3s[886]: time="2026-10-05T08:28:47Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0" machine # [ 34.262259] k3s[886]: time="2026-10-05T08:28:47Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.264116] k3s[886]: time="2026-10-05T08:28:47Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:62b0b7c0e36bc5e060902f41fd80b7baec3fdc056b137820d6017eeb824c41a9" machine # [ 34.571970] k3s[886]: time="2026-10-05T08:28:48Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/5kp7vafqw9fq3l1i0yrcvwh42vjrvs8s-nix-grpc-farm.tar in 6.063189595s" machine # [ 34.572835] k3s[886]: time="2026-10-05T08:28:48Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/djnarcp7bpn4whbzn22i5vvf30pdwipi-nix-grpc-farm-lb.tar" machine # [ 35.267380] k3s[886]: time="2026-10-05T08:28:48Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.262562] k3s[886]: time="2026-10-05T08:28:49Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 36.456718] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0" machine # [ 36.461574] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 36.499839] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nixos/djnarcp7bpn4whbzn22i5vvf30pdwipi-nix-grpc-farm-lb.tar in 1.927610632s" machine # [ 36.502237] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.837900] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::509d:68b4:dc7d:8f2 --node-labels= --read-only-port=0" machine # [ 36.839512] k3s[886]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 36.856256] k3s[886]: I1005 08:28:50.577022 886 server.go:541] "Kubelet version" kubeletVersion="v1.36.4+k3s1" machine # [ 36.857430] k3s[886]: I1005 08:28:50.577172 886 server.go:543] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 36.858668] k3s[886]: I1005 08:28:50.577246 886 watchdog_linux.go:94] "Systemd watchdog is not enabled" machine # [ 36.860198] k3s[886]: I1005 08:28:50.577282 886 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 36.873511] k3s[886]: I1005 08:28:50.594286 886 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 36.882593] k3s[886]: I1005 08:28:50.603466 886 server.go:1444] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 36.893565] k3s[886]: I1005 08:28:50.614473 886 server.go:804] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 36.897110] k3s[886]: I1005 08:28:50.614538 886 server.go:865] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 36.897701] k3s[886]: I1005 08:28:50.614898 886 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 36.899095] k3s[886]: I1005 08:28:50.614943 886 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"MemoryReservationPolicy":"None","PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 36.900425] k3s[886]: I1005 08:28:50.615390 886 topology_manager.go:172] "Creating topology manager with none policy" machine # [ 36.900970] k3s[886]: I1005 08:28:50.615423 886 container_manager_linux.go:309] "Creating device plugin manager" machine # [ 36.902121] k3s[886]: I1005 08:28:50.615563 886 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 36.924121] k3s[886]: I1005 08:28:50.644949 886 state_mem.go:45] "Initialized" logger="CPUManager state memory" machine # [ 36.925755] k3s[886]: I1005 08:28:50.646710 886 kubelet.go:485] "Attempting to sync node with API server" machine # [ 36.926286] k3s[886]: I1005 08:28:50.646740 886 kubelet.go:386] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 36.926700] k3s[886]: I1005 08:28:50.646771 886 kubelet.go:397] "Adding apiserver pod source" machine # [ 36.927284] k3s[886]: I1005 08:28:50.646789 886 apiserver.go:41] "Waiting for node sync before watching apiserver pods" machine # [ 36.933274] k3s[886]: I1005 08:28:50.654116 886 kuberuntime_manager.go:308] "Container runtime initialized" containerRuntime="containerd" version="2.3.4-k3s1.36" apiVersion="v1" machine # [ 36.934480] k3s[886]: I1005 08:28:50.655370 886 kubelet.go:1002] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 36.935106] k3s[886]: I1005 08:28:50.655430 886 kubelet.go:1029] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 36.943633] k3s[886]: I1005 08:28:50.664589 886 server.go:1280] "Started kubelet" machine # [ 36.943972] k3s[886]: I1005 08:28:50.664691 886 server.go:193] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 36.944641] k3s[886]: I1005 08:28:50.664713 886 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 36.945213] k3s[886]: I1005 08:28:50.664811 886 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 36.946544] k3s[886]: I1005 08:28:50.665163 886 server.go:264] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 36.947504] k3s[886]: I1005 08:28:50.668280 886 server.go:354] "Adding debug handlers to kubelet server" machine # [ 36.950323] k3s[886]: I1005 08:28:50.671179 886 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 36.952961] k3s[886]: I1005 08:28:50.673916 886 volume_manager.go:310] "Starting Kubelet Volume Manager" machine # [ 36.953690] k3s[886]: I1005 08:28:50.674211 886 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 36.954240] k3s[886]: E1005 08:28:50.674250 886 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 36.954754] k3s[886]: I1005 08:28:50.674470 886 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 36.955613] k3s[886]: E1005 08:28:50.674499 886 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 36.956838] k3s[886]: I1005 08:28:50.674588 886 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 36.958152] k3s[886]: I1005 08:28:50.674676 886 reconciler.go:29] "Reconciler: start to sync state" machine # [ 36.960072] k3s[886]: I1005 08:28:50.679271 886 factory.go:222] Registration of the systemd container factory successfully machine # [ 36.960727] k3s[886]: I1005 08:28:50.679495 886 factory.go:220] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 36.961673] k3s[886]: I1005 08:28:50.682630 886 factory.go:222] Registration of the containerd container factory successfully machine # [ 36.965965] k3s[886]: E1005 08:28:50.686920 886 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 36.981992] k3s[886]: I1005 08:28:50.702936 886 cpu_manager.go:235] "Starting" policy="none" machine # [ 36.982560] k3s[886]: I1005 08:28:50.703070 886 cpu_manager.go:236] "Reconciling" reconcilePeriod="10s" machine # [ 36.983541] k3s[886]: I1005 08:28:50.703101 886 state_mem.go:45] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 36.999241] k3s[886]: I1005 08:28:50.720149 886 policy_none.go:50] "Start" machine # [ 36.999889] k3s[886]: I1005 08:28:50.720184 886 memory_manager.go:190] "Starting memorymanager" policy="None" machine # [ 37.000478] k3s[886]: I1005 08:28:50.720210 886 state_mem.go:40] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 37.028996] k3s[886]: I1005 08:28:50.749895 886 policy_none.go:44] "Start" machine # [ 37.034650] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 37.047121] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 37.052643] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 37.054470] k3s[886]: E1005 08:28:50.775332 886 kubelet_node_status.go:396] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 37.054779] k3s[886]: E1005 08:28:50.775336 886 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 37.064506] k3s[886]: E1005 08:28:50.785441 886 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 37.064809] k3s[886]: I1005 08:28:50.785587 886 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 37.064968] k3s[886]: I1005 08:28:50.785609 886 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 37.065695] k3s[886]: I1005 08:28:50.786462 886 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 37.068826] k3s[886]: E1005 08:28:50.789798 886 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 37.069700] k3s[886]: E1005 08:28:50.789862 886 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 37.079488] k3s[886]: I1005 08:28:50.800444 886 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv4" machine # [ 37.088600] k3s[886]: I1005 08:28:50.809261 886 kubelet_network_linux.go:53] "Initialized iptables rules." protocol="IPv6" machine # [ 37.088902] k3s[886]: I1005 08:28:50.809331 886 status_manager.go:277] "Starting to sync pod status with apiserver" machine # [ 37.089616] k3s[886]: I1005 08:28:50.809402 886 kubelet.go:2622] "Starting kubelet main sync loop" machine # [ 37.089984] k3s[886]: E1005 08:28:50.809468 886 kubelet.go:2646] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 37.153937] k3s[886]: E1005 08:28:50.874781 886 kubelet.go:3516] "Unable to register mirror pod because node is not registered yet" err="node \"machine\" not found" node="machine" machine # [ 37.167451] k3s[886]: I1005 08:28:50.888356 886 kubelet_node_status.go:75] "Attempting to register node" node="machine" machine # [ 37.177078] k3s[886]: I1005 08:28:50.895499 886 kubelet_node_status.go:78] "Successfully registered node" node="machine" machine # [ 37.177371] k3s[886]: E1005 08:28:50.895537 886 kubelet_node_status.go:479] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 37.177836] k3s[886]: I1005 08:28:50.896965 886 node_controller.go:432] Initializing node machine with cloud provider machine # [ 37.178515] k3s[886]: I1005 08:28:50.897018 886 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.179061] k3s[886]: E1005 08:28:50.897062 886 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.179621] k3s[886]: I1005 08:28:50.898123 886 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 37.180954] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 37.182146] k3s[886]: I1005 08:28:50.903108 886 node_controller.go:432] Initializing node machine with cloud provider machine # [ 37.182863] k3s[886]: I1005 08:28:50.903172 886 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.183511] k3s[886]: E1005 08:28:50.903193 886 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.192057] k3s[886]: I1005 08:28:50.912679 886 node_controller.go:432] Initializing node machine with cloud provider machine # [ 37.192756] k3s[886]: I1005 08:28:50.912749 886 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.193446] k3s[886]: E1005 08:28:50.912777 886 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.194052] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 37.194500] k3s[886]: I1005 08:28:50.914173 886 node_controller.go:432] Initializing node machine with cloud provider machine # [ 37.195851] k3s[886]: I1005 08:28:50.916135 886 node_controller.go:236] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 37.196122] k3s[886]: E1005 08:28:50.916178 886 node_controller.go:247] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 37.196606] k3s[886]: I1005 08:28:50.916442 886 node_controller.go:432] Initializing node machine with cloud provider machine # [ 37.197146] k3s[886]: I1005 08:28:50.916663 886 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 37.197635] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Starting flannel with backend vxlan" machine # [ 37.209060] k3s[886]: I1005 08:28:50.929555 886 kuberuntime_manager.go:2172] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 37.218571] k3s[886]: I1005 08:28:50.939458 886 kubelet_network.go:48] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 37.235088] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 37.236430] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 37.237704] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 37.239311] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 37.241157] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 37.243137] k3s[886]: E1005 08:28:50.944657 886 options.go:205] The manifest file is empty, ignoring. machine # [ 37.244478] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 37.245828] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Handling backend connection request [machine]" machine # [ 37.247237] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 37.248758] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 37.250537] k3s[886]: I1005 08:28:50.951569 886 server.go:176] "Starting Kubernetes Scheduler" version="v1.36.4+k3s1" machine # [ 37.252139] k3s[886]: I1005 08:28:50.951589 886 server.go:178] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 37.253647] k3s[886]: I1005 08:28:50.953879 886 node_controller.go:477] Successfully initialized node machine with cloud provider machine # [ 37.255307] k3s[886]: I1005 08:28:50.954554 886 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 37.257732] k3s[886]: I1005 08:28:50.956828 886 secure_serving.go:214] Serving securely on 127.0.0.1:10259 machine # [ 37.259143] k3s[886]: I1005 08:28:50.957092 886 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 37.260666] k3s[886]: I1005 08:28:50.957111 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 37.262057] k3s[886]: I1005 08:28:50.957342 886 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 37.265083] k3s[886]: I1005 08:28:50.957640 886 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 37.266526] k3s[886]: I1005 08:28:50.957933 886 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 37.268746] k3s[886]: I1005 08:28:50.957952 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 37.270064] k3s[886]: I1005 08:28:50.958019 886 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 37.272521] k3s[886]: I1005 08:28:50.958081 886 shared_informer.go:402] "Waiting for caches to sync" machine # [ 37.273918] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 37.275370] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 37.277087] k3s[886]: I1005 08:28:50.982892 886 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 37.278793] k3s[886]: I1005 08:28:50.983128 886 kube.go:537] Starting kube subnet manager machine # [ 37.278979] k3s[886]: time="2026-10-05T08:28:50Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 37.328842] k3s[886]: I1005 08:28:51.049713 886 kubelet_node_status.go:431] "Fast updating node status as it just became ready" machine # [ 37.336850] k3s[886]: I1005 08:28:51.057317 886 shared_informer.go:409] "Caches are synced" machine # [ 37.338246] k3s[886]: I1005 08:28:51.058079 886 shared_informer.go:409] "Caches are synced" machine # [ 37.339483] k3s[886]: I1005 08:28:51.058163 886 shared_informer.go:409] "Caches are synced" machine # [ 37.496213] k3s[886]: I1005 08:28:51.216572 886 server.go:228] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::509d:68b4:dc7d:8f2"] machine # [ 37.498526] k3s[886]: E1005 08:28:51.219475 886 server.go:265] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 37.523458] k3s[886]: I1005 08:28:51.244397 886 server.go:274] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 37.525117] k3s[886]: I1005 08:28:51.244460 886 server_linux.go:137] "Using iptables Proxier" machine # [ 37.545596] k3s[886]: I1005 08:28:51.266518 886 proxier.go:241] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 37.555784] k3s[886]: I1005 08:28:51.276467 886 server.go:539] "Version info" version="v1.36.4+k3s1" machine # [ 37.557320] k3s[886]: I1005 08:28:51.276509 886 server.go:541] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 37.558862] k3s[886]: I1005 08:28:51.278733 886 config.go:200] "Starting service config controller" machine # [ 37.560165] k3s[886]: I1005 08:28:51.278769 886 shared_informer.go:381] "Waiting for caches to sync" controller="service config" machine # [ 37.561730] k3s[886]: I1005 08:28:51.278807 886 config.go:106] "Starting endpoint slice config controller" machine # [ 37.563126] k3s[886]: I1005 08:28:51.278821 886 shared_informer.go:381] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 37.564850] k3s[886]: I1005 08:28:51.278854 886 config.go:403] "Starting serviceCIDR config controller" machine # [ 37.566180] k3s[886]: I1005 08:28:51.278867 886 shared_informer.go:381] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 37.567871] k3s[886]: I1005 08:28:51.279356 886 config.go:309] "Starting node config controller" machine # [ 37.569141] k3s[886]: I1005 08:28:51.279435 886 shared_informer.go:381] "Waiting for caches to sync" controller="node config" machine # [ 37.659045] k3s[886]: I1005 08:28:51.379888 886 shared_informer.go:388] "Caches are synced" controller="node config" machine # [ 37.758172] k3s[886]: I1005 08:28:51.478974 886 shared_informer.go:388] "Caches are synced" controller="service config" machine # [ 37.758414] k3s[886]: I1005 08:28:51.479128 886 shared_informer.go:388] "Caches are synced" controller="endpoint slice config" machine # [ 37.758882] k3s[886]: I1005 08:28:51.479143 886 shared_informer.go:388] "Caches are synced" controller="serviceCIDR config" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.929033] k3s[886]: I1005 08:28:51.649902 886 apiserver.go:51] "Watching apiserver" machine # [ 38.213397] systemd[1]: Created slice libcontainer container kubepods-burstable-pod46aa2a28_11ea_43a8_bd14_a45010fe824e.slice. machine # [ 38.226301] systemd[1]: Created slice libcontainer container kubepods-burstable-podc8a9081b_9e98_441b_a6fb_f27a597744c3.slice. machine # [ 38.237490] k3s[886]: time="2026-10-05T08:28:51Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 38.240106] k3s[886]: I1005 08:28:51.960995 886 node_lifecycle_controller.go:1217] "Initializing eviction metric for zone" zone="" machine # [ 38.242129] k3s[886]: I1005 08:28:51.961123 886 node_lifecycle_controller.go:869] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.244133] k3s[886]: I1005 08:28:51.961214 886 node_lifecycle_controller.go:1063] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.253978] k3s[886]: I1005 08:28:51.974932 886 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 38.262211] k3s[886]: I1005 08:28:51.983139 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-tmp\") pod \"helm-install-nix-grpc-farm-lscgs\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " pod="kube-system/helm-install-nix-grpc-farm-lscgs" machine # [ 38.267217] k3s[886]: I1005 08:28:51.983153 886 kube.go:163] Node controller sync successful machine # [ 38.267676] k3s[886]: I1005 08:28:51.983185 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-values\") pod \"helm-install-nix-grpc-farm-lscgs\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " pod="kube-system/helm-install-nix-grpc-farm-lscgs" machine # [ 38.268376] k3s[886]: I1005 08:28:51.983222 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2hhl\" (UniqueName: \"kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-kube-api-access-t2hhl\") pod \"helm-install-nix-grpc-farm-lscgs\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " pod="kube-system/helm-install-nix-grpc-farm-lscgs" machine # [ 38.269090] k3s[886]: I1005 08:28:51.983230 886 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 38.269581] k3s[886]: I1005 08:28:51.983249 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/46aa2a28-11ea-43a8-bd14-a45010fe824e-config-volume\") pod \"coredns-54996dc9b4-2njdv\" (UID: \"46aa2a28-11ea-43a8-bd14-a45010fe824e\") " pod="kube-system/coredns-54996dc9b4-2njdv" machine # [ 38.270200] k3s[886]: I1005 08:28:51.983284 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwtqg\" (UniqueName: \"kubernetes.io/projected/46aa2a28-11ea-43a8-bd14-a45010fe824e-kube-api-access-jwtqg\") pod \"coredns-54996dc9b4-2njdv\" (UID: \"46aa2a28-11ea-43a8-bd14-a45010fe824e\") " pod="kube-system/coredns-54996dc9b4-2njdv" machine # [ 38.270690] k3s[886]: I1005 08:28:51.983607 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-helm\") pod \"helm-install-nix-grpc-farm-lscgs\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " pod="kube-system/helm-install-nix-grpc-farm-lscgs" machine # [ 38.270868] k3s[886]: I1005 08:28:51.983658 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-cache\") pod \"helm-install-nix-grpc-farm-lscgs\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " pod="kube-system/helm-install-nix-grpc-farm-lscgs" machine # [ 38.271668] k3s[886]: I1005 08:28:51.983740 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/c8a9081b-9e98-441b-a6fb-f27a597744c3-content\") pod \"helm-install-nix-grpc-farm-lscgs\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " pod="kube-system/helm-install-nix-grpc-farm-lscgs" machine # [ 38.272465] k3s[886]: I1005 08:28:51.983784 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/46aa2a28-11ea-43a8-bd14-a45010fe824e-custom-config-volume\") pod \"coredns-54996dc9b4-2njdv\" (UID: \"46aa2a28-11ea-43a8-bd14-a45010fe824e\") " pod="kube-system/coredns-54996dc9b4-2njdv" machine # [ 38.272965] k3s[886]: I1005 08:28:51.983814 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-config\") pod \"helm-install-nix-grpc-farm-lscgs\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " pod="kube-system/helm-install-nix-grpc-farm-lscgs" machine # [ 38.273370] k3s[886]: I1005 08:28:51.987058 886 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::509d:68b4:dc7d:8f2", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::509d:68b4:dc7d:8f2", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 38.333284] (udev-worker)[1336]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.340862] k3s[886]: I1005 08:28:52.061547 886 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 38.342841] k3s[886]: I1005 08:28:52.063804 886 iptables.go:50] Starting flannel in iptables mode... machine # [ 38.343475] k3s[886]: time="2026-10-05T08:28:52Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 38.343931] k3s[886]: time="2026-10-05T08:28:52Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 38.344663] k3s[886]: time="2026-10-05T08:28:52Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 38.348937] k3s[886]: time="2026-10-05T08:28:52Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 38.349246] k3s[886]: I1005 08:28:52.063937 886 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 38.366914] dhcpcd[685]: flannel.1: IAID 5e:38:15:15 machine # [ 38.367805] dhcpcd[685]: flannel.1: adding address fe80::40e9:5eff:fe38:1515 machine # [ 38.400291] k3s[886]: I1005 08:28:52.121180 886 iptables.go:111] Setting up masking rules machine # [ 38.413474] k3s[886]: I1005 08:28:52.134390 886 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 38.425078] k3s[886]: time="2026-10-05T08:28:52Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 38.425412] k3s[886]: time="2026-10-05T08:28:52Z" level=info msg="Running flannel backend" machine # [ 38.425903] k3s[886]: I1005 08:28:52.146094 886 vxlan_network.go:68] watching for new subnet leases machine # [ 38.426610] k3s[886]: I1005 08:28:52.146141 886 vxlan_network.go:115] starting vxlan device watcher machine # [ 38.492416] k3s[886]: I1005 08:28:52.213250 886 iptables.go:358] bootstrap done machine # [ 38.538993] k3s[886]: I1005 08:28:52.259555 886 iptables.go:358] bootstrap done machine # [ 38.613305] (udev-worker)[133[ 38.768863] cni0: port 1(vethfe0a2820) entered blocking state machine # 7]: Network interface NamePolicy= disabled on ke[ 38.769978] cni0: port 1(vethfe0a2820) entered disabled state machine # rnel command line. machine # [ 38.771077] vethfe0a2820: entered allmulticast mode machine # [ 38.771859] vethfe0a2820: entered promiscuous mode machine # [ 38.619233] (udev-worker)[1574]: Network interface NamePolicy= disabled on kernel command line. machine # [ 38.778415] cni0: port 2(veth10b8b603) entered blocking state machine # [ 38.779079] cni0: port 2(veth10b8b603) entered disabled state machine # [ 38.780042] veth10b8b603: entered allmulticast mode machine # [ 38.780918] veth10b8b603: entered promiscuous mode machine # [ 38.788062] cni0: port 1(vethfe0a2820) entered blocking state machine # [ 38.788914] cni0: port 1(vethfe0a2820) entered forwarding state machine # [ 38.795650] cni0: port 2(veth10b8b603) entered blocking state machine # [ 38.796458] cni0: port 2(veth10b8b603) entered forwarding state machine # [ 38.672510] dhcpcd[685]: veth10b8b603: waiting for carrier machine # [ 38.685427] dhcpcd[685]: vethfe0a2820: IAID db:a7:9d:88 machine # [ 38.685585] dhcpcd[685]: vethfe0a2820: adding address fe80::a05f:dbff:fea7:9d88 machine # [ 38.685926] dhcpcd[685]: veth10b8b603: carrier acquired machine # [ 38.691187] dhcpcd[685]: veth10b8b603: IAID 5c:80:f3:37 machine # [ 38.691485] dhcpcd[685]: veth10b8b603: adding address fe80::2057:5cff:fe80:f337 machine # [ 38.840312] dhcpcd[685]: flannel.1: soliciting a DHCP lease machine # [ 39.008229] cni0: port 2(veth10b8b603) entered disabled state machine # [ 38.853293] dhcpcd[685]: veth10b8b603: carrier lost machine # [ 39.010957] veth10b8b603 (unregistering): left allmulticast mode machine # [ 39.012138] veth10b8b603 (unregistering): left promiscuous mode machine # [ 39.016422] cni0: port 2(veth10b8b603) entered disabled state machine # [ 38.886278] dhcpcd[685]: veth10b8b603: deleting address fe80::2057:5cff:fe80:f337 machine # [ 38.886972] dhcpcd[685]: veth10b8b603: removing interface machine # [ 38.887734] k3s[886]: E1005 08:28:52.608105 886 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 38.888441] k3s[886]: E1005 08:28:52.608260 886 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-lscgs" machine # [ 38.888933] k3s[886]: E1005 08:28:52.608292 886 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/ranche[ 39.058961] cni0: port 1(vethfe0a2820) entered disabled state machine # r/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/helm-install-nix-grpc-farm-lscgs" machine # [ 38.890987] k3s[886]: E1005 08:28:52.608407 886 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-lscgs_kube-system(c8a9081b-9e98-441b-a6fb-f27a597744c3)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-lscgs_kube-system(c8a9081b-9e98-441b-a6fb-f27a597744c3)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/helm-install-nix-grpc-farm-lscgs" podUID="c8a9081b-9e98-441b-a6fb-f27a597744c3" machine # [ 38.905657] dhcpcd[685]: vethfe0a2820: carrier lost machine # [ 39.074106] vethfe0a2820 (unregistering): left allmulticast mode machine # [ 39.075189] vethfe0a2820 (unregistering): left promiscuous mode machine # [ 39.076373] cni0: port 1(vethfe0a2820) entered disabled state machine # [ 38.953422] dhcpcd[685]: vethfe0a2820: deleting address fe80::a05f:dbff:fea7:9d88 machine # [ 38.954051] dhcpcd[685]: vethfe0a2820: removing interface machine # [ 38.954858] k3s[886]: E1005 08:28:52.675498 886 remote_runtime.go:237] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" machine # [ 38.955470] k3s[886]: E1005 08:28:52.675588 886 kuberuntime_sandbox.go:70] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-2njdv" machine # [ 38.956242] k3s[886]: E1005 08:28:52.675616 886 kuberuntime_manager.go:1640] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to pull image \"rancher/mirrored-pause:3.10.2\": failed to pull and unpack image \"docker.io/rancher/mirrored-pause:3.10.2\": failed to resolve reference \"docker.io/rancher/mirrored-pause:3.10.2\": failed to do request: Head \"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\": dial tcp: lookup registry-1.docker.io: no such host" pod="kube-system/coredns-54996dc9b4-2njdv" machine # [ 38.956845] k3s[886]: E1005 08:28:52.675742 886 pod_workers.go:1338] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-54996dc9b4-2njdv_kube-system(46aa2a28-11ea-43a8-bd14-a45010fe824e)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-54996dc9b4-2njdv_kube-system(46aa2a28-11ea-43a8-bd14-a45010fe824e)\\\": rpc error: code = Unknown desc = failed to pull image \\\"rancher/mirrored-pause:3.10.2\\\": failed to pull and unpack image \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to resolve reference \\\"docker.io/rancher/mirrored-pause:3.10.2\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/rancher/mirrored-pause/manifests/3.10.2\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="kube-system/coredns-54996dc9b4-2njdv" podUID="46aa2a28-11ea-43a8-bd14-a45010fe824e" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.396930] k3s[886]: time="2026-10-05T08:28:53Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 39.397597] k3s[886]: I1005 08:28:53.117816 886 network_policy_controller.go:164] Starting network policy controller machine # [ 39.589097] k3s[886]: I1005 08:28:53.309133 886 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 41.110971] dhcpcd[685]: flannel.1: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 41.507945] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 41.511245] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 41.513673] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 41.515648] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 41.516160] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 41.519777] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 41.520385] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 41.525291] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 41.525691] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 41.532095] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 41.532562] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 41.535424] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 41.536226] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 41.541171] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 41.543550] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 41.547107] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 41.820501] k3s[886]: time="2026-10-05T08:28:55Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/nixos/smddpgqzjvlqv3lx57wdzl7kma805fj0-k3s-airgap-images-amd64.tar.zst in 5.320146275s" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 43.843052] dhcpcd[685]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.684424] dhcpcd[685]: flannel.1: using IPv4LL address 169.254.127.180 machine # [ 49.687251] dhcpcd[685]: flannel.1: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.476335] cni0: port 1(vethab5283f5) entered blocking state machine # [ 51.478530] cni0: port 1(vethab5283f5) entered disabled state machine # [ 51.480536] vethab5283f5: entered allmulticast mode machine # [ 51.482522] vethab5283f5: entered promiscuous mode machine # [ 51.498752] cni0: port 1(vethab5283f5) entered blocking state machine # [ 51.500017] cni0: port 1(vethab5283f5) entered forwarding state machine # [ 51.373859] (udev-worker)[2054]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.399340] dhcpcd[685]: vethab5283f5: IAID a3:e2:dc:5e machine # [ 51.399761] dhcpcd[685]: vethab5283f5: adding address fe80::c78:a3ff:fee2:dc5e machine # [ 51.411711] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3202790110.mount: Deactivated successfully. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.487462] systemd[1]: Started libcontainer container 06d043a668d63a045498cf4fb2623827e5e85f6e94209c3c33e09ced6b740561. machine # [ 52.413948] systemd[1]: Started libcontainer container 6acb330a7462deca40bd094999e448955c105c309864f3f17f95942a3b4a5b99. machine # [ 52.526629] k3s[886]: I1005 08:29:06.246548 886 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-lscgs" podStartSLOduration=20.246526718 podStartE2EDuration="20.246526718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 08:28:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 08:29:06.244854159 +0000 UTC m=+35.530529995" watchObservedRunningTime="2026-10-05 08:29:06.246526718 +0000 UTC m=+35.532202554" machine # [ 52.582578] dhcpcd[685]: vethab5283f5: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 52.653720] dhcpcd[685]: vethab5283f5: soliciting a DHCP lease machine # [ 53.114129] dhcpcd[685]: flannel.1: no IPv6 Routers available machine # [ 53.420165] cni0: port 2(vethedec12a2) entered blocking state machine # [ 53.265770] (udev-worker)[206[ 53.422002] cni0: port 2(vethedec12a2) entered disabled state machine # 6]: Network interface NamePolicy= disabled on ke[ 53.424127] vethedec12a2: entered allmulticast mode machine # rnel command line. machine # [ 53.425896] vethedec12a2: entered promiscuous mode machine # [ 53.438560] cni0: port 2(vethedec12a2) entered blocking state machine # [ 53.439300] cni0: port 2(vethedec12a2) entered forwarding state machine # [ 53.307859] dhcpcd[685]: vethedec12a2: IAID 96:af:f6:40 machine # [ 53.308913] dhcpcd[685]: vethedec12a2: adding address fe80::e4af:96ff:feaf:f640 machine # [ 53.391382] systemd[1]: Started libcontainer container ed8414fef0bbd72783932bc22d7f835af31c2e1cb6496311d5351f0853aaa226. machine # [ 53.489379] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3801743753.mount: Deactivated successfully. machine # [ 53.603606] dhcpcd[685]: vethedec12a2: soliciting a DHCP lease machine # [ 53.690501] k3s[886]: I1005 08:29:07.409896 886 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.203.84"} machine # [ 53.774937] systemd[1]: cri-containerd-6acb330a7462deca40bd094999e448955c105c309864f3f17f95942a3b4a5b99.scope: Deactivated successfully. machine # [ 53.775619] systemd[1]: cri-containerd-6acb330a7462deca40bd094999e448955c105c309864f3f17f95942a3b4a5b99.scope: Consumed 633ms CPU time over 1.361s wall clock time, 33.8M memory peak, 2.6M incoming IP traffic, 150.3K outgoing IP traffic. machine # [ 53.821546] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-6acb330a7462deca40bd094999e448955c105c309864f3f17f95942a3b4a5b99-rootfs.mount: Deactivated successfully. machine # [ 54.199118] k3s[886]: E1005 08:29:07.919418 886 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-685b9cb6c\" failed with read version: 449 is not as new as written version: 468 for group resource replicasets.apps" logger="UnhandledError" machine # [ 54.199470] k3s[886]: E1005 08:29:07.920255 886 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-scheduler-586f48856c\" failed with read version: 449 is not as new as written version: 469 for group resource replicasets.apps" logger="UnhandledError" machine # [ 54.201583] k3s[886]: E1005 08:29:07.922548 886 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-685b9cb6c\" failed with read version: 449 is not as new as written version: 468 for group resource replicasets.apps" logger="UnhandledError" machine # [ 54.215045] k3s[886]: E1005 08:29:07.924569 886 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-685b9cb6c\" failed with read version: 449 is not as new as written version: 468 for group resource replicasets.apps" logger="UnhandledError" machine # [ 54.230681] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod92502b47_9312_4c7c_9b00_307e26ed7b0a.slice. machine # [ 54.254364] systemd[1]: Started libcontainer container 0f11ff64fa446399b40925771634b151a1764e1e05550f0065a135d1b7268ab0. machine # [ 54.257877] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod49ea09ee_3edc_4792_944e_0757eafe5573.slice. machine # [ 54.270866] systemd[1]: Created slice libcontainer container kubepods-besteffort-podacdc11b8_7276_4e62_9f7b_568d219fb506.slice. machine # [ 54.273075] k3s[886]: I1005 08:29:07.993242 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92502b47-9312-4c7c-9b00-307e26ed7b0a-tmp\") pod \"nix-grpc-farm-lb-685b9cb6c-5pqwx\" (UID: \"92502b47-9312-4c7c-9b00-307e26ed7b0a\") " pod="farm/nix-grpc-farm-lb-685b9cb6c-5pqwx" machine # [ 54.273976] k3s[886]: I1005 08:29:07.993285 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/49ea09ee-3edc-4792-944e-0757eafe5573-ca\") pod \"nix-grpc-farm-scheduler-586f48856c-7ks5k\" (UID: \"49ea09ee-3edc-4792-944e-0757eafe5573\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-7ks5k" machine # [ 54.274653] k3s[886]: I1005 08:29:07.993321 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/acdc11b8-7276-4e62-9f7b-568d219fb506-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8\" (UID: \"acdc11b8-7276-4e62-9f7b-568d219fb506\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" machine # [ 54.275226] k3s[886]: I1005 08:29:07.993348 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/29805275-1cf4-4e86-8789-92c5a2bfc752-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s\" (UID: \"29805275-1cf4-4e86-8789-92c5a2bfc752\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" machine # [ 54.275758] k3s[886]: I1005 08:29:07.993381 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/29805275-1cf4-4e86-8789-92c5a2bfc752-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s\" (UID: \"29805275-1cf4-4e86-8789-92c5a2bfc752\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" machine # [ 54.276856] k3s[886]: I1005 08:29:07.993406 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/49ea09ee-3edc-4792-944e-0757eafe5573-oidc\") pod \"nix-grpc-farm-scheduler-586f48856c-7ks5k\" (UID: \"49ea09ee-3edc-4792-944e-0757eafe5573\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-7ks5k" machine # [ 54.277541] k3s[886]: I1005 08:29:07.993438 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxkjx\" (UniqueName: \"kubernetes.io/projected/acdc11b8-7276-4e62-9f7b-568d219fb506-kube-api-access-rxkjx\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8\" (UID: \"acdc11b8-7276-4e62-9f7b-568d219fb506\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" machine # [ 54.278080] k3s[886]: I1005 08:29:07.993467 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/29805275-1cf4-4e86-8789-92c5a2bfc752-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s\" (UID: \"29805275-1cf4-4e86-8789-92c5a2bfc752\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" machine # [ 54.278847] k3s[886]: I1005 08:29:07.993497 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/29805275-1cf4-4e86-8789-92c5a2bfc752-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s\" (UID: \"29805275-1cf4-4e86-8789-92c5a2bfc752\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" machine # [ 54.279856] k3s[886]: I1005 08:29:07.993525 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/29805275-1cf4-4e86-8789-92c5a2bfc752-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s\" (UID: \"29805275-1cf4-4e86-8789-92c5a2bfc752\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" machine # [ 54.280829] k3s[886]: I1005 08:29:07.993565 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dppth\" (UniqueName: \"kubernetes.io/projected/49ea09ee-3edc-4792-944e-0757eafe5573-kube-api-access-dppth\") pod \"nix-grpc-farm-scheduler-586f48856c-7ks5k\" (UID: \"49ea09ee-3edc-4792-944e-0757eafe5573\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-7ks5k" machine # [ 54.281461] k3s[886]: I1005 08:29:07.993596 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/29805275-1cf4-4e86-8789-92c5a2bfc752-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s\" (UID: \"29805275-1cf4-4e86-8789-92c5a2bfc752\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" machine # [ 54.283540] k3s[886]: I1005 08:29:07.993629 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/acdc11b8-7276-4e62-9f7b-568d219fb506-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8\" (UID: \"acdc11b8-7276-4e62-9f7b-568d219fb506\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" machine # [ 54.288288] k3s[886]: I1005 08:29:07.993654 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/acdc11b8-7276-4e62-9f7b-568d219fb506-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8\" (UID: \"acdc11b8-7276-4e62-9f7b-568d219fb506\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" machine # [ 54.293149] k3s[886]: I1005 08:29:07.993681 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-ca\") pod \"nix-grpc-farm-lb-685b9cb6c-5pqwx\" (UID: \"92502b47-9312-4c7c-9b00-307e26ed7b0a\") " pod="farm/nix-grpc-farm-lb-685b9cb6c-5pqwx" machine # [ 54.335125] k3s[886]: I1005 08:29:07.993704 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/acdc11b8-7276-4e62-9f7b-568d219fb506-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8\" (UID: \"acdc11b8-7276-4e62-9f7b-568d219fb506\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" machine # [ 54.335940] k3s[886]: I1005 08:29:07.993729 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/acdc11b8-7276-4e62-9f7b-568d219fb506-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8\" (UID: \"acdc11b8-7276-4e62-9f7b-568d219fb506\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" machine # [ 54.336570] k3s[886]: I1005 08:29:07.993761 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/acdc11b8-7276-4e62-9f7b-568d219fb506-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8\" (UID: \"acdc11b8-7276-4e62-9f7b-568d219fb506\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" machine # [ 54.337109] k3s[886]: I1005 08:29:07.993787 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/29805275-1cf4-4e86-8789-92c5a2bfc752-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s\" (UID: \"29805275-1cf4-4e86-8789-92c5a2bfc752\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" machine # [ 54.337612] k3s[886]: I1005 08:29:07.993811 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9p4t\" (UniqueName: \"kubernetes.io/projected/29805275-1cf4-4e86-8789-92c5a2bfc752-kube-api-access-s9p4t\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s\" (UID: \"29805275-1cf4-4e86-8789-92c5a2bfc752\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" machine # [ 54.338167] k3s[886]: I1005 08:29:07.993837 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/49ea09ee-3edc-4792-944e-0757eafe5573-tls\") pod \"nix-grpc-farm-scheduler-586f48856c-7ks5k\" (UID: \"49ea09ee-3edc-4792-944e-0757eafe5573\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-7ks5k" machine # [ 54.338613] k3s[886]: I1005 08:29:07.993866 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/acdc11b8-7276-4e62-9f7b-568d219fb506-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8\" (UID: \"acdc11b8-7276-4e62-9f7b-568d219fb506\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" machine # [ 54.339185] k3s[886]: I1005 08:29:07.993890 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/acdc11b8-7276-4e62-9f7b-568d219fb506-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8\" (UID: \"acdc11b8-7276-4e62-9f7b-568d219fb506\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" machine # [ 54.339768] k3s[886]: I1005 08:29:07.993919 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92502b47-9312-4c7c-9b00-307e26ed7b0a-config\") pod \"nix-grpc-farm-lb-685b9cb6c-5pqwx\" (UID: \"92502b47-9312-4c7c-9b00-307e26ed7b0a\") " pod="farm/nix-grpc-farm-lb-685b9cb6c-5pqwx" machine # [ 54.340607] k3s[886]: I1005 08:29:07.993943 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-lb\") pod \"nix-grpc-farm-lb-685b9cb6c-5pqwx\" (UID: \"92502b47-9312-4c7c-9b00-307e26ed7b0a\") " pod="farm/nix-grpc-farm-lb-685b9cb6c-5pqwx" machine # [ 54.340939] k3s[886]: I1005 08:29:07.993970 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/49ea09ee-3edc-4792-944e-0757eafe5573-niks3-token\") pod \"nix-grpc-farm-scheduler-586f48856c-7ks5k\" (UID: \"49ea09ee-3edc-4792-944e-0757eafe5573\") " pod="farm/nix-grpc-farm-scheduler-586f48856c-7ks5k" machine # [ 54.345204] k3s[886]: I1005 08:29:07.993993 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/29805275-1cf4-4e86-8789-92c5a2bfc752-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s\" (UID: \"29805275-1cf4-4e86-8789-92c5a2bfc752\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" machine # [ 54.349759] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod29805275_1cf4_4e86_8789_92c5a2bfc752.slice. machine # [ 54.473879] k3s[886]: I1005 08:29:08.194701 886 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-54996dc9b4-2njdv" podStartSLOduration=26.19467292 podStartE2EDuration="26.19467292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 08:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 08:29:08.194364222 +0000 UTC m=+37.480040337" watchObservedRunningTime="2026-10-05 08:29:08.19467292 +0000 UTC m=+37.480349036" machine # [ 54.548361] dhcpcd[685]: vethedec12a2: soliciting an IPv6 router machine # [ 54.744598] cni0: port 3(veth570e16d4) entered blocking state machine # [ 54.746220] cni0: port 3(veth570e16d4) entered disabled state machine # [ 54.747395] veth570e16d4: entered allmulticast mode machine # [ 54.748021] veth570e16d4: entered promiscuous mode machine # [ 54.756057] cni0: port 4(veth79f2721d) entered blocking state machine # [ 54.756837] cni0: port 4(veth79f2721d) entered disabled state machine # [ 54.757645] veth79f2721d: entered allmulticast mode machine # [ 54.758656] veth79f2721d: entered promiscuous mode machine # [ 54.760906] cni0: port 3(veth570e16d4) entered blocking state machine # [ 54.761651] cni0: port 3(veth570e16d4) entered forwarding state machine # [ 54.769785] cni0: port 4(veth79f2721d) entered blocking state machine # [ 54.770825] cni0: port 4(veth79f2721d) entered forwarding state machine # [ 54.648636] (udev-worker)[2545]: Network interface NamePolicy= disabled on kernel command line. machine # [ 54.650766] (udev-worker)[2551]: Network interface NamePolicy= disabled on kernel command line. machine # [ 54.771713] dhcpcd[685]: veth79f2721d: IAID 79:c7:d8:ea machine # [ 54.771947] dhcpcd[685]: veth79f2721d: adding address fe80::acd0:79ff:fec7:d8ea machine # [ 54.783509] dhcpcd[685]: veth570e16d4: IAID 1c:15:24:4e machine # [ 54.783672] dhcpcd[685]: veth570e16d4: adding address fe80::c472:1cff:fe15:244e machine # [ 54.859366] (udev-worker)[2565]: Network interface NamePolicy= disabled on kernel command line. machine # [ 55.016328] cni0: port 5(vethbc264d49) entered blocking state machine # [ 55.017733] cni0: port 5(vethbc264d49) entered disabled state machine # [ 55.018947] vethbc264d49: entered allmulticast mode machine # [ 55.019945] vethbc264d49: entered promiscuous mode machine # [ 54.871740] (udev-worker)[2566]: Network interface NamePolicy= disabled on kernel command line. machine # [ 55.030468] cni0: port 6(veth11c67e3f) entered blocking state machine # [ 55.031955] cni0: port 6(veth11c67e3f) entered disabled state machine # [ 55.033035] veth11c67e3f: entered allmulticast mode machine # [ 55.034313] veth11c67e3f: entered promiscuous mode machine # [ 55.036634] cni0: port 5(vethbc264d49) entered blocking state machine # [ 55.038025] cni0: port 5(vethbc264d49) entered forwarding state machine # [ 55.050788] cni0: port 6(veth11c67e3f) entered blocking state machine # [ 55.051844] cni0: port 6(veth11c67e3f) entered forwarding state machine # [ 54.901631] dhcpcd[685]: vethbc264d49: IAID 39:10:0a:73 machine # [ 54.902648] dhcpcd[685]: vethbc264d49: adding address fe80::a837:39ff:fe10:a73 machine # [ 54.919391] dhcpcd[685]: veth11c67e3f: IAID a2:f4:ff:1e machine # [ 54.919901] dhcpcd[685]: veth11c67e3f: adding address fe80::c6:a2ff:fef4:ff1e machine # [ 54.932779] systemd[1]: Started libcontainer container 780a7e8bb2f1289ab7fe893ba17f27ba980314dd1de2340bb3bd874a8da1afd8. machine # [ 54.938117] systemd[1]: Started libcontainer container 3b27d5981060e1e49a170565b5aa58f416720902afebba0ac8f09e77f1a55264. machine # [ 54.939894] dhcpcd[685]: veth79f2721d: soliciting a DHCP lease machine # [ 55.047470] systemd[1]: Started libcontainer container 939184910367fb592f572945d68492219bd7bd89ed9c537f063e6d6d68fc61e2. machine # [ 55.053972] systemd[1]: Started libcontainer container 6bf75ba4494ab64fdd90333e3c4c7381b75c28812a7209cff860ea1bb864e6cc. machine # [ 55.181751] systemd[1]: cri-containerd-06d043a668d63a045498cf4fb2623827e5e85f6e94209c3c33e09ced6b740561.scope: Deactivated successfully. machine # [ 55.324495] dhcpcd[685]: vethab5283f5: carrier lost machine # [ 55.481058] cni0: port 1(vethab5283f5) entered disabled state machine # [ 55.483104] vethab5283f5 (unregistering): left allmulticast mode machine # [ 55.484214] vethab5283f5 (unregistering): left promiscuous mode machine # [ 55.486057] cni0: port 1(vethab5283f5) entered disabled state machine # [ 55.353893] dhcpcd[685]: vethab5283f5: deleting address fe80::c78:a3ff:fee2:dc5e machine # [ 55.399483] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-06d043a668d63a045498cf4fb2623827e5e85f6e94209c3c33e09ced6b740561-rootfs.mount: Deactivated successfully. machine # [ 55.402291] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-06d043a668d63a045498cf4fb2623827e5e85f6e94209c3c33e09ced6b740561-shm.mount: Deactivated successfully. machine # [ 55.404927] systemd[1]: run-netns-cni\x2d8837f446\x2dcaae\x2d076f\x2d6c8b\x2d6494ec3fe3d5.mount: Deactivated successfully. machine # [ 55.417279] dhcpcd[685]: vethab5283f5: removing interface machine # [ 55.480288] k3s[886]: I1005 08:29:09.199682 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-values\" (UniqueName: \"kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-values\") pod \"c8a9081b-9e98-441b-a6fb-f27a597744c3\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " machine # [ 55.485688] k3s[886]: I1005 08:29:09.199742 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-config\") pod \"c8a9081b-9e98-441b-a6fb-f27a597744c3\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " machine # [ 55.490887] k3s[886]: I1005 08:29:09.199801 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-cache\") pod \"c8a9081b-9e98-441b-a6fb-f27a597744c3\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " machine # [ 55.495819] k3s[886]: I1005 08:29:09.199838 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8a9081b-9e98-441b-a6fb-f27a597744c3-content\" (UniqueName: \"kubernetes.io/configmap/c8a9081b-9e98-441b-a6fb-f27a597744c3-content\") pod \"c8a9081b-9e98-441b-a6fb-f27a597744c3\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " machine # [ 55.500599] k3s[886]: I1005 08:29:09.199878 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-kube-api-access-t2hhl\" (UniqueName: \"kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-kube-api-access-t2hhl\") pod \"c8a9081b-9e98-441b-a6fb-f27a597744c3\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " machine # [ 55.505569] k3s[886]: I1005 08:29:09.199911 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-tmp\") pod \"c8a9081b-9e98-441b-a6fb-f27a597744c3\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " machine # [ 55.511931] k3s[886]: I1005 08:29:09.199955 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-helm\") pod \"c8a9081b-9e98-441b-a6fb-f27a597744c3\" (UID: \"c8a9081b-9e98-441b-a6fb-f27a597744c3\") " machine # [ 55.517414] k3s[886]: I1005 08:29:09.204187 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8a9081b-9e98-441b-a6fb-f27a597744c3-content" pod "c8a9081b-9e98-441b-a6fb-f27a597744c3" (UID: "c8a9081b-9e98-441b-a6fb-f27a597744c3"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 55.522322] k3s[886]: I1005 08:29:09.216834 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-config" pod "c8a9081b-9e98-441b-a6fb-f27a597744c3" (UID: "c8a9081b-9e98-441b-a6fb-f27a597744c3"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 55.522653] k3s[886]: I1005 08:29:09.221716 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-values" pod "c8a9081b-9e98-441b-a6fb-f27a597744c3" (UID: "c8a9081b-9e98-441b-a6fb-f27a597744c3"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 55.523612] k3s[886]: I1005 08:29:09.225117 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-cache" pod "c8a9081b-9e98-441b-a6fb-f27a597744c3" (UID: "c8a9081b-9e98-441b-a6fb-f27a597744c3"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 55.524539] k3s[886]: I1005 08:29:09.233280 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-tmp" pod "c8a9081b-9e98-441b-a6fb-f27a597744c3" (UID: "c8a9081b-9e98-441b-a6fb-f27a597744c3"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 55.525888] k3s[886]: I1005 08:29:09.233340 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-helm" pod "c8a9081b-9e98-441b-a6fb-f27a597744c3" (UID: "c8a9081b-9e98-441b-a6fb-f27a597744c3"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 55.527175] systemd[1]: var-lib-kubelet-pods-c8a9081b\x2d9e98\x2d441b\x2da6fb\x2df27a597744c3-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 55.528054] systemd[1]: var-lib-kubelet-pods-c8a9081b\x2d9e98\x2d441b\x2da6fb\x2df27a597744c3-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 55.528577] k3s[886]: I1005 08:29:09.248286 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-kube-api-access-t2hhl" pod "c8a9081b-9e98-441b-a6fb-f27a597744c3" (UID: "c8a9081b-9e98-441b-a6fb-f27a597744c3"). InnerVolumeSpecName "kube-api-access-t2hhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 55.529633] systemd[1]: var-lib-kubelet-pods-c8a9081b\x2d9e98\x2d441b\x2da6fb\x2df27a597744c3-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 55.530702] systemd[1]: var-lib-kubelet-pods-c8a9081b\x2d9e98\x2d441b\x2da6fb\x2df27a597744c3-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 55.579499] k3s[886]: I1005 08:29:09.300350 886 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 55.579874] k3s[886]: I1005 08:29:09.300391 886 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/c8a9081b-9e98-441b-a6fb-f27a597744c3-content\") on node \"machine\" DevicePath \"\"" machine # [ 55.580510] k3s[886]: I1005 08:29:09.300409 886 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2hhl\" (UniqueName: \"kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-kube-api-access-t2hhl\") on node \"machine\" DevicePath \"\"" machine # [ 55.581104] k3s[886]: I1005 08:29:09.300427 886 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 55.581593] k3s[886]: I1005 08:29:09.300440 886 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 55.582146] k3s[886]: I1005 08:29:09.300452 886 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/c8a9081b-9e98-441b-a6fb-f27a597744c3-values\") on node \"machine\" DevicePath \"\"" machine # [ 55.582633] k3s[886]: I1005 08:29:09.300464 886 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/c8a9081b-9e98-441b-a6fb-f27a597744c3-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 55.960596] dhcpcd[685]: veth11c67e3f: soliciting a DHCP lease machine # [ 56.165883] k3s[886]: I1005 08:29:09.886790 886 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06d043a668d63a045498cf4fb2623827e5e85f6e94209c3c33e09ced6b740561" machine # [ 56.176548] systemd[1]: Removed slice libcontainer container kubepods-burstable-podc8a9081b_9e98_441b_a6fb_f27a597744c3.slice. machine # [ 56.176938] systemd[1]: kubepods-burstable-podc8a9081b_9e98_441b_a6fb_f27a597744c3.slice: Consumed 663ms CPU time over 17.948s wall clock time, 34M memory peak, 2.6M incoming IP traffic, 150.3K outgoing IP traffic. machine # [ 56.295893] dhcpcd[685]: veth570e16d4: soliciting a DHCP lease machine # [ 56.365253] systemd[1]: var-lib-kubelet-pods-c8a9081b\x2d9e98\x2d441b\x2da6fb\x2df27a597744c3-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dt2hhl.mount: Deactivated successfully. machine # [ 56.365730] systemd[1]: var-lib-kubelet-pods-c8a9081b\x2d9e98\x2d441b\x2da6fb\x2df27a597744c3-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 56.382878] dhcpcd[685]: vethbc264d49: soliciting a DHCP lease machine # [ 56.499527] systemd[1]: Started libcontainer container da01f92e3f61d286dc1864ba98f7e1b9c524fbd38aeddc6666268e72ad517ef4. machine # [ 56.593817] k3s[886]: I1005 08:29:10.314290 886 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-685b9cb6c-5pqwx" podStartSLOduration=3.314266611 podStartE2EDuration="3.314266611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 08:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 08:29:10.312804694 +0000 UTC m=+39.598480530" watchObservedRunningTime="2026-10-05 08:29:10.314266611 +0000 UTC m=+39.599942448" machine # [ 56.607709] dhcpcd[685]: veth79f2721d: soliciting an IPv6 router machine # [ 56.664391] dhcpcd[685]: veth570e16d4: soliciting an IPv6 router machine # [ 56.982059] dhcpcd[685]: veth11c67e3f: soliciting an IPv6 router machine # [ 57.319643] dhcpcd[685]: vethbc264d49: soliciting an IPv6 router machine # [ 58.604484] dhcpcd[685]: vethedec12a2: probing for an IPv4LL address machine # [ 59.941228] dhcpcd[685]: veth79f2721d: probing for an IPv4LL address machine # [ 60.962276] dhcpcd[685]: veth11c67e3f: probing for an IPv4LL address machine # [ 61.296520] dhcpcd[685]: veth570e16d4: probing for an IPv4LL address machine # [ 61.384108] dhcpcd[685]: vethbc264d49: probing for an IPv4LL address machine # [ 62.547662] systemd[1]: Started libcontainer container cc5563bda131ab7ab7eccdb4c7799a6b2c44e28eb6e7b9e004ba3942658b123d. machine # [ 62.674155] systemd[1]: tmp-ovl\x2didmapped370317129.mount: Deactivated successfully. machine # [ 62.695326] systemd[1]: Started libcontainer container d516be33d26d2f149a33025801004bddd5b1de9effa0104c6f1e876cf1f619f2. machine # [ 62.699785] systemd[1]: Started libcontainer container 41d50a79ecb238014d4e8f5ceb1796bb4d80ebf66e1f6894e71d706b6902e062. machine # [ 62.812148] k3s[886]: I1005 08:29:16.532571 886 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-586f48856c-7ks5k" podStartSLOduration=9.532544353 podStartE2EDuration="9.532544353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 08:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 08:29:16.357964064 +0000 UTC m=+45.643640179" watchObservedRunningTime="2026-10-05 08:29:16.532544353 +0000 UTC m=+45.818220189" machine # [ 62.957678] niks3-server[1188]: 2026/10/05 08:29:16 INFO lead: acquired remote=10.42.0.7:44272 machine # [ 63.508234] systemd[1]: tmp-ovl\x2didmapped1163589514.mount: Deactivated successfully. machine # error: timed out waiting for the condition machine # [ 64.366831] dhcpcd[685]: vethedec12a2: using IPv4LL address 169.254.141.17 machine # [ 64.369612] dhcpcd[685]: vethedec12a2: adding route to 169.254.0.0/16 machine # [ 64.836380] systemd[1]: cri-containerd-41d50a79ecb238014d4e8f5ceb1796bb4d80ebf66e1f6894e71d706b6902e062.scope: Deactivated successfully. machine # [ 64.837790] systemd[1]: cri-containerd-41d50a79ecb238014d4e8f5ceb1796bb4d80ebf66e1f6894e71d706b6902e062.scope: Consumed 847ms CPU time over 2.136s wall clock time, 365.5M memory peak, 103.7M read from disk, 146.1M written to disk. machine # [ 64.839242] systemd[1]: cri-containerd-d516be33d26d2f149a33025801004bddd5b1de9effa0104c6f1e876cf1f619f2.scope: Deactivated successfully. machine # [ 64.841306] systemd[1]: cri-containerd-d516be33d26d2f149a33025801004bddd5b1de9effa0104c6f1e876cf1f619f2.scope: Consumed 840ms CPU time over 2.143s wall clock time, 362.1M memory peak, 92.9M read from disk, 230.6M written to disk. machine # [ 64.899883] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d516be33d26d2f149a33025801004bddd5b1de9effa0104c6f1e876cf1f619f2-rootfs.mount: Deactivated successfully. machine # [ 64.907112] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-41d50a79ecb238014d4e8f5ceb1796bb4d80ebf66e1f6894e71d706b6902e062-rootfs.mount: Deactivated successfully. machine # [ 65.024881] dhcpcd[685]: veth79f2721d: using IPv4LL address 169.254.223.132 machine # [ 65.025442] dhcpcd[685]: veth79f2721d: adding route to 169.254.0.0/16 machine # [ 65.922746] dhcpcd[685]: veth570e16d4: using IPv4LL address 169.254.7.66 machine # [ 65.923392] dhcpcd[685]: veth570e16d4: adding route to 169.254.0.0/16 machine # [ 66.031978] dhcpcd[685]: veth11c67e3f: using IPv4LL address 169.254.193.211 machine # [ 66.032915] dhcpcd[685]: veth11c67e3f: adding route to 169.254.0.0/16 machine # [ 66.240454] dhcpcd[685]: vethbc264d49: using IPv4LL address 169.254.104.185 machine # [ 66.241457] dhcpcd[685]: vethbc264d49: adding route to 169.254.0.0/16 machine # [ 66.385391] systemd[1]: tmp-ovl\x2didmapped1351212515.mount: Deactivated successfully. machine # [ 66.405322] systemd[1]: Started libcontainer container c9b5378847fbc214e9a38095d9702c7d77208d7583722f8e8d36fab1bfe966c3. machine # [ 66.407560] systemd[1]: Started libcontainer container 651e32e7f5a13cf1a82c2f1a310c0357e7372c9d6bdfcc54f900dc3324449de6. machine # [ 66.551058] dhcpcd[685]: vethedec12a2: no IPv6 Routers available machine # [ 66.583533] systemd[1]: Started libcontainer container 0a4fac2167f69269e4d56c48f47c67a2c219ea0057d627be7cc1475b94df444a. machine # [ 66.594280] systemd[1]: Started libcontainer container fa56a825c78e1902a091d7ff477c981e15906b2d63c694747ffa86bae001fd36. machine # [ 66.811393] systemd[1]: Started libcontainer container 33ed94495ee53a085e823a1b09c509ae35a74a5e3bee29fb5fe1e75cdb648753. machine # [ 66.815231] systemd[1]: Started libcontainer container 9c6aafd9ff7cf962b8882b8e5d9856f98ed41c919e5a212621f994964ecbcfea. machine # [ 66.987493] k3s[886]: I1005 08:29:20.707331 886 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s" podStartSLOduration=11.59748864 podStartE2EDuration="13.707306508s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.109817868s" isStatefulPod=false podCreationTimestamp="2026-10-05 08:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 08:29:20.706569543 +0000 UTC m=+49.992249010" watchObservedRunningTime="2026-10-05 08:29:20.707306508 +0000 UTC m=+49.992982344" machine # [ 67.226713] systemd[1]: tmp-ovl\x2didmapped949051035.mount: Deactivated successfully. machine # [ 68.203370] k3s[886]: I1005 08:29:21.923440 886 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8" podStartSLOduration=12.836816264 podStartE2EDuration="14.923391792s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.086575528s" isStatefulPod=false podCreationTimestamp="2026-10-05 08:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 08:29:20.734561648 +0000 UTC m=+50.020237763" watchObservedRunningTime="2026-10-05 08:29:21.923391792 +0000 UTC m=+51.209072377" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 38.96 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.22 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 68.610641] dhcpcd[685]: veth79f2721d: no IPv6 Routers available machine # [ 68.666509] dhcpcd[685]: veth570e16d4: no IPv6 Routers available machine # [ 68.985064] dhcpcd[685]: veth11c67e3f: no IPv6 Routers available machine # [ 69.321920] dhcpcd[685]: vethbc264d49: no IPv6 Routers available machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 1.86 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.06 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.72 seconds) machine: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.6:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 0.08 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: waiting for success: curl -sf http://10.42.0.7:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.7:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.04 seconds) (finished: subtest: chart deploys and workers become Ready, in 42.17 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.17 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.15 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 109.158895] niks3-server[1188]: 2026/10/05 08:30:02 INFO Received push request method=POST path=/api/pushes machine # [ 109.186367] niks3-server[1188]: 2026/10/05 08:30:02 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign machine # [ 109.189435] niks3-server[1188]: 2026/10/05 08:30:02 INFO Signed narinfos id=1 count=1 machine # [ 109.195973] niks3-server[1188]: 2026/10/05 08:30:02 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 109.197097] niks3-server[1188]: 2026/10/05 08:30:02 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 109.200235] niks3-server[1188]: 2026/10/05 08:30:02 INFO Received complete push request method=POST path=/api/pushes/1/complete machine # [ 109.204410] niks3-server[1188]: 2026/10/05 08:30:02 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 133.724144] niks3-server[1188]: 2026/10/05 08:30:27 INFO Received push request method=POST path=/api/pushes machine # [ 133.748338] niks3-server[1188]: 2026/10/05 08:30:27 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign machine # [ 133.749224] niks3-server[1188]: 2026/10/05 08:30:27 INFO Signed narinfos id=2 count=1 machine # [ 133.755120] niks3-server[1188]: 2026/10/05 08:30:27 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 133.758616] niks3-server[1188]: 2026/10/05 08:30:27 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 133.763263] niks3-server[1188]: 2026/10/05 08:30:27 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 133.769204] niks3-server[1188]: 2026/10/05 08:30:27 INFO Received complete push request method=POST path=/api/pushes/2/complete machine # [ 133.775398] niks3-server[1188]: 2026/10/05 08:30:27 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 133.844739] niks3-server[1188]: 2026/10/05 08:30:27 INFO Received push request method=POST path=/api/pushes machine # [ 133.856801] niks3-server[1188]: 2026/10/05 08:30:27 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign machine # [ 133.858697] niks3-server[1188]: 2026/10/05 08:30:27 INFO Signed narinfos id=3 count=1 machine # [ 133.861833] niks3-server[1188]: 2026/10/05 08:30:27 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 133.863120] niks3-server[1188]: 2026/10/05 08:30:27 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 133.864777] niks3-server[1188]: 2026/10/05 08:30:27 INFO Received complete push request method=POST path=/api/pushes/3/complete machine # [ 133.867531] niks3-server[1188]: 2026/10/05 08:30:27 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 158.763946] niks3-server[1188]: 2026/10/05 08:30:52 INFO Received push request method=POST path=/api/pushes machine # [ 158.778672] niks3-server[1188]: 2026/10/05 08:30:52 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign machine # [ 158.779867] niks3-server[1188]: 2026/10/05 08:30:52 INFO Signed narinfos id=4 count=1 machine # [ 158.784208] niks3-server[1188]: 2026/10/05 08:30:52 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 158.786742] niks3-server[1188]: 2026/10/05 08:30:52 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 158.788462] niks3-server[1188]: 2026/10/05 08:30:52 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 158.790684] niks3-server[1188]: 2026/10/05 08:30:52 INFO Received complete push request method=POST path=/api/pushes/4/complete machine # [ 158.795598] niks3-server[1188]: 2026/10/05 08:30:52 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 158.857334] niks3-server[1188]: 2026/10/05 08:30:52 INFO Received push request method=POST path=/api/pushes machine # [ 158.866569] niks3-server[1188]: 2026/10/05 08:30:52 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign machine # [ 158.867056] niks3-server[1188]: 2026/10/05 08:30:52 INFO Signed narinfos id=5 count=1 machine # [ 158.871105] niks3-server[1188]: 2026/10/05 08:30:52 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 158.874056] niks3-server[1188]: 2026/10/05 08:30:52 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 158.874795] niks3-server[1188]: 2026/10/05 08:30:52 INFO Received complete push request method=POST path=/api/pushes/5/complete machine # [ 183.793573] niks3-server[1188]: 2026/10/05 08:31:17 INFO Received push request method=POST path=/api/pushes machine # [ 183.813134] niks3-server[1188]: 2026/10/05 08:31:17 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign machine # [ 183.814359] niks3-server[1188]: 2026/10/05 08:31:17 INFO Signed narinfos id=6 count=1 machine # [ 183.817974] niks3-server[1188]: 2026/10/05 08:31:17 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 183.823388] niks3-server[1188]: 2026/10/05 08:31:17 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 183.825654] niks3-server[1188]: 2026/10/05 08:31:17 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 183.830601] niks3-server[1188]: 2026/10/05 08:31:17 INFO Received complete push request method=POST path=/api/pushes/6/complete machine # [ 183.837323] niks3-server[1188]: 2026/10/05 08:31:17 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 112.08 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.14 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.21 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 209.437408] niks3-server[1188]: 2026/10/05 08:31:43 INFO Received push request method=POST path=/api/pushes machine # [ 209.459731] niks3-server[1188]: 2026/10/05 08:31:43 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign machine # [ 209.463974] niks3-server[1188]: 2026/10/05 08:31:43 INFO Signed narinfos id=7 count=1 machine # [ 209.467896] niks3-server[1188]: 2026/10/05 08:31:43 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 209.473077] niks3-server[1188]: 2026/10/05 08:31:43 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 209.476474] niks3-server[1188]: 2026/10/05 08:31:43 INFO Received complete push request method=POST path=/api/pushes/7/complete machine # [ 209.483116] niks3-server[1188]: 2026/10/05 08:31:43 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 234.202475] niks3-server[1188]: 2026/10/05 08:32:07 INFO Received push request method=POST path=/api/pushes machine # [ 234.226802] niks3-server[1188]: 2026/10/05 08:32:07 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign machine # [ 234.228674] niks3-server[1188]: 2026/10/05 08:32:07 INFO Signed narinfos id=8 count=1 machine # [ 234.230329] niks3-server[1188]: 2026/10/05 08:32:07 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 234.232686] niks3-server[1188]: 2026/10/05 08:32:07 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 234.237669] niks3-server[1188]: 2026/10/05 08:32:07 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 234.241226] niks3-server[1188]: 2026/10/05 08:32:07 INFO Received complete push request method=POST path=/api/pushes/8/complete machine # [ 234.247098] niks3-server[1188]: 2026/10/05 08:32:07 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 234.313991] niks3-server[1188]: 2026/10/05 08:32:08 INFO Received push request method=POST path=/api/pushes machine # [ 234.324384] niks3-server[1188]: 2026/10/05 08:32:08 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign machine # [ 234.326470] niks3-server[1188]: 2026/10/05 08:32:08 INFO Signed narinfos id=9 count=1 machine # [ 234.328484] niks3-server[1188]: 2026/10/05 08:32:08 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 234.331063] niks3-server[1188]: 2026/10/05 08:32:08 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 234.334442] niks3-server[1188]: 2026/10/05 08:32:08 INFO Received complete push request method=POST path=/api/pushes/9/complete machine # [ 234.337318] niks3-server[1188]: 2026/10/05 08:32:08 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 258.843829] niks3-server[1188]: 2026/10/05 08:32:32 INFO Received push request method=POST path=/api/pushes machine # [ 258.866988] niks3-server[1188]: 2026/10/05 08:32:32 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign machine # [ 258.870069] niks3-server[1188]: 2026/10/05 08:32:32 INFO Signed narinfos id=10 count=1 machine # [ 258.873177] niks3-server[1188]: 2026/10/05 08:32:32 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 258.874532] niks3-server[1188]: 2026/10/05 08:32:32 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 258.875933] niks3-server[1188]: 2026/10/05 08:32:32 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 258.881525] niks3-server[1188]: 2026/10/05 08:32:32 INFO Received complete push request method=POST path=/api/pushes/10/complete machine # [ 258.886540] niks3-server[1188]: 2026/10/05 08:32:32 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 258.952781] niks3-server[1188]: 2026/10/05 08:32:32 INFO Received push request method=POST path=/api/pushes machine # [ 258.963528] niks3-server[1188]: 2026/10/05 08:32:32 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign machine # [ 258.963959] niks3-server[1188]: 2026/10/05 08:32:32 INFO Signed narinfos id=11 count=1 machine # [ 258.969289] niks3-server[1188]: 2026/10/05 08:32:32 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 258.970185] niks3-server[1188]: 2026/10/05 08:32:32 INFO Received complete push request method=POST path=/api/pushes/11/complete machine # [ 258.979513] niks3-server[1188]: 2026/10/05 08:32:32 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 258.982557] niks3-server[1188]: 2026/10/05 08:32:32 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 283.906254] niks3-server[1188]: 2026/10/05 08:32:57 INFO Received push request method=POST path=/api/pushes machine # [ 283.926542] niks3-server[1188]: 2026/10/05 08:32:57 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign machine # [ 283.927890] niks3-server[1188]: 2026/10/05 08:32:57 INFO Signed narinfos id=12 count=1 machine # [ 283.930217] niks3-server[1188]: 2026/10/05 08:32:57 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 283.932796] niks3-server[1188]: 2026/10/05 08:32:57 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 283.934866] niks3-server[1188]: 2026/10/05 08:32:57 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 283.937519] niks3-server[1188]: 2026/10/05 08:32:57 INFO Received complete push request method=POST path=/api/pushes/12/complete machine # [ 283.941724] niks3-server[1188]: 2026/10/05 08:32:57 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 100.77 seconds) (finished: subtest: build through the balancer lands in the cache, in 213.21 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.23 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.18 seconds) machine: must succeed: kubectl apply -f /nix/store/pzq1y78ar0jx25hvv3v5qh4428dn7jnp-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/pzq1y78ar0jx25hvv3v5qh4428dn7jnp-ci-job.json, in 0.21 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 286.238642] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod19ce24d3_c603_4f7c_8621_9a44ce3a8d64.slice. machine # [ 286.409990] k3s[886]: I1005 08:33:00.130270 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-nix-grpc-farm\") pod \"ci-4kf4w\" (UID: \"19ce24d3-c603-4f7c-8621-9a44ce3a8d64\") " pod="ci/ci-4kf4w" machine # [ 286.410398] k3s[886]: I1005 08:33:00.130407 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k7pn\" (UniqueName: \"kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-kube-api-access-9k7pn\") pod \"ci-4kf4w\" (UID: \"19ce24d3-c603-4f7c-8621-9a44ce3a8d64\") " pod="ci/ci-4kf4w" machine # [ 286.411517] k3s[886]: I1005 08:33:00.130478 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-job\") pod \"ci-4kf4w\" (UID: \"19ce24d3-c603-4f7c-8621-9a44ce3a8d64\") " pod="ci/ci-4kf4w" machine # [ 287.655265] cni0: port 1(veth417606a7) entered blocking state machine # [ 287.660131] cni0: port 1(veth417606a7) entered disabled state machine # [ 287.663009] veth417606a7: entered allmulticast mode machine # [ 287.666133] veth417606a7: entered promiscuous mode machine # [ 287.684595] cni0: port 1(veth417606a7) entered blocking state machine # [ 287.686929] cni0: port 1(veth417606a7) entered forwarding state machine # [ 287.575914] (udev-worker)[5178]: Network interface NamePolicy= disabled on kernel command line. machine # [ 287.605076] dhcpcd[685]: veth417606a7: IAID aa:8a:8a:e2 machine # [ 287.605276] dhcpcd[685]: veth417606a7: adding address fe80::58f6:aaff:fe8a:8ae2 machine # [ 287.626609] systemd[1]: Started libcontainer container 1b6343a0c3c132dbea2a29f85486995bcd17036a377928d396cc1e167be6f4d8. machine # [ 288.576521] dhcpcd[685]: veth417606a7: soliciting a DHCP lease machine # [ 289.582674] systemd[1]: Started libcontainer container a3b99f911d988b09ce58d91389df37f7fc008baec6413c952669f1534ab01f52. machine # [ 290.164319] dhcpcd[685]: veth417606a7: soliciting an IPv6 router machine # [ 290.875559] niks3-server[1188]: 2026/10/05 08:33:04 INFO Received push request method=POST path=/api/pushes machine # [ 290.892857] niks3-server[1188]: 2026/10/05 08:33:04 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign machine # [ 290.894293] niks3-server[1188]: 2026/10/05 08:33:04 INFO Signed narinfos id=13 count=1 machine # [ 290.898533] niks3-server[1188]: 2026/10/05 08:33:04 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 290.903567] niks3-server[1188]: 2026/10/05 08:33:04 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 290.906644] niks3-server[1188]: 2026/10/05 08:33:04 INFO Received complete push request method=POST path=/api/pushes/13/complete machine # [ 290.910045] niks3-server[1188]: 2026/10/05 08:33:04 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 293.578372] dhcpcd[685]: veth417606a7: probing for an IPv4LL address machine # [ 298.392385] dhcpcd[685]: veth417606a7: using IPv4LL address 169.254.201.165 machine # [ 298.392883] dhcpcd[685]: veth417606a7: adding route to 169.254.0.0/16 machine # [ 302.169561] dhcpcd[685]: veth417606a7: no IPv6 Routers available machine # [ 310.311188] postgres[768]: [768] LOG: checkpoint starting: time machine # [ 315.227933] niks3-server[1188]: 2026/10/05 08:33:28 INFO Received push request method=POST path=/api/pushes machine # [ 315.254605] niks3-server[1188]: 2026/10/05 08:33:28 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign machine # [ 315.257474] niks3-server[1188]: 2026/10/05 08:33:28 INFO Signed narinfos id=14 count=1 machine # [ 315.260206] niks3-server[1188]: 2026/10/05 08:33:28 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 315.262357] niks3-server[1188]: 2026/10/05 08:33:28 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 315.263468] niks3-server[1188]: 2026/10/05 08:33:28 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 315.270595] niks3-server[1188]: 2026/10/05 08:33:28 INFO Received complete push request method=POST path=/api/pushes/14/complete machine # [ 315.277118] niks3-server[1188]: 2026/10/05 08:33:28 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 315.352232] niks3-server[1188]: 2026/10/05 08:33:29 INFO Received push request method=POST path=/api/pushes machine # [ 315.365183] niks3-server[1188]: 2026/10/05 08:33:29 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign machine # [ 315.369503] niks3-server[1188]: 2026/10/05 08:33:29 INFO Signed narinfos id=15 count=1 machine # [ 315.370982] niks3-server[1188]: 2026/10/05 08:33:29 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 315.373172] niks3-server[1188]: 2026/10/05 08:33:29 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 315.375180] niks3-server[1188]: 2026/10/05 08:33:29 INFO Received complete push request method=POST path=/api/pushes/15/complete machine # [ 315.382704] niks3-server[1188]: 2026/10/05 08:33:29 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 339.669384] niks3-server[1188]: 2026/10/05 08:33:53 INFO Received push request method=POST path=/api/pushes machine # [ 339.681911] niks3-server[1188]: 2026/10/05 08:33:53 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign machine # [ 339.683023] niks3-server[1188]: 2026/10/05 08:33:53 INFO Signed narinfos id=16 count=1 machine # [ 339.686186] niks3-server[1188]: 2026/10/05 08:33:53 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 339.688147] niks3-server[1188]: 2026/10/05 08:33:53 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 339.690628] niks3-server[1188]: 2026/10/05 08:33:53 INFO Received complete push request method=POST path=/api/pushes/16/complete machine # [ 339.695854] niks3-server[1188]: 2026/10/05 08:33:53 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 339.697696] niks3-server[1188]: 2026/10/05 08:33:53 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 339.759968] niks3-server[1188]: 2026/10/05 08:33:53 INFO Received push request method=POST path=/api/pushes machine # [ 339.770171] niks3-server[1188]: 2026/10/05 08:33:53 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign machine # [ 339.771657] niks3-server[1188]: 2026/10/05 08:33:53 INFO Signed narinfos id=17 count=1 machine # [ 339.775521] niks3-server[1188]: 2026/10/05 08:33:53 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 339.777354] niks3-server[1188]: 2026/10/05 08:33:53 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 339.781542] niks3-server[1188]: 2026/10/05 08:33:53 INFO Received complete push request method=POST path=/api/pushes/17/complete machine # [ 339.787342] niks3-server[1188]: 2026/10/05 08:33:53 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 364.491551] niks3-server[1188]: 2026/10/05 08:34:18 INFO Received push request method=POST path=/api/pushes machine # [ 364.514177] niks3-server[1188]: 2026/10/05 08:34:18 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign machine # [ 364.514591] niks3-server[1188]: 2026/10/05 08:34:18 INFO Signed narinfos id=18 count=1 machine # [ 364.516971] niks3-server[1188]: 2026/10/05 08:34:18 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 364.522446] niks3-server[1188]: 2026/10/05 08:34:18 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 364.524299] niks3-server[1188]: 2026/10/05 08:34:18 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 364.530630] niks3-server[1188]: 2026/10/05 08:34:18 INFO Received complete push request method=POST path=/api/pushes/18/complete machine # [ 364.534318] niks3-server[1188]: 2026/10/05 08:34:18 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 367.214089] niks3-server[1188]: 2026/10/05 08:34:20 INFO Received push request method=POST path=/api/pushes machine # [ 367.232309] niks3-server[1188]: 2026/10/05 08:34:20 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign machine # [ 367.233450] niks3-server[1188]: 2026/10/05 08:34:20 INFO Signed narinfos id=19 count=1 machine # [ 367.238151] niks3-server[1188]: 2026/10/05 08:34:20 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 367.242206] niks3-server[1188]: 2026/10/05 08:34:20 INFO Received complete push request method=POST path=/api/pushes/19/complete machine # [ 367.245601] niks3-server[1188]: 2026/10/05 08:34:20 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 367.249785] niks3-server[1188]: 2026/10/05 08:34:20 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 392.374241] niks3-server[1188]: 2026/10/05 08:34:46 INFO Received push request method=POST path=/api/pushes machine # [ 392.391223] niks3-server[1188]: 2026/10/05 08:34:46 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign machine # [ 392.392649] niks3-server[1188]: 2026/10/05 08:34:46 INFO Signed narinfos id=20 count=1 machine # [ 392.396466] niks3-server[1188]: 2026/10/05 08:34:46 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 392.397079] niks3-server[1188]: 2026/10/05 08:34:46 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 392.403536] niks3-server[1188]: 2026/10/05 08:34:46 INFO Received complete push request method=POST path=/api/pushes/20/complete machine # [ 392.416341] niks3-server[1188]: 2026/10/05 08:34:46 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 392.421129] niks3-server[1188]: 2026/10/05 08:34:46 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 392.552144] systemd[1]: cri-containerd-a3b99f911d988b09ce58d91389df37f7fc008baec6413c952669f1534ab01f52.scope: Deactivated successfully. machine # [ 392.554068] systemd[1]: cri-containerd-a3b99f911d988b09ce58d91389df37f7fc008baec6413c952669f1534ab01f52.scope: Consumed 1.026s CPU time over 1min 42.969s wall clock time, 75.9M memory peak, 6.3M read from disk, 412K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine # [ 392.600260] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a3b99f911d988b09ce58d91389df37f7fc008baec6413c952669f1534ab01f52-rootfs.mount: Deactivated successfully. machine # [ 393.717655] systemd[1]: cri-containerd-1b6343a0c3c132dbea2a29f85486995bcd17036a377928d396cc1e167be6f4d8.scope: Deactivated successfully. machine # [ 393.764366] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-1b6343a0c3c132dbea2a29f85486995bcd17036a377928d396cc1e167be6f4d8-rootfs.mount: Deactivated successfully. machine # [ 393.810931] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-1b6343a0c3c132dbea2a29f85486995bcd17036a377928d396cc1e167be6f4d8-shm.mount: Deactivated successfully. machine # [ 394.013759] cni0: port 1(veth417606a7) entered disabled state machine # [ 393.860790] dhcpcd[685]: veth417606a7: carrier lost machine # [ 394.016789] veth417606a7 (unregistering): left allmulticast mode machine # [ 394.018355] veth417606a7 (unregistering): left promiscuous mode machine # [ 394.020164] cni0: port 1(veth417606a7) entered disabled state machine # [ 393.883546] systemd[1]: run-netns-cni\x2d01aaf5c8\x2d2dee\x2defde\x2d7850\x2db096906d50cf.mount: Deactivated successfully. machine # [ 393.888565] dhcpcd[685]: veth417606a7: deleting address fe80::58f6:aaff:fe8a:8ae2 machine # [ 393.892262] dhcpcd[685]: veth417606a7: deleting route to 169.254.0.0/16 machine # [ 393.960357] dhcpcd[685]: veth417606a7: removing interface machine # [ 393.973374] k3s[886]: I1005 08:34:47.693837 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-kube-api-access-9k7pn\" (UniqueName: \"kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-kube-api-access-9k7pn\") pod \"19ce24d3-c603-4f7c-8621-9a44ce3a8d64\" (UID: \"19ce24d3-c603-4f7c-8621-9a44ce3a8d64\") " machine # [ 393.978111] k3s[886]: I1005 08:34:47.693927 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-nix-grpc-farm\") pod \"19ce24d3-c603-4f7c-8621-9a44ce3a8d64\" (UID: \"19ce24d3-c603-4f7c-8621-9a44ce3a8d64\") " machine # [ 393.982598] k3s[886]: I1005 08:34:47.693963 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-job\" (UniqueName: \"kubernetes.io/configmap/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-job\") pod \"19ce24d3-c603-4f7c-8621-9a44ce3a8d64\" (UID: \"19ce24d3-c603-4f7c-8621-9a44ce3a8d64\") " machine # [ 393.987051] k3s[886]: I1005 08:34:47.694517 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-job" pod "19ce24d3-c603-4f7c-8621-9a44ce3a8d64" (UID: "19ce24d3-c603-4f7c-8621-9a44ce3a8d64"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 393.991091] k3s[886]: I1005 08:34:47.700577 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-kube-api-access-9k7pn" pod "19ce24d3-c603-4f7c-8621-9a44ce3a8d64" (UID: "19ce24d3-c603-4f7c-8621-9a44ce3a8d64"). InnerVolumeSpecName "kube-api-access-9k7pn". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 393.995512] k3s[886]: I1005 08:34:47.704218 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-nix-grpc-farm" pod "19ce24d3-c603-4f7c-8621-9a44ce3a8d64" (UID: "19ce24d3-c603-4f7c-8621-9a44ce3a8d64"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 393.999768] systemd[1]: var-lib-kubelet-pods-19ce24d3\x2dc603\x2d4f7c\x2d8621\x2d9a44ce3a8d64-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2d9k7pn.mount: Deactivated successfully. machine # [ 394.002175] systemd[1]: var-lib-kubelet-pods-19ce24d3\x2dc603\x2d4f7c\x2d8621\x2d9a44ce3a8d64-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 394.073908] k3s[886]: I1005 08:34:47.794789 886 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 394.074197] k3s[886]: I1005 08:34:47.794834 886 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-job\") on node \"machine\" DevicePath \"\"" machine # [ 394.075117] k3s[886]: I1005 08:34:47.794853 886 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k7pn\" (UniqueName: \"kubernetes.io/projected/19ce24d3-c603-4f7c-8621-9a44ce3a8d64-kube-api-access-9k7pn\") on node \"machine\" DevicePath \"\"" machine # [ 394.700540] k3s[886]: I1005 08:34:48.421417 886 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b6343a0c3c132dbea2a29f85486995bcd17036a377928d396cc1e167be6f4d8" machine # [ 394.722672] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod19ce24d3_c603_4f7c_8621_9a44ce3a8d64.slice. machine # [ 394.722911] systemd[1]: kubepods-besteffort-pod19ce24d3_c603_4f7c_8621_9a44ce3a8d64.slice: Consumed 1.058s CPU time over 1min 48.482s wall clock time, 76.1M memory peak, 6.3M read from disk, 616K written to disk, 18.3K incoming IP traffic, 44.8K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 110.03 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.17 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp9mbdd1ba/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (26s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.17 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.03 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 111.33 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.32 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.56 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-685b9cb6c-5pqwx -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 397.475146] k3s[886]: E1005 08:34:51.195659 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50296: use of closed network connection" machine # [ 398.714540] k3s[886]: E1005 08:34:52.435079 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50300: use of closed network connection" machine # [ 400.024643] k3s[886]: E1005 08:34:53.744648 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50310: use of closed network connection" machine # [ 401.309026] k3s[886]: E1005 08:34:55.029183 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50326: use of closed network connection" machine # [ 402.597472] k3s[886]: E1005 08:34:56.317946 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:50328: use of closed network connection" machine # [ 403.881815] k3s[886]: E1005 08:34:57.602313 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37968: use of closed network connection" machine # [ 405.174639] k3s[886]: E1005 08:34:58.894860 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37980: use of closed network connection" machine # [ 406.489468] k3s[886]: E1005 08:35:00.209789 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37994: use of closed network connection" machine # [ 407.790086] k3s[886]: E1005 08:35:01.510626 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:37996: use of closed network connection" machine # [ 409.083556] k3s[886]: E1005 08:35:02.802756 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38008: use of closed network connection" machine # [ 410.392140] k3s[886]: E1005 08:35:04.112628 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38010: use of closed network connection" machine # [ 411.719268] k3s[886]: E1005 08:35:05.439811 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:38016: use of closed network connection" machine # [ 413.029615] k3s[886]: E1005 08:35:06.750173 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57856: use of closed network connection" machine # [ 414.366532] k3s[886]: E1005 08:35:08.087109 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57862: use of closed network connection" machine # [ 414.638124] postgres[768]: [768] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=104.230 s, sync=0.053 s, total=104.328 s; sync files=364, longest=0.003 s, average=0.001 s; distance=4978 kB, estimate=4978 kB; lsn=0/1C74D68, redo lsn=0/1C42AC0 machine # [ 415.687567] k3s[886]: E1005 08:35:09.408119 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57864: use of closed network connection" machine # [ 416.977448] k3s[886]: E1005 08:35:10.697135 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57868: use of closed network connection" machine # [ 418.265207] k3s[886]: E1005 08:35:11.985168 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57882: use of closed network connection" machine # [ 419.569116] k3s[886]: E1005 08:35:13.289631 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57894: use of closed network connection" machine # [ 420.841403] k3s[886]: E1005 08:35:14.561070 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57896: use of closed network connection" machine # [ 422.159492] k3s[886]: E1005 08:35:15.879805 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:57900: use of closed network connection" machine # [ 423.502447] k3s[886]: E1005 08:35:17.222875 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34706: use of closed network connection" machine # [ 424.811833] k3s[886]: E1005 08:35:18.532328 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34708: use of closed network connection" machine # [ 426.128779] k3s[886]: E1005 08:35:19.849291 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34712: use of closed network connection" machine # [ 427.417944] k3s[886]: E1005 08:35:21.138433 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34726: use of closed network connection" machine # [ 428.724573] k3s[886]: E1005 08:35:22.445120 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34736: use of closed network connection" machine # [ 430.069390] k3s[886]: E1005 08:35:23.789866 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34752: use of closed network connection" machine # [ 431.417424] k3s[886]: E1005 08:35:25.137898 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34762: use of closed network connection" machine # [ 432.719416] k3s[886]: E1005 08:35:26.439904 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:34770: use of closed network connection" machine # [ 434.009444] k3s[886]: E1005 08:35:27.729607 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49104: use of closed network connection" machine # [ 435.304379] k3s[886]: E1005 08:35:29.024556 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49106: use of closed network connection" machine # [ 436.628822] k3s[886]: E1005 08:35:30.349242 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49122: use of closed network connection" machine # [ 437.926409] k3s[886]: E1005 08:35:31.646794 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49124: use of closed network connection" machine # [ 439.199240] k3s[886]: E1005 08:35:32.919510 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49130: use of closed network connection" machine # [ 440.510669] k3s[886]: E1005 08:35:34.230991 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49136: use of closed network connection" machine # [ 441.808817] k3s[886]: E1005 08:35:35.529336 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:49152: use of closed network connection" machine # [ 443.101147] k3s[886]: E1005 08:35:36.821274 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36386: use of closed network connection" machine # [ 444.436520] k3s[886]: E1005 08:35:38.156686 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36388: use of closed network connection" machine # [ 445.751601] k3s[886]: E1005 08:35:39.471929 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36402: use of closed network connection" machine # [ 447.037560] k3s[886]: E1005 08:35:40.758094 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36418: use of closed network connection" machine # [ 448.371670] k3s[886]: E1005 08:35:42.092207 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36426: use of closed network connection" machine # [ 449.672085] k3s[886]: E1005 08:35:43.391882 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36440: use of closed network connection" machine # [ 450.994249] k3s[886]: E1005 08:35:44.714778 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36452: use of closed network connection" machine # [ 452.334621] k3s[886]: E1005 08:35:46.054555 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:36456: use of closed network connection" machine # [ 453.623670] k3s[886]: E1005 08:35:47.344230 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48310: use of closed network connection" machine # [ 454.934524] k3s[886]: E1005 08:35:48.655081 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48324: use of closed network connection" machine # [ 456.254406] k3s[886]: E1005 08:35:49.974830 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48338: use of closed network connection" machine # [ 457.550473] k3s[886]: E1005 08:35:51.270957 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48346: use of closed network connection" machine # [ 458.889490] k3s[886]: E1005 08:35:52.609907 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48354: use of closed network connection" machine # [ 460.205560] k3s[886]: E1005 08:35:53.925938 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48370: use of closed network connection" machine # [ 461.498810] k3s[886]: E1005 08:35:55.219173 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48380: use of closed network connection" machine # [ 462.787754] k3s[886]: E1005 08:35:56.507706 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48390: use of closed network connection" machine # [ 464.105076] k3s[886]: E1005 08:35:57.825589 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44300: use of closed network connection" machine # [ 465.422436] k3s[886]: E1005 08:35:59.141714 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44302: use of closed network connection" machine # [ 466.757942] k3s[886]: E1005 08:36:00.478304 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44306: use of closed network connection" machine # [ 468.072578] k3s[886]: E1005 08:36:01.793137 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44318: use of closed network connection" machine # [ 469.342582] k3s[886]: E1005 08:36:03.062522 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:44322: use of closed network connection" machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-685b9cb6c-5pqwx -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 72.14 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 469.580062] niks3-server[1188]: 2026/10/05 08:36:03 INFO Received push request method=POST path=/api/pushes machine # [ 469.591669] niks3-server[1188]: 2026/10/05 08:36:03 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign machine # [ 469.594882] niks3-server[1188]: 2026/10/05 08:36:03 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 469.596464] niks3-server[1188]: 2026/10/05 08:36:03 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 469.601856] niks3-server[1188]: 2026/10/05 08:36:03 INFO Signed narinfos id=21 count=1 machine # [ 469.608324] niks3-server[1188]: 2026/10/05 08:36:03 INFO Received complete push request method=POST path=/api/pushes/21/complete machine # [ 494.521555] niks3-server[1188]: 2026/10/05 08:36:28 INFO Received push request method=POST path=/api/pushes machine # [ 494.542725] niks3-server[1188]: 2026/10/05 08:36:28 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 494.544059] niks3-server[1188]: 2026/10/05 08:36:28 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 494.551845] niks3-server[1188]: 2026/10/05 08:36:28 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign machine # [ 494.552591] niks3-server[1188]: 2026/10/05 08:36:28 INFO Signed narinfos id=22 count=1 machine # [ 494.561492] niks3-server[1188]: 2026/10/05 08:36:28 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 494.569436] niks3-server[1188]: 2026/10/05 08:36:28 INFO Received complete push request method=POST path=/api/pushes/22/complete machine # [ 494.575735] niks3-server[1188]: 2026/10/05 08:36:28 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 494.643389] niks3-server[1188]: 2026/10/05 08:36:28 INFO Received push request method=POST path=/api/pushes machine # [ 494.653435] niks3-server[1188]: 2026/10/05 08:36:28 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign machine # [ 494.655464] niks3-server[1188]: 2026/10/05 08:36:28 INFO Signed narinfos id=23 count=1 machine # [ 494.658649] niks3-server[1188]: 2026/10/05 08:36:28 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 494.661229] niks3-server[1188]: 2026/10/05 08:36:28 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 494.663215] niks3-server[1188]: 2026/10/05 08:36:28 INFO Received complete push request method=POST path=/api/pushes/23/complete machine # [ 494.665241] niks3-server[1188]: 2026/10/05 08:36:28 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 519.782650] niks3-server[1188]: 2026/10/05 08:36:53 INFO Received push request method=POST path=/api/pushes machine # [ 519.807515] niks3-server[1188]: 2026/10/05 08:36:53 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign machine # [ 519.809583] niks3-server[1188]: 2026/10/05 08:36:53 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 519.810716] niks3-server[1188]: 2026/10/05 08:36:53 INFO Signed narinfos id=24 count=1 machine # [ 519.812383] niks3-server[1188]: 2026/10/05 08:36:53 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 519.815833] niks3-server[1188]: 2026/10/05 08:36:53 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 519.819929] niks3-server[1188]: 2026/10/05 08:36:53 INFO Received complete push request method=POST path=/api/pushes/24/complete machine # [ 519.824820] niks3-server[1188]: 2026/10/05 08:36:53 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 519.899431] niks3-server[1188]: 2026/10/05 08:36:53 INFO Received push request method=POST path=/api/pushes machine # [ 519.911575] niks3-server[1188]: 2026/10/05 08:36:53 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign machine # [ 519.911983] niks3-server[1188]: 2026/10/05 08:36:53 INFO Signed narinfos id=25 count=1 machine # [ 519.915310] niks3-server[1188]: 2026/10/05 08:36:53 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 519.916563] niks3-server[1188]: 2026/10/05 08:36:53 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 519.918869] niks3-server[1188]: 2026/10/05 08:36:53 INFO Received complete push request method=POST path=/api/pushes/25/complete machine # [ 519.923232] niks3-server[1188]: 2026/10/05 08:36:53 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 544.645358] niks3-server[1188]: 2026/10/05 08:37:18 INFO Received push request method=POST path=/api/pushes machine # [ 544.664608] niks3-server[1188]: 2026/10/05 08:37:18 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign machine # [ 544.665460] niks3-server[1188]: 2026/10/05 08:37:18 INFO Signed narinfos id=26 count=1 machine # [ 544.669461] niks3-server[1188]: 2026/10/05 08:37:18 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 544.671306] niks3-server[1188]: 2026/10/05 08:37:18 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 544.676239] niks3-server[1188]: 2026/10/05 08:37:18 INFO Received complete push request method=POST path=/api/pushes/26/complete machine # [ 544.682672] niks3-server[1188]: 2026/10/05 08:37:18 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine # [ 544.689265] niks3-server[1188]: 2026/10/05 08:37:18 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 75.32 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 148.38 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.16 seconds) machine: must succeed: curl -sf http://10.42.0.8:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s"' machine: (finished: must succeed: curl -sf http://10.42.0.8:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s"', in 0.04 seconds) (finished: subtest: metrics carry build_info, in 0.19 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 545.088813] k3s[886]: E1005 08:37:18.809316 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48558: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.19 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 545.372801] k3s[886]: E1005 08:37:19.093614 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48572: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.29 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc -- sh -c 'fallocate -l 11443650560 /nix/fill' machine # [ 545.599524] k3s[886]: E1005 08:37:19.320416 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48582: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc -- sh -c 'fallocate -l 11443650560 /nix/fill', in 0.23 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc --since=30s | grep -q 'store paths deleted', in 2.68 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc -- sh -c 'rm /nix/fill' machine # [ 548.512315] k3s[886]: E1005 08:37:22.232765 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48594: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc -- sh -c 'rm /nix/fill', in 0.23 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.14 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 548.847948] k3s[886]: E1005 08:37:22.568779 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:48606: use of closed network connection" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.20 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 3.95 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # [ 548.876564] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 21b40384b7a84d2e99dbe42b61ab219c machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.03 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 549.012482] nix[11204]: don't know how to build these paths: machine # [ 549.012730] nix[11204]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 549.035781] nix[11204]: copying 1 paths to '127.0.0.1:30051'... machine # [ 549.038501] nix[11204]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 549.095829] niks3-server[1188]: 2026/10/05 08:37:22 INFO Received push request method=POST path=/api/pushes machine # [ 549.113279] niks3-server[1188]: 2026/10/05 08:37:22 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign machine # [ 549.114301] niks3-server[1188]: 2026/10/05 08:37:22 INFO Signed narinfos id=27 count=1 machine # [ 549.118903] niks3-server[1188]: 2026/10/05 08:37:22 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 549.122600] niks3-server[1188]: 2026/10/05 08:37:22 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 549.128298] niks3-server[1188]: 2026/10/05 08:37:22 INFO Received complete push request method=POST path=/api/pushes/27/complete machine # [ 549.133567] niks3-server[1188]: 2026/10/05 08:37:22 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 549.141297] nix[11204]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 549.143046] nix[11204]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.06 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.21 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 550.177645] nix[11204]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 550.178186] nix[11204]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 550.203320] systemd[1]: cri-containerd-da01f92e3f61d286dc1864ba98f7e1b9c524fbd38aeddc6666268e72ad517ef4.scope: Deactivated successfully. machine # [ 550.203915] systemd[1]: cri-containerd-da01f92e3f61d286dc1864ba98f7e1b9c524fbd38aeddc6666268e72ad517ef4.scope: Consumed 5.819s CPU time over 8min 13.703s wall clock time, 57.2M memory peak, 35.1M read from disk, 617.6K incoming IP traffic, 869.1K outgoing IP traffic. machine # [ 550.243379] k3s[886]: E1005 08:37:23.963648 886 replica_set.go:640] "Unhandled Error" err="sync \"farm/nix-grpc-farm-lb-685b9cb6c\" failed with read version: 788 is not as new as written version: 813 for group resource replicasets.apps" logger="UnhandledError" machine # [ 550.251055] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-da01f92e3f61d286dc1864ba98f7e1b9c524fbd38aeddc6666268e72ad517ef4-rootfs.mount: Deactivated successfully. machine # [ 550.261961] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2c497c5a_f330_4316_adc5_8fd1b77b7cbf.slice. machine # [ 550.291662] k3s[886]: I1005 08:37:24.012573 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c497c5a-f330-4316-adc5-8fd1b77b7cbf-tmp\") pod \"nix-grpc-farm-lb-685b9cb6c-2mzfw\" (UID: \"2c497c5a-f330-4316-adc5-8fd1b77b7cbf\") " pod="farm/nix-grpc-farm-lb-685b9cb6c-2mzfw" machine # [ 550.292164] k3s[886]: I1005 08:37:24.012628 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/2c497c5a-f330-4316-adc5-8fd1b77b7cbf-tls-ca\") pod \"nix-grpc-farm-lb-685b9cb6c-2mzfw\" (UID: \"2c497c5a-f330-4316-adc5-8fd1b77b7cbf\") " pod="farm/nix-grpc-farm-lb-685b9cb6c-2mzfw" machine # [ 550.292982] k3s[886]: I1005 08:37:24.012660 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c497c5a-f330-4316-adc5-8fd1b77b7cbf-config\") pod \"nix-grpc-farm-lb-685b9cb6c-2mzfw\" (UID: \"2c497c5a-f330-4316-adc5-8fd1b77b7cbf\") " pod="farm/nix-grpc-farm-lb-685b9cb6c-2mzfw" machine # [ 550.293920] k3s[886]: I1005 08:37:24.012701 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/2c497c5a-f330-4316-adc5-8fd1b77b7cbf-tls-lb\") pod \"nix-grpc-farm-lb-685b9cb6c-2mzfw\" (UID: \"2c497c5a-f330-4316-adc5-8fd1b77b7cbf\") " pod="farm/nix-grpc-farm-lb-685b9cb6c-2mzfw" machine # [ 550.312592] systemd[1]: cri-containerd-3b27d5981060e1e49a170565b5aa58f416720902afebba0ac8f09e77f1a55264.scope: Deactivated successfully. machine # [ 550.348289] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3b27d5981060e1e49a170565b5aa58f416720902afebba0ac8f09e77f1a55264-rootfs.mount: Deactivated successfully. machine # [ 550.381363] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-3b27d5981060e1e49a170565b5aa58f416720902afebba0ac8f09e77f1a55264-shm.mount: Deactivated successfully. machine # [ 550.405719] k3s[886]: I1005 08:37:24.126649 886 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b27d5981060e1e49a170565b5aa58f416720902afebba0ac8f09e77f1a55264" machine # [ 550.579366] cni0: port 3(veth570e16d4) entered disabled state machine # [ 550.425319] dhcpcd[685]: veth570e16d4: carrier lost machine # [ 550.582605] veth570e16d4 (unregistering): left allmulticast mode machine # [ 550.584024] veth570e16d4 (unregistering): left promiscuous mode machine # [ 550.585113] cni0: port 3(veth570e16d4) entered disabled state machine # [ 550.462358] dhcpcd[685]: veth570e16d4: deleting address fe80::c472:1cff:fe15:244e machine # [ 550.465261] dhcpcd[685]: veth570e16d4: deleting route to 169.254.0.0/16 machine # [ 550.493204] k3s[886]: I1005 08:37:24.214141 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92502b47-9312-4c7c-9b00-307e26ed7b0a-tmp\" (UniqueName: \"kubernetes.io/empty-dir/92502b47-9312-4c7c-9b00-307e26ed7b0a-tmp\") pod \"92502b47-9312-4c7c-9b00-307e26ed7b0a\" (UID: \"92502b47-9312-4c7c-9b00-307e26ed7b0a\") " machine # [ 550.493562] k3s[886]: I1005 08:37:24.214207 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92502b47-9312-4c7c-9b00-307e26ed7b0a-config\" (UniqueName: \"kubernetes.io/configmap/92502b47-9312-4c7c-9b00-307e26ed7b0a-config\") pod \"92502b47-9312-4c7c-9b00-307e26ed7b0a\" (UID: \"92502b47-9312-4c7c-9b00-307e26ed7b0a\") " machine # [ 550.494215] k3s[886]: I1005 08:37:24.214243 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-lb\" (UniqueName: \"kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-lb\") pod \"92502b47-9312-4c7c-9b00-307e26ed7b0a\" (UID: \"92502b47-9312-4c7c-9b00-307e26ed7b0a\") " machine # [ 550.494727] k3s[886]: I1005 08:37:24.214271 886 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-ca\" (UniqueName: \"kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-ca\") pod \"92502b47-9312-4c7c-9b00-307e26ed7b0a\" (UID: \"92502b47-9312-4c7c-9b00-307e26ed7b0a\") " machine # [ 550.511889] k3s[886]: I1005 08:37:24.232748 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-ca" pod "92502b47-9312-4c7c-9b00-307e26ed7b0a" (UID: "92502b47-9312-4c7c-9b00-307e26ed7b0a"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 550.516778] k3s[886]: I1005 08:37:24.237699 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92502b47-9312-4c7c-9b00-307e26ed7b0a-tmp" pod "92502b47-9312-4c7c-9b00-307e26ed7b0a" (UID: "92502b47-9312-4c7c-9b00-307e26ed7b0a"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 550.518144] k3s[886]: I1005 08:37:24.239055 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-lb" pod "92502b47-9312-4c7c-9b00-307e26ed7b0a" (UID: "92502b47-9312-4c7c-9b00-307e26ed7b0a"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 550.527461] k3s[886]: I1005 08:37:24.248426 886 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92502b47-9312-4c7c-9b00-307e26ed7b0a-config" pod "92502b47-9312-4c7c-9b00-307e26ed7b0a" (UID: "92502b47-9312-4c7c-9b00-307e26ed7b0a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 550.569379] dhcpcd[685]: veth570e16d4: removing interface machine # [ 550.594653] k3s[886]: I1005 08:37:24.315591 886 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 550.595545] k3s[886]: I1005 08:37:24.316194 886 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/92502b47-9312-4c7c-9b00-307e26ed7b0a-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 550.596560] k3s[886]: I1005 08:37:24.316755 886 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92502b47-9312-4c7c-9b00-307e26ed7b0a-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 550.597227] k3s[886]: I1005 08:37:24.316772 886 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92502b47-9312-4c7c-9b00-307e26ed7b0a-config\") on node \"machine\" DevicePath \"\"" machine # [ 550.607581] (udev-worker)[11412]: Network interface NamePolicy= disabled on kernel command line. machine # [ 550.763131] cni0: port 1(veth2b3ff6d4) entered blocking state machine # [ 550.764522] cni0: port 1(veth2b3ff6d4) entered disabled state machine # [ 550.765800] veth2b3ff6d4: entered allmulticast mode machine # [ 550.766957] veth2b3ff6d4: entered promiscuous mode machine # [ 550.775229] cni0: port 1(veth2b3ff6d4) entered blocking state machine # [ 550.776727] cni0: port 1(veth2b3ff6d4) entered forwarding state machine # [ 550.644705] dhcpcd[685]: veth2b3ff6d4: IAID bb:4b:cb:85 machine # [ 550.645105] dhcpcd[685]: veth2b3ff6d4: adding address fe80::f077:bbff:fe4b:cb85 machine # [ 550.717654] systemd[1]: Started libcontainer container ffca45c07bb04d48ff22b5dd6d7759e538ce79e8a19c7fef7be43526efb44c86. machine # [ 550.858096] systemd[1]: Started libcontainer container 59f93a7d99f4dfdf9501920d979c7707b1375f4e931070e0932d9717f609519c. machine # [ 550.940730] k3s[886]: I1005 08:37:24.661016 886 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-685b9cb6c-2mzfw" podStartSLOduration=1.660991628 podStartE2EDuration="1.660991628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-05 08:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 08:37:24.660460834 +0000 UTC m=+533.946137229" watchObservedRunningTime="2026-10-05 08:37:24.660991628 +0000 UTC m=+533.946667464" machine # [ 551.101890] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod92502b47_9312_4c7c_9b00_307e26ed7b0a.slice. machine # [ 551.102391] systemd[1]: kubepods-besteffort-pod92502b47_9312_4c7c_9b00_307e26ed7b0a.slice: Consumed 5.851s CPU time over 8min 16.869s wall clock time, 57.4M memory peak, 35.1M read from disk, 617.6K incoming IP traffic, 869.1K outgoing IP traffic. machine # [ 551.266628] systemd[1]: var-lib-kubelet-pods-92502b47\x2d9312\x2d4c7c\x2d9b00\x2d307e26ed7b0a-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 551.271430] systemd[1]: var-lib-kubelet-pods-92502b47\x2d9312\x2d4c7c\x2d9b00\x2d307e26ed7b0a-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 551.275974] systemd[1]: var-lib-kubelet-pods-92502b47\x2d9312\x2d4c7c\x2d9b00\x2d307e26ed7b0a-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 551.279721] systemd[1]: run-netns-cni\x2db9226b11\x2d1dc2\x2d5f70\x2dc488\x2d9fe0a94f0cfc.mount: Deactivated successfully. machine # [ 551.282590] systemd[1]: var-lib-kubelet-pods-92502b47\x2d9312\x2d4c7c\x2d9b00\x2d307e26ed7b0a-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 551.286343] systemd[1]: var-lib-kubelet-pods-92502b47\x2d9312\x2d4c7c\x2d9b00\x2d307e26ed7b0a-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 551.290168] systemd[1]: var-lib-kubelet-pods-92502b47\x2d9312\x2d4c7c\x2d9b00\x2d307e26ed7b0a-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 551.331569] dhcpcd[685]: veth2b3ff6d4: soliciting a DHCP lease machine # [ 551.411436] k3s[886]: E1005 08:37:25.131386 886 kubelet_pods.go:2193] "failed to read memory cgroup config for the pod" err="failed to read memory.max for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92502b47_9312_4c7c_9b00_307e26ed7b0a.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92502b47_9312_4c7c_9b00_307e26ed7b0a.slice/memory.max: no such file or directory" podName="nix-grpc-farm-lb-685b9cb6c-5pqwx" machine # [ 551.412310] k3s[886]: E1005 08:37:25.131506 886 kubelet_pods.go:2198] "failed to read memory cgroup limits for the pod" err="failed to read cpu.max file for cgroup /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92502b47_9312_4c7c_9b00_307e26ed7b0a.slice: openat2 /sys/fs/cgroup/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92502b47_9312_4c7c_9b00_307e26ed7b0a.slice/cpu.max: no such file or directory" podName="nix-grpc-farm-lb-685b9cb6c-5pqwx" machine # [ 552.681426] nix[11204]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 553.099176] k3s[886]: I1005 08:37:26.818984 886 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92502b47-9312-4c7c-9b00-307e26ed7b0a" path="/var/lib/kubelet/pods/92502b47-9312-4c7c-9b00-307e26ed7b0a/volumes" machine # [ 553.185892] dhcpcd[685]: veth2b3ff6d4: soliciting an IPv6 router machine # [ 553.737686] nix[11204]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 553.737988] nix[11204]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-npk5s: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 556.334165] dhcpcd[685]: veth2b3ff6d4: probing for an IPv4LL address machine # [ 561.375715] dhcpcd[685]: veth2b3ff6d4: using IPv4LL address 169.254.81.172 machine # [ 561.376258] dhcpcd[685]: veth2b3ff6d4: adding route to 169.254.0.0/16 machine # [ 565.189118] dhcpcd[685]: veth2b3ff6d4: no IPv6 Routers available machine # [ 577.006691] k3s[886]: I1005 08:37:50.726784 886 scope.go:122] "RemoveContainer" containerID="da01f92e3f61d286dc1864ba98f7e1b9c524fbd38aeddc6666268e72ad517ef4" machine # [ 598.290337] niks3-server[1188]: 2026/10/05 08:38:12 INFO Received push request method=POST path=/api/pushes machine # [ 598.309179] niks3-server[1188]: 2026/10/05 08:38:12 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign machine # [ 598.311088] niks3-server[1188]: 2026/10/05 08:38:12 INFO Signed narinfos id=28 count=1 machine # [ 598.315703] niks3-server[1188]: 2026/10/05 08:38:12 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 598.318991] niks3-server[1188]: 2026/10/05 08:38:12 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 598.325237] niks3-server[1188]: 2026/10/05 08:38:12 INFO Received complete push request method=POST path=/api/pushes/28/complete machine # [ 598.331744] niks3-server[1188]: 2026/10/05 08:38:12 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 598.368647] systemd[1]: vialb.service: Deactivated successfully. machine # [ 598.370893] systemd[1]: vialb.service: Consumed 229ms CPU time over 49.492s wall clock time, 42.5M memory peak, 4K written to disk, 8.6K incoming IP traffic, 17.4K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.98 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.04 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.22 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.54 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 599.411126] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 9c0fe17c88f244c88923c6e900e2032d machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.02 seconds) machine # [ 599.551744] nix[12162]: don't know how to build these paths: machine # [ 599.552891] nix[12162]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 599.574204] nix[12162]: copying 1 paths to '127.0.0.1:30051'... machine # [ 599.575082] nix[12162]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 599.610205] k3s[886]: E1005 08:38:13.330700 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47214: use of closed network connection" machine # command terminated with exit code 1 machine # [ 599.619661] niks3-server[1188]: 2026/10/05 08:38:13 INFO Received push request method=POST path=/api/pushes machine # [ 599.635138] niks3-server[1188]: 2026/10/05 08:38:13 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign machine # [ 599.637405] niks3-server[1188]: 2026/10/05 08:38:13 INFO Signed narinfos id=29 count=1 machine # [ 599.640755] niks3-server[1188]: 2026/10/05 08:38:13 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 599.642993] niks3-server[1188]: 2026/10/05 08:38:13 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 599.647197] niks3-server[1188]: 2026/10/05 08:38:13 INFO Received complete push request method=POST path=/api/pushes/29/complete machine # [ 599.654164] niks3-server[1188]: 2026/10/05 08:38:13 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 599.661168] nix[12162]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 599.662842] nix[12162]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 599.828050] k3s[886]: E1005 08:38:13.548852 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47224: use of closed network connection" machine # command terminated with exit code 1 machine # [ 601.120686] k3s[886]: E1005 08:38:14.841223 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47232: use of closed network connection" machine # command terminated with exit code 1 machine # [ 601.324247] k3s[886]: E1005 08:38:15.045071 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47234: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 602.616214] k3s[886]: E1005 08:38:16.335631 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47238: use of closed network connection" machine # [ 602.829257] k3s[886]: E1005 08:38:16.550010 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47244: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 604.128855] k3s[886]: E1005 08:38:17.848963 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39806: use of closed network connection" machine # [ 604.332497] k3s[886]: E1005 08:38:18.053369 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39808: use of closed network connection" machine # command terminated with exit code 1 machine # [ 605.652144] k3s[886]: E1005 08:38:19.372605 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39824: use of closed network connection" machine # command terminated with exit code 1 machine # [ 605.851979] k3s[886]: E1005 08:38:19.572862 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39826: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 607.185478] k3s[886]: E1005 08:38:20.905224 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39840: use of closed network connection" machine # [ 607.389991] k3s[886]: E1005 08:38:21.110887 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39850: use of closed network connection" machine # command terminated with exit code 1 machine # [ 608.639879] k3s[886]: E1005 08:38:22.360075 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39864: use of closed network connection" machine # command terminated with exit code 1 machine # [ 608.835774] k3s[886]: E1005 08:38:22.556681 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39866: use of closed network connection" machine # command terminated with exit code 1 machine # [ 610.152694] k3s[886]: E1005 08:38:23.873265 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39872: use of closed network connection" machine # command terminated with exit code 1 machine # [ 610.372542] k3s[886]: E1005 08:38:24.093210 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39882: use of closed network connection" machine # command terminated with exit code 1 machine # [ 610.726446] postgres[768]: [768] LOG: checkpoint starting: time machine # [ 611.697276] k3s[886]: E1005 08:38:25.417749 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39886: use of closed network connection" machine # command terminated with exit code 1 machine # [ 611.891285] k3s[886]: E1005 08:38:25.611973 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:39890: use of closed network connection" machine # command terminated with exit code 1 machine # [ 613.159129] postgres[768]: [768] LOG: checkpoint complete: wrote 24 buffers (0.1%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.413 s, sync=0.008 s, total=2.434 s; sync files=22, longest=0.005 s, average=0.001 s; distance=242 kB, estimate=4504 kB; lsn=0/1C7F708, redo lsn=0/1C7F6B0 machine # [ 613.198271] k3s[886]: E1005 08:38:26.918571 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45076: use of closed network connection" machine # command terminated with exit code 1 machine # [ 613.402302] k3s[886]: E1005 08:38:27.123149 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45090: use of closed network connection" machine # command terminated with exit code 1 machine # [ 614.726050] k3s[886]: E1005 08:38:28.446122 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45094: use of closed network connection" machine # command terminated with exit code 1 machine # [ 614.926078] k3s[886]: E1005 08:38:28.646874 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45110: use of closed network connection" machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 616.224234] k3s[886]: E1005 08:38:29.944255 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45124: use of closed network connection" machine # [ 616.429114] k3s[886]: E1005 08:38:30.150011 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45126: use of closed network connection" machine # command terminated with exit code 1 machine # [ 617.718297] k3s[886]: E1005 08:38:31.438835 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45140: use of closed network connection" machine # command terminated with exit code 1 machine # [ 617.922099] k3s[886]: E1005 08:38:31.642957 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45146: use of closed network connection" machine # command terminated with exit code 1 machine # [ 619.231164] k3s[886]: E1005 08:38:32.951707 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45150: use of closed network connection" machine # command terminated with exit code 1 machine # [ 619.439288] k3s[886]: E1005 08:38:33.159739 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45158: use of closed network connection" machine # command terminated with exit code 1 machine # [ 620.009647] k3s[886]: I1005 08:38:33.728563 886 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 620.737777] k3s[886]: E1005 08:38:34.458343 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45168: use of closed network connection" machine # command terminated with exit code 1 machine # [ 620.947538] k3s[886]: E1005 08:38:34.668428 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45170: use of closed network connection" machine # command terminated with exit code 1 machine # [ 622.263904] k3s[886]: E1005 08:38:35.984325 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45174: use of closed network connection" machine # command terminated with exit code 1 machine # [ 622.480916] k3s[886]: E1005 08:38:36.201801 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:45178: use of closed network connection" machine # command terminated with exit code 1 machine # [ 623.775437] k3s[886]: E1005 08:38:37.495821 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47264: use of closed network connection" machine # command terminated with exit code 1 machine # [ 624.000106] k3s[886]: E1005 08:38:37.720763 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47276: use of closed network connection" machine # [ 624.202852] k3s[886]: E1005 08:38:37.923759 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47286: use of closed network connection" machine # command terminated with exit code 1 machine # [ 624.415645] k3s[886]: E1005 08:38:38.136548 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47302: use of closed network connection" machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8 --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7f47df8658-qfjw8 --wait=false, in 0.17 seconds) machine: must succeed: sleep 5.0 machine # [ 624.650614] systemd[1]: cri-containerd-9c6aafd9ff7cf962b8882b8e5d9856f98ed41c919e5a212621f994964ecbcfea.scope: Deactivated successfully. machine # [ 624.651123] systemd[1]: cri-containerd-9c6aafd9ff7cf962b8882b8e5d9856f98ed41c919e5a212621f994964ecbcfea.scope: Consumed 594ms CPU time over 9min 17.834s wall clock time, 12.2M memory peak, 5.2M read from disk. machine # [ 624.686229] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9c6aafd9ff7cf962b8882b8e5d9856f98ed41c919e5a212621f994964ecbcfea-rootfs.mount: Deactivated successfully. machine # [ 625.249177] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod2149f445_c6bd_44fa_9871_550ed5c0f84d.slice. machine # [ 625.402180] k3s[886]: I1005 08:38:39.122672 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz2pg\" (UniqueName: \"kubernetes.io/projected/2149f445-c6bd-44fa-9871-550ed5c0f84d-kube-api-access-cz2pg\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2\" (UID: \"2149f445-c6bd-44fa-9871-550ed5c0f84d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" machine # [ 625.402456] k3s[886]: I1005 08:38:39.122732 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/2149f445-c6bd-44fa-9871-550ed5c0f84d-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2\" (UID: \"2149f445-c6bd-44fa-9871-550ed5c0f84d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" machine # [ 625.403276] k3s[886]: I1005 08:38:39.122766 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"spool\" (UniqueName: \"kubernetes.io/empty-dir/2149f445-c6bd-44fa-9871-550ed5c0f84d-spool\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2\" (UID: \"2149f445-c6bd-44fa-9871-550ed5c0f84d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" machine # [ 625.403754] k3s[886]: I1005 08:38:39.122795 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/2149f445-c6bd-44fa-9871-550ed5c0f84d-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2\" (UID: \"2149f445-c6bd-44fa-9871-550ed5c0f84d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" machine # [ 625.404430] k3s[886]: I1005 08:38:39.122823 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/2149f445-c6bd-44fa-9871-550ed5c0f84d-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2\" (UID: \"2149f445-c6bd-44fa-9871-550ed5c0f84d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" machine # [ 625.404953] k3s[886]: I1005 08:38:39.122849 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/2149f445-c6bd-44fa-9871-550ed5c0f84d-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2\" (UID: \"2149f445-c6bd-44fa-9871-550ed5c0f84d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" machine # [ 625.405799] k3s[886]: I1005 08:38:39.122880 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/2149f445-c6bd-44fa-9871-550ed5c0f84d-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2\" (UID: \"2149f445-c6bd-44fa-9871-550ed5c0f84d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" machine # [ 625.406653] k3s[886]: I1005 08:38:39.122907 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/2149f445-c6bd-44fa-9871-550ed5c0f84d-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2\" (UID: \"2149f445-c6bd-44fa-9871-550ed5c0f84d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" machine # [ 625.407231] k3s[886]: I1005 08:38:39.122937 886 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2149f445-c6bd-44fa-9871-550ed5c0f84d-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2\" (UID: \"2149f445-c6bd-44fa-9871-550ed5c0f84d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" machine # [ 625.796473] cni0: port 3(veth8604be05) entered blocking state machine # [ 625.798694] cni0: port 3(veth8604be05) entered disabled state machine # [ 625.800578] veth8604be05: entered allmulticast mode machine # [ 625.802508] veth8604be05: entered promiscuous mode machine # [ 625.813318] cni0: port 3(veth8604be05) entered blocking state machine # [ 625.814774] cni0: port 3(veth8604be05) entered forwarding state machine # [ 625.689107] (udev-worker)[13763]: Network interface NamePolicy= disabled on kernel command line. machine # [ 625.721522] dhcpcd[685]: veth8604be05: IAID 03:70:fd:1d machine # [ 625.721935] dhcpcd[685]: veth8604be05: adding address fe80::18f8:3ff:fe70:fd1d machine # [ 625.747326] systemd[1]: tmp-ovl\x2didmapped2413102992.mount: Deactivated successfully. machine # [ 625.767295] systemd[1]: Started libcontainer container fde7be93325f0b369a7b2b74e903006d97a8c01719068eb2e28bf320e40e090e. machine # [ 625.985387] systemd[1]: Started libcontainer container d369d32827260036146b5bb074a489f9a3d6b68603e7bc8a6c2fd2b8c79c83ce. machine # [ 626.623748] dhcpcd[685]: veth8604be05: soliciting a DHCP lease machine # [ 627.386907] dhcpcd[685]: veth8604be05: soliciting an IPv6 router machine # [ 628.396511] systemd[1]: cri-containerd-d369d32827260036146b5bb074a489f9a3d6b68603e7bc8a6c2fd2b8c79c83ce.scope: Deactivated successfully. machine # [ 628.399670] systemd[1]: cri-containerd-d369d32827260036146b5bb074a489f9a3d6b68603e7bc8a6c2fd2b8c79c83ce.scope: Consumed 972ms CPU time over 2.412s wall clock time, 474.8M memory peak, 194.4M read from disk, 46.3M written to disk. machine # [ 628.453140] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d369d32827260036146b5bb074a489f9a3d6b68603e7bc8a6c2fd2b8c79c83ce-rootfs.mount: Deactivated successfully. machine # [ 628.987107] systemd[1]: tmp-ovl\x2didmapped2240967426.mount: Deactivated successfully. machine # [ 629.002497] systemd[1]: Started libcontainer container 3143139383e031a3e6582033bbdb4e39fd60aafe57fa667ba309aa4e6039c562. machine # [ 629.183313] systemd[1]: Started libcontainer container 16146836d5e6a0d291a978b3a9d5d48199c4f5c793e1a5ac64e46daa2a865a73. machine # [ 629.383323] systemd[1]: Started libcontainer container eb57fb1dc22ed548ffd3c92f2667fbed1327d59bef5b1d71dd1e9b338506d344. machine # [ 629.462175] k3s[886]: I1005 08:38:43.182519 886 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7f47df8658-phpw2" podStartSLOduration=2.804112881 podStartE2EDuration="5.182489742s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.378376861s" isStatefulPod=false podCreationTimestamp="2026-10-05 08:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-05 08:38:43.181728751 +0000 UTC m=+612.467480575" watchObservedRunningTime="2026-10-05 08:38:43.182489742 +0000 UTC m=+612.468165578" machine: (finished: must succeed: sleep 5.0, in 5.04 seconds) machine # [ 629.830558] k3s[886]: E1005 08:38:43.551365 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47304: use of closed network connection" machine # command terminated with exit code 1 machine # [ 630.028698] k3s[886]: E1005 08:38:43.749577 886 conn.go:353] "Error on socket receive" err="read tcp 127.0.0.1:10250->127.0.0.1:47306: use of closed network connection" machine: waiting for success: ! systemctl is-active slow machine # [ 631.624969] dhcpcd[685]: veth8604be05: probing for an IPv4LL address machine # [ 636.941238] dhcpcd[685]: veth8604be05: using IPv4LL address 169.254.33.206 machine # [ 636.942417] dhcpcd[685]: veth8604be05: adding route to 169.254.0.0/16 machine # [ 639.390883] dhcpcd[685]: veth8604be05: no IPv6 Routers available machine # [ 644.005639] niks3-server[1188]: 2026/10/05 08:38:57 INFO Received push request method=POST path=/api/pushes machine # [ 644.026866] niks3-server[1188]: 2026/10/05 08:38:57 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign machine # [ 644.028595] niks3-server[1188]: 2026/10/05 08:38:57 INFO Signed narinfos id=30 count=1 machine # [ 644.033367] niks3-server[1188]: 2026/10/05 08:38:57 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 644.034979] niks3-server[1188]: 2026/10/05 08:38:57 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 644.043266] niks3-server[1188]: 2026/10/05 08:38:57 INFO Received complete push request method=POST path=/api/pushes/30/complete machine # [ 644.048719] niks3-server[1188]: 2026/10/05 08:38:57 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 644.078373] systemd[1]: slow.service: Deactivated successfully. machine # [ 644.079321] systemd[1]: slow.service: Consumed 172ms CPU time over 44.667s wall clock time, 38.3M memory peak, 4K written to disk, 5.4K incoming IP traffic, 11.7K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.60 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.04 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.15 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 45.50 seconds) (finished: run the VM test script, in 645.83 seconds) test script finished in 645.89s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-10-05T08:38:59Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-10-05T08:38:59Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-10-05T08:38:59Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.09 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh