tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine # Disk image does not exist, creating the virtualisation disk image... machine: QEMU running (pid 45) machine # Formatting '/build/vm-state-machine/tmp.yuhVeoNKY0', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 17c82819-ad08-4e80-a1e6-4278cbe0eb58 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # Starting virtiofs daemons... machine # [2026-09-21T14:43:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-21T14:43:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-21T14:43:29Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-21T14:43:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-21T14:43:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-21T14:43:29Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-21T14:43:29Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) machine # [2026-09-21T14:43:29Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether machine # [2026-09-21T14:43:29Z INFO virtiofsd] Waiting for vhost-user socket connection... machine # [2026-09-21T14:43:29Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-21T14:43:29Z INFO virtiofsd] Client connected, servicing requests machine # [2026-09-21T14:43:29Z INFO virtiofsd] Client connected, servicing requests machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:05.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 14 11:36:19 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/y1qll7v7k0glicb17p8d6a0g4ms0382l-nixos-system-machine-test/init regInfo=/nix/store/47mcwyc0vi0jq8j3cj6wys91ixvqrxgj-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 494065292 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000814] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000844] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000883] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002737] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002749] Using GB pages for direct mapping machine # [ 0.002879] RAMDISK: [mem 0x7e371000-0x7ffcffff] machine # [ 0.002886] ACPI: Early table checksum verification disabled machine # [ 0.002889] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002892] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002896] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002903] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002905] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002907] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002908] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002910] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002911] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002913] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002914] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002914] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002915] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002915] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002916] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002916] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003162] No NUMA configuration found machine # [ 0.003163] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003166] NODE_DATA(0) allocated [mem 0x17fff8780-0x17fffdcff] machine # [ 0.005468] Zone ranges: machine # [ 0.005469] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005470] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005472] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005473] Device empty machine # [ 0.005473] Movable zone start for each node machine # [ 0.005474] Early memory node ranges machine # [ 0.005475] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005476] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005476] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005477] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005496] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005757] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.077888] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.078360] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.078375] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.078405] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.078408] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.078410] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.078411] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.078412] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.078413] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.078415] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.078417] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.078422] TSC deadline timer available machine # [ 0.078434] CPU topo: Max. logical packages: 1 machine # [ 0.078434] CPU topo: Max. logical dies: 1 machine # [ 0.078435] CPU topo: Max. dies per package: 1 machine # [ 0.078438] CPU topo: Max. threads per core: 1 machine # [ 0.078439] CPU topo: Num. cores per package: 4 machine # [ 0.078439] CPU topo: Num. threads per package: 4 machine # [ 0.078439] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.078463] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.078478] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.078481] kvm-guest: setup PV sched yield machine # [ 0.078490] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.078492] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.078493] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.078494] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.078496] Booting paravirtualized kernel on KVM machine # [ 0.078500] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.083014] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.085217] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.085265] kvm-guest: PV spinlocks enabled machine # [ 0.085267] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.085269] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/y1qll7v7k0glicb17p8d6a0g4ms0382l-nixos-system-machine-test/init regInfo=/nix/store/47mcwyc0vi0jq8j3cj6wys91ixvqrxgj-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.085364] Unknown kernel command line parameters "regInfo=/nix/store/47mcwyc0vi0jq8j3cj6wys91ixvqrxgj-closure-info/registration", will be passed to user space. machine # [ 0.085377] random: crng init done machine # [ 0.085378] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.089899] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.092028] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.092102] software IO TLB: area num 4. machine # [ 0.166082] Fallback order for Node 0: 0 machine # [ 0.166089] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.166091] Policy zone: Normal machine # [ 0.168593] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.175720] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.184763] allocated 8388608 bytes of page_ext machine # [ 0.194662] ftrace: allocating 48787 entries in 192 pages machine # [ 0.194664] ftrace: allocated 192 pages with 2 groups machine # [ 0.195494] Dynamic Preempt: lazy machine # [ 0.195672] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.195673] rcu: RCU event tracing is enabled. machine # [ 0.195674] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.195675] Trampoline variant of Tasks RCU enabled. machine # [ 0.195675] Rude variant of Tasks RCU enabled. machine # [ 0.195676] Tracing variant of Tasks RCU enabled. machine # [ 0.195676] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.195677] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.195697] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.195699] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.195700] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.200099] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.200402] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.200410] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.200529] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.204132] Console: colour VGA+ 80x25 machine # [ 0.204135] printk: legacy console [tty0] enabled machine # [ 0.235747] printk: legacy console [ttyS0] enabled machine # [ 0.348201] ACPI: Core revision 20250807 machine # [ 0.349089] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.350723] APIC: Switch to symmetric I/O mode setup machine # [ 0.351783] x2apic enabled machine # [ 0.352538] APIC: Switched APIC routing to: physical x2apic machine # [ 0.353504] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.354787] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.356330] kvm-guest: setup PV IPIs machine # [ 0.357917] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.359005] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.363331] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.365410] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.366456] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.367328] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.368332] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.369328] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.370328] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.372125] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.373089] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.374327] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.375334] Spectre V2 : Enabling IBPB for BPF machine # [ 0.376329] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.377328] active return thunk: srso_alias_return_thunk machine # [ 0.379048] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.380327] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.381327] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.382328] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.383328] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.384327] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.385328] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.387328] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.388328] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.389327] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.390328] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.391328] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.392328] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.422641] Freeing SMP alternatives memory: 44K machine # [ 0.423330] pid_max: default: 32768 minimum: 301 machine # [ 0.424406] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.425437] landlock: Up and running. machine # [ 0.426094] Yama: becoming mindful. machine # [ 0.427002] LSM support for eBPF active machine # [ 0.427527] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.429403] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.432017] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.432868] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.433333] ... version: 2 machine # [ 0.434076] ... bit width: 48 machine # [ 0.434331] ... generic counters: 6 machine # [ 0.435105] ... generic bitmap: 000000000000003f machine # [ 0.435387] ... fixed-purpose counters: 0 machine # [ 0.436171] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.437061] ... value mask: 0000ffffffffffff machine # [ 0.437330] ... max period: 00007fffffffffff machine # [ 0.438284] ... global_ctrl mask: 000000000000003f machine # [ 0.439177] signal: max sigframe size: 3376 machine # [ 0.439952] rcu: Hierarchical SRCU implementation. machine # [ 0.440333] rcu: Max phase no-delay instances is 400. machine # [ 0.441476] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.446858] smp: Bringing up secondary CPUs ... machine # [ 0.447803] smpboot: x86: Booting SMP configuration: machine # [ 0.448339] .... node #0, CPUs: #1 #2 #3 machine # [ 0.451469] smp: Brought up 1 node, 4 CPUs machine # [ 0.453091] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.453658] Memory: 3957832K/4193752K available (17247K kernel code, 2727K rwdata, 13616K rodata, 3652K init, 2976K bss, 220856K reserved, 0K cma-reserved) machine # [ 0.455330] devtmpfs: initialized machine # [ 0.456129] x86/mm: Memory block size: 128MB machine # [ 0.458517] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.460408] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.461424] pinctrl core: initialized pinctrl subsystem machine # [ 0.462645] PM: RTC time: 14:43:29, date: 2026-09-21 machine # [ 0.466587] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.468096] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.469356] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.470889] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.471341] audit: initializing netlink subsys (disabled) machine # [ 0.472356] audit: type=2000 audit(1790001810.119:1): state=initialized audit_enabled=0 res=1 machine # [ 0.472557] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.474332] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.475330] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.476330] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.477330] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.478342] cpuidle: using governor menu machine # [ 0.480523] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.481602] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.482334] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.483343] PCI: Using configuration type 1 for base access machine # [ 0.484491] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.487674] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.488331] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.489331] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.490330] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.495764] ACPI: Added _OSI(Module Device) machine # [ 0.497343] ACPI: Added _OSI(Processor Device) machine # [ 0.499337] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.508160] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.516353] ACPI: Interpreter enabled machine # [ 0.517399] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.519340] ACPI: Using IOAPIC for interrupt routing machine # [ 0.521543] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.525338] PCI: Using E820 reservations for host bridge windows machine # [ 0.528730] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.541158] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.543345] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.547514] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.549601] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.553248] PCI host bridge to bus 0000:00 machine # [ 0.554340] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.556335] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.559341] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.561335] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.564334] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.566331] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.567331] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.568497] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.570793] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.585419] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.586378] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.587352] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.588501] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.593612] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.599372] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] machine # [ 0.600305] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.601192] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.602342] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.604904] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.608400] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] machine # [ 0.609297] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.610141] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.611890] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.616369] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.617303] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.619178] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.620905] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.625339] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.627092] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.628352] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.630336] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.631916] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.634373] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.635377] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.637530] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.640374] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.641353] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.643077] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.646371] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.659237] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.660931] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint machine # [ 0.664273] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.666176] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.667896] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.672377] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.673315] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.675153] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.676869] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.680338] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.681264] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.682126] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.683883] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.686094] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] machine # [ 0.687552] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.689979] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] machine # [ 0.690526] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.693206] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] machine # [ 0.694270] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.697053] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.698562] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.699621] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.701622] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.704359] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] machine # [ 0.705635] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.707715] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.709023] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.713656] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.714444] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.716435] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.717436] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.718431] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.719426] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.720432] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.721431] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.723365] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.724347] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.725343] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.726348] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.727344] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.728342] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.729343] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.730343] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.733534] iommu: Default domain type: Translated machine # [ 0.734007] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.735674] ACPI: bus type USB registered machine # [ 0.736416] usbcore: registered new interface driver usbfs machine # [ 0.738356] usbcore: registered new interface driver hub machine # [ 0.739342] usbcore: registered new device driver usb machine # [ 0.741608] NetLabel: Initializing machine # [ 0.742264] NetLabel: domain hash size = 128 machine # [ 0.742934] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.743444] NetLabel: unlabeled traffic allowed by default machine # [ 0.744343] PCI: Using ACPI for IRQ routing machine # [ 0.788556] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.789327] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.789327] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.792337] vgaarb: loaded machine # [ 0.793120] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.794332] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.799443] clocksource: Switched to clocksource kvm-clock machine # [ 0.804583] VFS: Disk quotas dquot_6.6.0 machine # [ 0.805362] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.807099] pnp: PnP ACPI init machine # [ 0.807894] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.808933] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.810525] pnp: PnP ACPI: found 5 devices machine # [ 0.820415] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.822111] clocksource: Switched to clocksource acpi_pm machine # [ 0.823117] NET: Registered PF_INET protocol family machine # [ 0.824981] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.842187] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.843706] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.845173] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.847747] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.849157] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.850433] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.851822] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.853019] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.854400] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.855421] NET: Registered PF_XDP protocol family machine # [ 0.856336] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.857422] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.858504] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.859668] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.860851] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.862040] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.863985] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.866163] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.868288] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.870400] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.872264] PCI: CLS 0 bytes, default 64 machine # [ 0.873126] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.873594] Trying to unpack rootfs image as initramfs... machine # [ 0.874197] software IO TLB: mapped [mem 0x000000007a371000-0x000000007e371000] (64MB) machine # [ 0.874331] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.897669] Initialise system trusted keyrings machine # [ 0.899063] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.910461] Key type asymmetric registered machine # [ 0.911249] Asymmetric key parser 'x509' registered machine # [ 0.912143] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.913971] io scheduler mq-deadline registered machine # [ 0.914765] io scheduler kyber registered machine # [ 0.919026] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.920347] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.922730] Linux agpgart interface v0.103 machine # [ 0.923553] ACPI: bus type drm_connector registered machine # [ 0.926658] usbcore: registered new interface driver usbserial_generic machine # [ 0.927789] usbserial: USB Serial support registered for generic machine # [ 0.928816] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.928816] Please enable it if your BIOS has the CPPC option. machine # [ 0.931164] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.932649] drop_monitor: Initializing network drop monitor service machine # [ 0.933872] NET: Registered PF_INET6 protocol family machine # [ 0.937145] Segment Routing with IPv6 machine # [ 0.938909] In-situ OAM (IOAM) with IPv6 machine # [ 0.942824] IPI shorthand broadcast: enabled machine # [ 0.954240] sched_clock: Marking stable (800031432, 153917775)->(973489952, -19540745) machine # [ 0.958707] registered taskstats version 1 machine # [ 0.961635] Loading compiled-in X.509 certificates machine # [ 0.984766] Demotion targets for Node 0: null machine # [ 0.986737] Key type .fscrypt registered machine # [ 0.988155] Key type fscrypt-provisioning registered machine # [ 0.990119] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.991965] ima: Allocated hash algorithm: sha1 machine # [ 0.993558] ima: No architecture policies found machine # [ 0.995498] PM: Magic number: 10:765:738 machine # [ 0.998735] RAS: Correctable Errors collector initialized. machine # [ 1.006002] clk: Disabling unused clocks machine # [ 1.006742] PM: genpd: Disabling unused power domains machine # [ 1.157681] Freeing initrd memory: 29052K machine # [ 1.165321] Freeing unused decrypted memory: 2028K machine # [ 1.171720] Freeing unused kernel image (initmem) memory: 3652K machine # [ 1.174480] Write protecting the kernel read-only data: 32768k machine # [ 1.179352] Freeing unused kernel image (text/rodata gap) memory: 1184K machine # [ 1.183263] Freeing unused kernel image (rodata/data gap) memory: 720K machine # [ 1.251145] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.252343] Run /init as init process machine # [ 1.266687] systemd[1]: Inserted module 'autofs4' machine # [ 1.292855] fuse: init (API version 7.45) machine # [ 1.302074] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.304416] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.307839] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.310041] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.315326] virtiofs virtio5: discovered new tag: nix-store machine # [ 1.316988] virtiofs virtio5: virtio_fs_setup_dax: No cache capability machine # [ 1.324338] virtiofs virtio6: discovered new tag: shared machine # [ 1.337348] virtiofs virtio6: virtio_fs_setup_dax: No cache capability machine # [ 1.340756] virtiofs virtio7: discovered new tag: xchg machine # [ 1.342257] virtiofs virtio7: virtio_fs_setup_dax: No cache capability machine # [ 1.367624] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.704464] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.717889] systemd[1]: Detected virtualization kvm. machine # [ 1.720168] systemd[1]: Detected architecture x86-64. machine # [ 1.722401] systemd[1]: Running in initrd. machine # [ 1.724859] systemd[1]: Initializing machine ID from random generator. machine # [ 1.727838] systemd[1]: Hostname set to . machine # [ 1.848552] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.909078] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.920584] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.921851] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.924811] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.927026] systemd[1]: Reached target Path Units. machine # [ 1.928730] systemd[1]: Reached target Slice Units. machine # [ 1.930511] systemd[1]: Reached target Swaps. machine # [ 1.932102] systemd[1]: Reached target Timer Units. machine # [ 1.934046] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.936378] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.938632] systemd[1]: Listening on Journal Sockets. machine # [ 1.940664] systemd[1]: Listening on udev Control Socket. machine # [ 1.942437] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.943443] systemd[1]: Reached target Socket Units. machine # [ 1.945593] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.947798] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.950827] systemd[1]: Starting Journal Service... machine # [ 1.953996] systemd[1]: Starting Load Kernel Modules... machine # [ 1.955021] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.959951] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.966732] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.971320] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.975464] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.979042] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.988061] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.991180] systemd-journald[90]: Collecting audit messages is disabled. machine # [ 2.002693] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 2.007676] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 2.011551] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 2.014113] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 2.015740] systemd[1]: Finished Load Kernel Modules. machine # [ 2.018082] systemd[1]: Starting Apply Kernel Variables... machine # [ 2.027064] systemd[1]: Finished Apply Kernel Variables. machine # [ 2.028636] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 2.030040] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 2.031304] systemd[1]: Reached target Local File Systems. machine # [ 2.033422] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 2.041946] systemd[1]: Started Journal Service. machine # [ 1.888118] systemd-modules-load[91]: Using 4 probe threads machine # [ 1.891417] systemd-modules-load[91]: Inserted module 'virtio_balloon' machine # [ 1.893777] systemd-modules-load[91]: Inserted module 'virtio_gpu' machine # [ 1.895072] systemd-modules-load[91]: Inserted module 'dm_mod' machine # [ 1.896112] systemd[1]: Starting Create System Files and Directories... machine # [ 1.903521] systemd[1]: Finished Create System Files and Directories. machine # [ 1.907739] systemd-udevd[101]: Using default interface naming scheme 'v261'. machine # [ 1.918782] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.932980] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.933820] systemd[1]: Reached target System Initialization. machine # [ 1.934670] systemd[1]: Reached target Basic System. machine # [ 2.176327] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.179464] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.180289] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.188402] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.189515] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.191468] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.193488] virtio_blk virtio2: 4/0/0 default/read/poll queues machine # [ 2.198460] virtio_blk virtio2: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.200651] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.201843] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.203322] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.204518] usb usb1: Product: EHCI Host Controller machine # [ 2.205958] usb usb1: Manufacturer: Linux 6.18.52 ehci_hcd machine # [ 2.206741] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.209712] hub 1-0:1.0: USB hub found machine # [ 2.209940] SCSI subsystem initialized machine # [ 2.211502] hub 1-0:1.0: 6 ports detected machine # [ 2.222832] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.223684] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.224830] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.225711] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 machine # [ 2.073251] s[ 2.226851] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # ystemd[1]: Starting Virtual Console Setup... machine # [ 2.228298] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.229622] usb usb2: Product: UHCI Host Controller machine # [ 2.230460] usb usb2: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.231326] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 2.232181] hub 2-0:1.0: USB hub found machine # [ 2.233376] hub 2-0:1.0: 2 ports detected machine # [ 2.081330] (udev-worker)[115]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface[ 2.237220] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # name. machine # [ 2.238624] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.239984] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.240888] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 machine # [ 2.241887] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.243267] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.088739] (udev-worker)[115]: Network inter[ 2.244449] usb usb3: Product: UHCI Host Controller machine # face NamePolicy= disabled on kernel command line.[ 2.245542] usb usb3: Manufacturer: Linux 6.18.52 uhci_hcd machine # machine # [ 2.246690] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.247995] hub 3-0:1.0: USB hub found machine # [ 2.094635] (udev-worker)[125]: Network interface NamePolicy=[ 2.248758] hub 3-0:1.0: 2 ports detected machine # disabled on kernel command line. machine # [ 2.251767] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.252685] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.253843] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.254772] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 machine # [ 2.101904] systemd-vconsole-setup[140]: Configuration of first virtual console was [ 2.256155] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # skipped, ignoring remaining ones. machine # [ 2.258056] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.259601] usb usb4: Product: UHCI Host Controller machine # [ 2.260427] usb usb4: Manufacturer: Linux 6.18.52 uhci_hcd machine # [ 2.261724] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.105945] systemd[1]: Finished Virtual Console Setup. machine # [ 2.263413] hub 4-0:1.0: USB hub found machine # [ 2.264277] hub 4-0:1.0: 2 ports detected machine # [ 2.267451] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.117182] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.118114] systemd[1]: Reached target Initrd Root Device. machine # [ 2.119565] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.281033] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.282327] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.283707] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.286450] scsi host0: ahci machine # [ 2.287425] scsi host1: ahci machine # [ 2.288581] scsi host2: ahci machine # [ 2.289702] scsi host3: ahci machine # [ 2.290790] scsi host4: ahci machine # [ 2.291840] scsi host5: ahci machine # [ 2.292651] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 50 lpm-pol 1 machine # [ 2.293949] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 50 lpm-pol 1 machine # [ 2.293955] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 50 lpm-pol 1 machine # [ 2.293961] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 50 lpm-pol 1 machine # [ 2.297629] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 50 lpm-pol 1 machine # [ 2.297635] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 50 lpm-pol 1 machine # [ 2.157669] systemd-fsck[171]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.160944] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.457997] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.588285] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.591299] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.594056] usb 1-1: Product: QEMU USB Tablet machine # [ 2.595683] usb 1-1: Manufacturer: QEMU machine # [ 2.597176] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.618392] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.620740] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.623268] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.625515] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.627858] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.630314] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.632440] ata3.00: applying bridge limits machine # [ 2.634379] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.635455] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.636619] ata3.00: configured for UDMA/100 machine # [ 2.640721] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.670187] usbcore: registered new interface driver usbhid machine # [ 2.672257] usbhid: USB HID core driver machine # [ 2.683028] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.687382] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.704477] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.742446] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.810474] systemd[1]: Mounting /sysroot... machine # [ 3.103850] EXT4-fs (vda): mounted filesystem 17c82819-ad08-4e80-a1e6-4278cbe0eb58 r/w with ordered data mode. Quota mode: none. machine # [ 2.984301] systemd[1]: Mounted /sysroot. machine # [ 2.986399] systemd[1]: Reached target Initrd Root File System. machine # [ 2.992437] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.995891] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 3.009439] systemd[1]: Mounting /sysroot/run... machine # [ 3.013733] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 3.018297] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 3.028335] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 3.030983] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.033179] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 3.035043] systemd[1]: Mounted /sysroot/run. machine # [ 3.036518] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.039124] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.047271] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.051998] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.054674] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.056929] systemd-sysroot-fstab-check[191]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 3.060401] systemd[1]: Reload requested from client PID 191 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 3.064128] systemd[1]: Reloading... machine # [ 3.119878] systemd[1]: Reloading finished in 63 ms. machine # [ 3.141180] systemd-sysroot-fstab-check[191]: Requesting initrd-fs.target/start/replace... machine # [ 3.146886] systemd-sysroot-fstab-check[191]: Requesting swap.target/start/replace... machine # [ 3.151409] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.155975] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.158158] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.160211] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.173838] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.176070] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.811186] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.866941] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.869128] systemd[1]: Reached target Initrd File Systems. machine # [ 3.871244] systemd[1]: Starting Find NixOS closure... machine # [ 3.873226] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.896379] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.899139] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.916844] systemd[1]: Finished Find NixOS closure. machine # [ 3.918840] systemd[1]: Reached target Initrd Default Target. machine # [ 3.920988] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.949512] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.951773] systemd[1]: Stopped target Basic System. machine # [ 3.953681] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.955717] systemd[1]: Stopped target Path Units. machine # [ 3.957563] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.960228] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.962862] systemd[1]: Stopped target Slice Units. machine # [ 3.964711] systemd[1]: Stopped target Socket Units. machine # [ 3.966583] systemd[1]: Stopped target System Initialization. machine # [ 3.968728] systemd[1]: Stopped target Swaps. machine # [ 3.971222] systemd[1]: Stopped target Timer Units. machine # [ 3.973178] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.975416] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.977787] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.980728] systemd[1]: Stopped Find NixOS closure. machine # [ 3.982464] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.985307] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.987539] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.989156] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.991288] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.992772] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.994901] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.997089] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.999151] systemd[1]: Stopped Create System Files and Directories. machine # [ 4.000953] systemd[1]: Stopped target Local File Systems. machine # [ 4.002532] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 4.004388] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 4.006324] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 4.007859] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 4.009290] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 4.010542] systemd[1]: Stopped Virtual Console Setup. machine # [ 4.011521] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 4.012738] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 4.013810] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 4.014899] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 4.015789] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 4.016898] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 4.018175] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 4.019305] systemd[1]: Closed udev Control Socket. machine # [ 4.020145] systemd[1]: Starting Cleanup udev Database... machine # [ 4.021090] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 4.022290] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 4.023246] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 4.024422] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 4.025449] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 4.026426] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 4.034258] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 4.035324] systemd[1]: Finished Cleanup udev Database. machine # [ 4.036072] systemd[1]: Reached target Switch Root. machine # [ 4.037632] systemd[1]: Starting NixOS Activation... machine # [ 4.170613] initrd-nixos-activation-start[238]: booting system configuration /nix/store/y1qll7v7k0glicb17p8d6a0g4ms0382l-nixos-system-machine-test machine # [ 4.230800] initrd-nixos-activation-start[238]: running activation script... machine # [ 4.569345] initrd-nixos-activation-start[261]: setting up /etc... machine # [ 4.729348] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.732591] systemd[1]: Finished NixOS Activation. machine # [ 4.736560] systemd[1]: Starting Switch Root... machine # [ 4.771532] systemd[1]: Switching root. machine # [ 4.996030] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). machine # [ 5.107948] NET: Registered PF_VSOCK protocol family machine # [ 5.493991] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.503958] systemd[1]: Detected virtualization kvm. machine # [ 5.505762] systemd[1]: Detected architecture x86-64. machine # [ 5.507716] systemd[1]: Detected first boot. machine # [ 5.512202] systemd[1]: Initializing machine ID from random generator. machine # [ 5.668063] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.770995] systemd[1]: Applying preset policy. machine # [ 5.984243] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.288351] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.289754] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.292054] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.294428] systemd[1]: Created slice Slice /system/getty. machine # [ 6.295942] systemd[1]: Created slice User and Session Slice. machine # [ 6.296856] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.298185] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.299407] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.300144] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.300954] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.301804] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.302633] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.303524] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.304457] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.305409] systemd[1]: Reached target Path Units. machine # [ 6.306131] systemd[1]: Reached target Remote File Systems. machine # [ 6.306963] systemd[1]: Reached target Slice Units. machine # [ 6.307751] systemd[1]: Reached target Swaps. machine # [ 6.310113] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.313072] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.315115] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.317298] systemd[1]: Listening on Factory Reset Management. machine # [ 6.318236] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.321555] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.323038] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.325531] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.326828] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.328084] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.329537] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.334552] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.335650] systemd[1]: Listening on udev Control Socket. machine # [ 6.336615] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.339307] systemd[1]: Mounting Huge Pages File System... machine # [ 6.341598] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.344041] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.353664] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.359585] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.365231] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.366204] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.367649] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.369267] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.372478] systemd[1]: Mounting FUSE Control File System... machine # [ 6.373461] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.379127] systemd[1]: Starting Journal Service... machine # [ 6.386689] systemd[1]: Starting Load Kernel Modules... machine # [ 6.394390] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.401386] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.402429] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.405160] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.407636] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.408676] systemd[1]: Mounted Huge Pages File System. machine # [ 6.409646] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.410772] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.411722] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.413280] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.414381] systemd[1]: Mounted FUSE Control File System. machine # [ 6.416789] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.421877] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.423351] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.425876] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.433721] loop: module loaded machine # [ 6.436452] systemd[1]: Finished Load Kernel Modules. machine # [ 6.439057] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.442124] systemd-journald[333]: Collecting audit messages is enabled. machine # [ 6.302275] systemd[1]: Queue[ 6.456145] systemd[1]: Started Journal Service. machine # d start job for default target Multi-User System. machine # [ 6.458014] EXT4-fs (vda): re-mounted 17c82819-ad08-4e80-a1e6-4278cbe0eb58. machine # [ 6.305108] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.307708] systemd-modules-load[334]: Using 2 probe threads machine # [ 6.308931] systemd-modules-load[334]: Inserted module 'loop' machine # [ 6.310119] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.312288] systemd-oomd[335]: No swap; memory pressure usage will be degraded machine # [ 6.314350] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.316491] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.318182] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.320148] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.321191] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.322888] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.323767] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.337693] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.340570] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.350795] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.509579] systemd-journald[333]: Received client request to flush runtime journal. machine # [ 6.416142] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.417984] systemd[1]: Reached target First Boot Complete. machine # [ 6.419518] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.421093] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.422731] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.424507] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.427041] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.429076] systemd-udevd[364]: Using default interface naming scheme 'v261'. machine # [ 6.461756] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 6.538105] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.556628] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 6.567565] (udev-worker)[387]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.570654] (udev-worker)[390]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 6.573111] (udev-worker)[390]: Network interface NamePolicy= disabled on kernel command line. machine # [ 6.574386] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 6.598327] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 6.599543] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.600990] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.603329] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.604929] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.606862] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.783662] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 6.787778] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 6.796142] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 6.800990] Console: switching to colour dummy device 80x25 machine # [ 6.803404] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 6.803833] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 6.805183] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 6.806094] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 6.807299] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input4 machine # [ 6.811411] ACPI: button: Power Button [PWRF] machine # [ 6.825058] Console: switching to colour frame buffer device 160x50 machine # [ 6.826295] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 6.837814] mousedev: PS/2 mouse device common for all mice machine # [ 6.866456] rtc_cmos PNP0B00:00: RTC can wake from S4 machine # [ 6.871918] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 6.872120] rtc_cmos PNP0B00:00: registered as rtc0 machine # [ 6.873096] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 6.874004] rtc_cmos PNP0B00:00: setting system clock to 2026-09-21T14:43:36 UTC (1790001816) machine # [ 6.874534] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 6.880031] systemd-journald[333]: Time jumped backwards, rotating. machine # [ 6.906333] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 6.907139] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 6.913427] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 6.782346] systemd[1]: Starting Virtual Console Setup... machine # [ 6.796827] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.954517] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 6.806085] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.961872] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 6.970276] ppdev: user-space parallel port driver machine # [ 6.822170] systemd[1]: Starting Virtual Console Setup... machine # [ 6.827772] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 6.829837] systemd[1]: Stopped Virtual Console Setup. machine # [ 6.987967] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 6.846186] systemd[1]: Starting Virtual Console Setup... machine # [ 7.035840] kvm_amd: TSC scaling supported machine # [ 7.036434] kvm_amd: Nested Virtualization enabled machine # [ 7.036974] kvm_amd: Nested Paging enabled machine # [ 7.037393] kvm_amd: LBR virtualization supported machine # [ 7.037970] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.038468] kvm_amd: Virtual GIF supported machine # [ 7.038869] kvm_amd: Virtual NMI enabled machine # [ 7.127688] EDAC MC: Ver: 3.0.0 machine # [ 7.002494] systemd-vconsole-setup[410]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.004880] systemd[1]: Finished Virtual Console Setup. machine # [ 7.139858] systemd[1]: Mounting /run/wrappers... machine # [ 7.172254] systemd[1]: Mounted /run/wrappers. machine # [ 7.175070] systemd[1]: Reached target Local File Systems. machine # [ 7.179336] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.184465] systemd[1]: Starting register-nix-paths.service... machine # [ 7.189344] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.191471] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.202812] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.206819] systemd[1]: Starting Create System Files and Directories... machine # [ 7.262351] systemd[1]: Finished Create System Files and Directories. machine # [ 7.265559] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.268127] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.273301] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.295362] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.325385] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.329126] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.332848] systemd[1]: Starting Update is Completed... machine # [ 7.356037] systemd[1]: Finished Update is Completed. machine # [ 7.464834] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.466043] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 7.710076] systemd[1]: Finished register-nix-paths.service. machine # [ 7.711386] systemd[1]: Reached target System Initialization. machine # [ 7.712426] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 7.713722] systemd[1]: Started niks3 garbage collection timer. machine # [ 7.714856] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 7.716079] systemd[1]: Reached target Timer Units. machine # [ 7.717114] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 7.723930] systemd[1]: Listening on niks3 server socket. machine # [ 7.725077] systemd[1]: Listening on Nix Daemon Socket. machine # [ 7.726158] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 7.727610] systemd[1]: Reached target Socket Units. machine # [ 7.728631] systemd[1]: Reached target Basic System. machine # [ 7.729733] systemd[1]: Started backdoor.service. machine # [ 7.731843] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 7.735537] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.744542] systemd[1]: Starting Post-Boot Actions... machine # [ 7.746744] systemd[1]: Started Reset console on configuration changes. machine # [ 7.750744] systemd[1]: Starting resolvconf update... machine # [ 7.754439] systemd[1]: Started rustfs.service. machine # [ 7.761081] systemd[1]: Starting rustfs-bucket.service... machine # [ 7.768680] systemd[1]: Starting D-Bus System Message Bus... machine # [ 7.789036] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 7.823258] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.823621] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.824064] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.825861] nsncd[493]: Sep 21 14:43:37.605 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.827311] systemd[1]: Starting User Login Management... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine # [ 7.847039] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: (connecting took 8.49 seconds) machine: (finished: waiting for the VM to finish booting, in 8.75 seconds) machine # [ 7.875754] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 7.882405] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' machine # [ 7.882831] dbus-broker-launch[501]: Invalid user-name in /nix/store/d3mrkr0v9x5sgbb0rb2pnsl0mysb1m4x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 7.893049] systemd-logind[524]: New seat seat0. machine # [ 7.898179] systemd-logind[524]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 7.898567] systemd-logind[524]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 7.901482] systemd-logind[524]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 7.902781] systemd[1]: Started User Login Management. machine # [ 7.903934] systemd[1]: Starting linger-users.service... machine # [ 7.904706] systemd[1]: Started D-Bus System Message Bus. machine # [ 7.916898] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 7.917249] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 7.917729] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 7.918262] systemd[1]: Stopping User and Group Name Lookups... machine # [ 7.918828] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 7.923145] dbus-broker-launch[501]: Ready machine # [ 7.926097] systemd[1]: nscd.service: Deactivated successfully. machine # [ 7.926431] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 7.930867] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 7.945317] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 7.946050] systemd[1]: Finished linger-users.service. machine # [ 7.963101] nsncd[596]: Sep 21 14:43:37.741 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 7.963520] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 7.964129] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 7.964661] systemd[1]: Reached target User and Group Name Lookups. machine # [ 7.986031] systemd[1]: Finished resolvconf update. machine # [ 7.986430] systemd[1]: Reached target Preparation for Network. machine # [ 7.988936] systemd[1]: Starting DHCP Client... machine # [ 7.991127] systemd[1]: Starting Address configuration of eth1... machine # [ 7.992506] systemd[1]: Starting Extra networking commands.... machine # [ 8.044902] network-addresses-eth1-start[628]: adding address 192.168.1.1/24... done machine # [ 8.054928] network-addresses-eth1-start[628]: adding address 2001:db8:1::1/64... done machine # [ 8.066160] systemd[1]: Finished Address configuration of eth1. machine # [ 8.088528] dhcpcd[639]: dhcpcd-10.3.2 starting machine # [ 8.095902] dhcpcd[698]: dev: loaded udev machine # [ 8.102654] systemd[1]: Finished Extra networking commands.. machine # [ 8.104153] systemd[1]: Reached target Network. machine # [ 8.108067] systemd[1]: Starting PostgreSQL Server... machine # [ 8.262341] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.265508] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.112688] systemd[1]: Starting Permit User Sessions... machine # [ 8.132506] systemd[1]: Finished Permit User Sessions. machine # [ 8.134146] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.136459] systemd[1]: Started Getty on tty1. machine # [ 8.137596] systemd[1]: Reached target Login Prompts. machine # [ 8.358393] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 8.375757] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 8.377035] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 8.378688] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 8.379844] cfg80211: failed to load regulatory.db machine # [ 8.229868] postgresql-pre-start[713]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.230240] postgresql-pre-start[713]: This user must also own the server process. machine # [ 8.234389] postgresql-pre-start[713]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.235858] postgresql-pre-start[713]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.237172] postgresql-pre-start[713]: The default text search configuration will be set to "english". machine # [ 8.238421] postgresql-pre-start[713]: Data page checksums are enabled. machine # [ 8.239342] postgresql-pre-start[713]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.240616] postgresql-pre-start[713]: creating subdirectories ... ok machine # [ 8.241611] postgresql-pre-start[713]: selecting dynamic shared memory implementation ... posix machine # [ 8.416015] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.263652] dhcpcd[698]: eth0: waiting for carrier machine # [ 8.292449] postgresql-pre-start[713]: selecting default "max_connections" ... 100 machine # [ 8.340154] postgresql-pre-start[713]: selecting default "shared_buffers" ... 128MB machine # [ 9.064465] dhcpcd[698]: eth0: carrier acquired machine # [ 9.067918] postgresql-pre-start[713]: selecting default time zone ... UTC machine # [ 9.069671] postgresql-pre-start[713]: creating configuration files ... ok machine # [ 9.076091] dhcpcd[698]: DUID 00:01:00:01:32:43:ff:1a:52:54:00:12:34:56 machine # [ 9.077303] dhcpcd[698]: eth0: IAID 00:12:34:56 machine # [ 9.078438] dhcpcd[698]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 9.248190] postgresql-pre-start[713]: running bootstrap script ... ok machine # [ 9.719272] postgresql-pre-start[713]: performing post-bootstrap initialization ... ok machine # [ 9.881619] postgresql-pre-start[713]: syncing data to disk ... ok machine # [ 9.882401] postgresql-pre-start[713]: initdb: warning: enabling "trust" authentication for local connections machine # [ 9.883006] postgresql-pre-start[713]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 9.883859] postgresql-pre-start[713]: Success. You can now start the database server using: machine # [ 9.884700] postgresql-pre-start[713]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 10.038960] postgres[749]: [749] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 10.043243] postgres[749]: [749] LOG: listening on IPv6 address "::1", port 5432 machine # [ 10.043954] postgres[749]: [749] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 10.045776] postgres[749]: [749] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 10.058601] postgres[762]: [762] LOG: database system was shut down at 2026-09-21 14:43:39 GMT machine # [ 10.062244] dhcpcd[698]: eth0: soliciting a DHCP lease machine # [ 10.066612] postgres[749]: [749] LOG: database system is ready to accept connections machine # [ 10.226090] NET: Registered PF_PACKET protocol family machine # [ 10.074961] systemd[1]: Started PostgreSQL Server. machine # [ 10.078207] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 10.083870] dhcpcd[698]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 10.088247] dhcpcd[698]: eth0: probing address 10.0.2.15/24 machine # [ 10.286501] postgresql-setup-start[780]: CREATE DATABASE machine # [ 10.322160] postgresql-setup-start[785]: CREATE ROLE machine # [ 10.341657] postgresql-setup-start[787]: ALTER DATABASE machine # [ 10.347041] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 10.348212] systemd[1]: Reached target PostgreSQL. machine # [ 11.701317] dhcpcd[698]: eth0: soliciting an IPv6 router machine # [ 11.701680] dhcpcd[698]: eth0: Router Advertisement from fe80::2 machine # [ 11.703679] dhcpcd[698]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 11.706702] dhcpcd[698]: eth0: adding route to fec0::/64 machine # [ 11.708339] dhcpcd[698]: eth0: adding default route via fe80::2 machine # [ 15.230668] dhcpcd[698]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 15.231476] dhcpcd[698]: eth0: adding route to 10.0.2.0/24 machine # [ 15.233184] dhcpcd[698]: eth0: adding default route via 10.0.2.2 machine # [ 15.379384] systemd[1]: Started DHCP Client. machine # [ 15.380800] systemd[1]: Reached target Network is Online. machine # [ 15.384180] systemd[1]: Starting k3s service... machine # [ 15.478213] k3s[887]: time="2026-09-21T14:43:45Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 15.478711] k3s[887]: time="2026-09-21T14:43:45Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/05fb32d1d5d79ab4bf8f805d07e4a7dfb491001fd5137b587aa471efd4746099" machine # [ 17.136244] rustfs-bucket-start[902]: mb s3://farm machine # [ 17.140105] systemd[1]: Finished rustfs-bucket.service. machine # [ 17.600063] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 17.612584] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 17.613151] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 17.613704] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 17.626558] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Database tables and indexes are up to date" machine # [ 17.626665] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 17.633246] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Startup VACUUM completed successfully" machine # [ 17.636788] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Kine available at unix://kine.sock" machine # [ 17.638082] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 17.644661] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 17.648322] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:47.425230998 +0000 UTC notAfter=2036-09-18 13:43:47.425230998 +0000 UTC" machine # [ 17.649187] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.650198] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.650757] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.651960] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.653206] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.654224] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.655138] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790001827: notBefore=2026-09-21 13:43:47.431260256 +0000 UTC notAfter=2036-09-18 13:43:47.431260256 +0000 UTC" machine # [ 17.656077] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.656745] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.657609] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.658504] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790001827: notBefore=2026-09-21 13:43:47.434318466 +0000 UTC notAfter=2036-09-18 13:43:47.434318466 +0000 UTC" machine # [ 17.659153] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.659826] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790001827: notBefore=2026-09-21 13:43:47.435035317 +0000 UTC notAfter=2036-09-18 13:43:47.435035317 +0000 UTC" machine # [ 17.660665] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.661515] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790001827: notBefore=2026-09-21 13:43:47.435634835 +0000 UTC notAfter=2036-09-18 13:43:47.435634835 +0000 UTC" machine # [ 17.662222] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.663086] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.694518] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790001827: notBefore=2026-09-21 13:43:47 +0000 UTC notAfter=2027-09-21 13:43:47 +0000 UTC" machine # [ 17.697770] k3s[887]: time="2026-09-21T14:43:47Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 17.703707] k3s[887]: time="2026-09-21T14:43:47Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__7390_e495_b878_abdf-41ebb5:fec0::7390:e495:b878:abdf listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=13EBA4A886F3D9118EB8CBD49C860FC01C56503F]" machine # [ 18.703390] k3s[887]: time="2026-09-21T14:43:48Z" level=info msg="Password verified locally for node machine" machine # [ 18.704095] k3s[887]: time="2026-09-21T14:43:48Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790001827: notBefore=2026-09-21 13:43:48 +0000 UTC notAfter=2027-09-21 13:43:48 +0000 UTC" machine # [ 18.967481] k3s[887]: time="2026-09-21T14:43:48Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:48 +0000 UTC notAfter=2027-09-21 13:43:48 +0000 UTC" machine # [ 19.072736] k3s[887]: time="2026-09-21T14:43:48Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:48 +0000 UTC notAfter=2027-09-21 13:43:48 +0000 UTC" machine # [ 19.180830] k3s[887]: time="2026-09-21T14:43:48Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790001827: notBefore=2026-09-21 13:43:48 +0000 UTC notAfter=2027-09-21 13:43:48 +0000 UTC" machine # [ 19.259691] k3s[887]: time="2026-09-21T14:43:49Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:39082: runtime core not ready" machine # [ 19.364478] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Module overlay was already loaded" machine # [ 19.579953] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 19.584912] Bridge firewalling registered machine # [ 19.441614] k3s[887]: time="2026-09-21T14:43:49Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 19.451859] k3s[887]: time="2026-09-21T14:43:49Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 19.459549] k3s[887]: time="2026-09-21T14:43:49Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 19.551230] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Set sysctl 'net/ipv4/conf/default/forwarding' to 1" machine # [ 19.551867] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 19.553152] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 19.554268] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 19.555204] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 19.566673] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.567403] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 19.569155] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 19.572579] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 19.573125] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Handling backend connection request [machine]" machine # [ 19.573588] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.574053] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.574559] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Connection to etcd is ready" machine # [ 19.575038] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="ETCD server is now running" machine # [ 19.575512] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 19.583080] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 19.590832] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 19.591681] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 19.607950] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 19.608508] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 19.609109] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 19.609568] k3s[887]: I0921 14:43:49.388617 887 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 19.610069] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 19.610529] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 19.611131] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 19.611685] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 19.612347] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 19.613191] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Run: k3s kubectl" machine # [ 19.613920] k3s[887]: I0921 14:43:49.390226 887 server.go:158] Version: v1.35.8+k3s1 machine # [ 19.614621] k3s[887]: I0921 14:43:49.390251 887 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 19.692589] k3s[887]: time="2026-09-21T14:43:49Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:39154: runtime core not ready" machine # [ 19.716394] k3s[887]: I0921 14:43:49.495949 887 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 19.720470] k3s[887]: I0921 14:43:49.500044 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 19.720753] k3s[887]: I0921 14:43:49.500504 887 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 19.721192] k3s[887]: I0921 14:43:49.500521 887 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 19.721663] k3s[887]: I0921 14:43:49.500794 887 instance.go:240] Using reconciler: lease machine # [ 19.733903] k3s[887]: I0921 14:43:49.513732 887 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 19.734227] k3s[887]: W0921 14:43:49.513768 887 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 19.736055] k3s[887]: I0921 14:43:49.515887 887 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 19.766829] k3s[887]: I0921 14:43:49.546663 887 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 19.767236] k3s[887]: I0921 14:43:49.547098 887 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 19.790239] k3s[887]: I0921 14:43:49.570073 887 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 19.831688] k3s[887]: I0921 14:43:49.611437 887 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 19.831844] k3s[887]: W0921 14:43:49.611473 887 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 19.832342] k3s[887]: W0921 14:43:49.611485 887 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 19.832873] k3s[887]: I0921 14:43:49.611808 887 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 19.833501] k3s[887]: W0921 14:43:49.611823 887 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.833978] k3s[887]: I0921 14:43:49.613049 887 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 19.834625] k3s[887]: I0921 14:43:49.613814 887 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 19.835110] k3s[887]: W0921 14:43:49.613832 887 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 19.835613] k3s[887]: W0921 14:43:49.613844 887 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 19.836116] k3s[887]: I0921 14:43:49.615726 887 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 19.836601] k3s[887]: W0921 14:43:49.615746 887 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 19.837143] k3s[887]: I0921 14:43:49.616698 887 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 19.837667] k3s[887]: W0921 14:43:49.616716 887 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 19.838161] k3s[887]: W0921 14:43:49.616727 887 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 19.838712] k3s[887]: I0921 14:43:49.617133 887 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 19.839149] k3s[887]: W0921 14:43:49.617149 887 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 19.839642] k3s[887]: W0921 14:43:49.617160 887 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 19.840119] k3s[887]: I0921 14:43:49.617492 887 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 19.840608] k3s[887]: W0921 14:43:49.617507 887 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 19.841121] k3s[887]: I0921 14:43:49.618844 887 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 19.841625] k3s[887]: W0921 14:43:49.618862 887 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 19.842139] k3s[887]: I0921 14:43:49.619929 887 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 19.842638] k3s[887]: W0921 14:43:49.619946 887 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 19.843114] k3s[887]: W0921 14:43:49.619957 887 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 19.843640] k3s[887]: I0921 14:43:49.620839 887 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 19.844142] k3s[887]: W0921 14:43:49.620944 887 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 19.844801] k3s[887]: I0921 14:43:49.623380 887 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 19.845475] k3s[887]: W0921 14:43:49.623399 887 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 19.845940] k3s[887]: W0921 14:43:49.623410 887 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 19.846609] k3s[887]: I0921 14:43:49.623665 887 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 19.847127] k3s[887]: W0921 14:43:49.623678 887 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 19.847641] k3s[887]: W0921 14:43:49.623688 887 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 19.848142] k3s[887]: I0921 14:43:49.626286 887 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 19.848638] k3s[887]: W0921 14:43:49.626308 887 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 19.849140] k3s[887]: W0921 14:43:49.626319 887 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 19.849650] k3s[887]: I0921 14:43:49.627458 887 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 19.850138] k3s[887]: W0921 14:43:49.627475 887 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 19.850621] k3s[887]: W0921 14:43:49.627487 887 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 19.851136] k3s[887]: W0921 14:43:49.627497 887 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 19.851629] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 19.852112] k3s[887]: I0921 14:43:49.630223 887 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 19.852596] k3s[887]: W0921 14:43:49.630242 887 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 19.853982] k3s[887]: W0921 14:43:49.630253 887 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 19.855467] k3s[887]: I0921 14:43:49.632194 887 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 19.856721] k3s[887]: W0921 14:43:49.632214 887 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 19.858705] k3s[887]: W0921 14:43:49.632225 887 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 19.860025] k3s[887]: I0921 14:43:49.633026 887 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 19.861703] k3s[887]: W0921 14:43:49.633043 887 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 19.863088] k3s[887]: I0921 14:43:49.636451 887 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 19.864622] k3s[887]: W0921 14:43:49.636471 887 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 19.866107] k3s[887]: W0921 14:43:49.636482 887 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 19.867612] k3s[887]: W0921 14:43:49.636492 887 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 19.869060] k3s[887]: I0921 14:43:49.640500 887 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 19.870578] k3s[887]: W0921 14:43:49.640518 887 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 20.128230] k3s[887]: I0921 14:43:49.907945 887 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.128423] k3s[887]: I0921 14:43:49.907963 887 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.128891] k3s[887]: I0921 14:43:49.908260 887 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 20.129553] k3s[887]: I0921 14:43:49.908334 887 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 20.130090] k3s[887]: I0921 14:43:49.908483 887 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 20.130558] k3s[887]: I0921 14:43:49.908491 887 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 20.134079] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 20.134706] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.135220] k3s[887]: I0921 14:43:49.909329 887 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 20.135652] k3s[887]: I0921 14:43:49.909345 887 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 20.136133] k3s[887]: I0921 14:43:49.909433 887 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 20.136628] k3s[887]: I0921 14:43:49.909443 887 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 20.137149] k3s[887]: I0921 14:43:49.909458 887 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 20.137344] k3s[887]: I0921 14:43:49.909521 887 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 20.137785] k3s[887]: I0921 14:43:49.909580 887 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 20.138464] k3s[887]: I0921 14:43:49.909590 887 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 20.138920] k3s[887]: I0921 14:43:49.909634 887 aggregator.go:185] waiting for initial CRD sync... machine # [ 20.139584] k3s[887]: I0921 14:43:49.909656 887 controller.go:78] Starting OpenAPI AggregationController machine # [ 20.143083] k3s[887]: I0921 14:43:49.909689 887 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 20.143749] k3s[887]: I0921 14:43:49.909810 887 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 20.144423] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.144878] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 20.145531] k3s[887]: time="2026-09-21T14:43:49Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 20.145976] k3s[887]: I0921 14:43:49.910008 887 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 20.146329] k3s[887]: I0921 14:43:49.910113 887 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 20.146849] k3s[887]: I0921 14:43:49.910545 887 repairip.go:210] Starting ipallocator-repair-controller machine # [ 20.147529] k3s[887]: I0921 14:43:49.910559 887 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 20.148016] k3s[887]: I0921 14:43:49.910940 887 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 20.148574] k3s[887]: I0921 14:43:49.911010 887 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 20.149032] k3s[887]: I0921 14:43:49.911343 887 controller.go:142] Starting OpenAPI controller machine # [ 20.149323] k3s[887]: I0921 14:43:49.911402 887 controller.go:90] Starting OpenAPI V3 controller machine # [ 20.149787] k3s[887]: I0921 14:43:49.911436 887 naming_controller.go:305] Starting NamingConditionController machine # [ 20.153079] k3s[887]: I0921 14:43:49.911498 887 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 20.153765] k3s[887]: I0921 14:43:49.911534 887 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 20.154501] k3s[887]: I0921 14:43:49.911572 887 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 20.154951] k3s[887]: I0921 14:43:49.911735 887 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 20.155632] k3s[887]: I0921 14:43:49.911752 887 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 20.156139] k3s[887]: I0921 14:43:49.911832 887 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 20.156616] k3s[887]: I0921 14:43:49.911844 887 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 20.216394] k3s[887]: I0921 14:43:49.996171 887 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 20.221360] k3s[887]: I0921 14:43:50.001193 887 shared_informer.go:377] "Caches are synced" machine # [ 20.221608] k3s[887]: I0921 14:43:50.001244 887 policy_source.go:248] refreshing policies machine # [ 20.229624] k3s[887]: time="2026-09-21T14:43:50Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.230231] k3s[887]: I0921 14:43:50.009510 887 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 20.230751] k3s[887]: I0921 14:43:50.009527 887 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 20.231419] k3s[887]: I0921 14:43:50.009581 887 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 20.231857] k3s[887]: I0921 14:43:50.009665 887 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 20.234290] k3s[887]: time="2026-09-21T14:43:50Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.234898] k3s[887]: time="2026-09-21T14:43:50Z" level=info msg="Caches are synced" logger=k3s machine # [ 20.235567] k3s[887]: I0921 14:43:50.011083 887 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 20.236042] k3s[887]: I0921 14:43:50.012705 887 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 20.236541] k3s[887]: I0921 14:43:50.012740 887 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 20.237028] k3s[887]: I0921 14:43:50.012896 887 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 20.237485] k3s[887]: I0921 14:43:50.012967 887 aggregator.go:187] initial CRD sync complete... machine # [ 20.237932] k3s[887]: I0921 14:43:50.012980 887 autoregister_controller.go:144] Starting autoregister controller machine # [ 20.238604] k3s[887]: I0921 14:43:50.012991 887 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 20.239075] k3s[887]: I0921 14:43:50.013003 887 cache.go:39] Caches are synced for autoregister controller machine # [ 20.252062] k3s[887]: I0921 14:43:50.028989 887 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 20.252355] k3s[887]: I0921 14:43:50.029020 887 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 20.252821] k3s[887]: I0921 14:43:50.030316 887 controller.go:667] quota admission added evaluator for: namespaces machine # [ 20.255043] k3s[887]: E0921 14:43:50.034860 887 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 20.261057] k3s[887]: I0921 14:43:50.039020 887 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.261336] k3s[887]: I0921 14:43:50.039373 887 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.267789] k3s[887]: I0921 14:43:50.047636 887 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 20.273491] k3s[887]: I0921 14:43:50.053301 887 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 20.303704] k3s[887]: I0921 14:43:50.083482 887 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 20.309084] k3s[887]: W0921 14:43:50.088718 887 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 20.311083] k3s[887]: I0921 14:43:50.090403 887 controller.go:667] quota admission added evaluator for: endpoints machine # [ 20.316103] k3s[887]: I0921 14:43:50.095465 887 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 20.322227] k3s[887]: E0921 14:43:50.102048 887 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 20.463373] k3s[887]: I0921 14:43:50.242899 887 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 20.614258] k3s[887]: time="2026-09-21T14:43:50Z" level=info msg="containerd is now running" machine # [ 20.626589] k3s[887]: time="2026-09-21T14:43:50Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 21.135209] k3s[887]: I0921 14:43:50.914552 887 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 21.140128] k3s[887]: I0921 14:43:50.919928 887 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 21.141351] k3s[887]: I0921 14:43:50.919953 887 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 21.572848] k3s[887]: time="2026-09-21T14:43:51Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 22.210719] k3s[887]: I0921 14:43:51.990198 887 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 22.251539] k3s[887]: I0921 14:43:52.031355 887 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 23.571907] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 23.572099] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Waiting for untainted node" machine # [ 23.572565] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Kube API server is now running" machine # [ 23.573038] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="k3s is up and running" machine # [ 23.576714] systemd[1]: Started k3s service. machine # [ 23.577473] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 23.583517] systemd[1]: Starting niks3 server... machine # [ 23.588593] k3s[887]: I0921 14:43:53.367614 887 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 23.588941] k3s[887]: I0921 14:43:53.367644 887 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 23.591268] k3s[887]: I0921 14:43:53.371113 887 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 23.592241] k3s[887]: I0921 14:43:53.371469 887 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 23.592663] k3s[887]: I0921 14:43:53.371924 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.593184] k3s[887]: I0921 14:43:53.371970 887 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.593638] k3s[887]: I0921 14:43:53.371495 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 23.594890] k3s[887]: I0921 14:43:53.372001 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.595596] k3s[887]: I0921 14:43:53.371539 887 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 23.596211] k3s[887]: I0921 14:43:53.371516 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 23.596851] k3s[887]: I0921 14:43:53.372314 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.607503] k3s[887]: I0921 14:43:53.387307 887 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 23.611691] k3s[887]: I0921 14:43:53.391499 887 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 23.622226] k3s[887]: I0921 14:43:53.402059 887 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 23.622578] k3s[887]: I0921 14:43:53.402095 887 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 23.678341] k3s[887]: I0921 14:43:53.458155 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 23.678532] k3s[887]: I0921 14:43:53.458242 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 23.679026] k3s[887]: I0921 14:43:53.458268 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 23.685422] k3s[887]: I0921 14:43:53.465255 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 23.685879] k3s[887]: I0921 14:43:53.465307 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 23.690297] k3s[887]: I0921 14:43:53.470112 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 23.690795] k3s[887]: I0921 14:43:53.470153 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 23.691520] k3s[887]: I0921 14:43:53.470173 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 23.692055] k3s[887]: I0921 14:43:53.470198 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 23.699533] k3s[887]: I0921 14:43:53.470220 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 23.699960] k3s[887]: I0921 14:43:53.479435 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 23.700644] k3s[887]: I0921 14:43:53.471953 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 23.705197] k3s[887]: I0921 14:43:53.479464 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 23.705714] k3s[887]: I0921 14:43:53.485081 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 23.706279] k3s[887]: I0921 14:43:53.485121 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 23.712504] k3s[887]: I0921 14:43:53.492347 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 23.713056] k3s[887]: I0921 14:43:53.492383 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 23.713579] k3s[887]: I0921 14:43:53.492407 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 23.719417] k3s[887]: I0921 14:43:53.499267 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 23.719846] k3s[887]: I0921 14:43:53.499302 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 23.720945] k3s[887]: I0921 14:43:53.499338 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 23.726159] k3s[887]: I0921 14:43:53.506002 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 23.726807] k3s[887]: I0921 14:43:53.506043 887 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 23.727489] k3s[887]: I0921 14:43:53.506065 887 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 23.743443] k3s[887]: W0921 14:43:53.523238 887 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 23.745848] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 23.750762] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 23.761851] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 23.767461] k3s[887]: I0921 14:43:53.547301 887 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.772029] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 23.778631] k3s[887]: I0921 14:43:53.558454 887 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 23.787643] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 23.792233] k3s[887]: I0921 14:43:53.572076 887 shared_informer.go:377] "Caches are synced" machine # [ 23.793689] k3s[887]: I0921 14:43:53.573539 887 shared_informer.go:377] "Caches are synced" machine # [ 23.795742] k3s[887]: I0921 14:43:53.575094 887 shared_informer.go:377] "Caches are synced" machine # [ 23.800525] k3s[887]: I0921 14:43:53.580361 887 shared_informer.go:377] "Caches are synced" machine # [ 23.811554] k3s[887]: I0921 14:43:53.591335 887 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 23.816864] k3s[887]: I0921 14:43:53.596599 887 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine: (finished: waiting for unit k3s.service, in 24.74 seconds) machine: waiting for success: kubectl get ns farm machine # Error from server (NotFound): namespaces "farm" not found machine # [ 24.042421] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 24.048296] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 24.048610] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 24.055338] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 24.055631] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 24.058580] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 24.058847] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 24.060962] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 24.061759] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 24.063391] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 24.064167] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 24.065757] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 24.066872] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 24.070778] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 24.071540] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 24.080675] k3s[887]: time="2026-09-21T14:43:53Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 24.255408] k3s[887]: I0921 14:43:54.035207 887 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # [ 24.304331] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 24.306104] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.307842] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 24.309584] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 24.311414] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 24.313468] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 24.315074] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 24.316879] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 24.318767] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 24.320421] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 24.322168] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 24.343761] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 3.717754072s" machine # [ 24.346165] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 24.409864] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::7390:e495:b878:abdf 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 24.410088] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 24.577666] k3s[887]: I0921 14:43:54.356625 887 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 24.578460] k3s[887]: I0921 14:43:54.356661 887 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 24.694195] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__7390_e495_b878_abdf-41ebb5:fec0::7390:e495:b878:abdf listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=13EBA4A886F3D9118EB8CBD49C860FC01C56503F]" machine # [ 24.713983] k3s[887]: time="2026-09-21T14:43:54Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=235) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__7390_e495_b878_abdf-41ebb5:fec0::7390:e495:b878:abdf listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=13EBA4A886F3D9118EB8CBD49C860FC01C56503F]" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 25.357517] k3s[887]: I0921 14:43:55.137250 887 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 25.727778] k3s[887]: time="2026-09-21T14:43:55Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 25.728457] k3s[887]: time="2026-09-21T14:43:55Z" level=info msg="Creating deploy event broadcaster" machine # [ 25.733959] k3s[887]: I0921 14:43:55.513743 887 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 25.737629] k3s[887]: time="2026-09-21T14:43:55Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 25.739976] k3s[887]: time="2026-09-21T14:43:55Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 25.746288] k3s[887]: time="2026-09-21T14:43:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 25.746892] k3s[887]: time="2026-09-21T14:43:55Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 25.747852] k3s[887]: time="2026-09-21T14:43:55Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 26.110928] k3s[887]: time="2026-09-21T14:43:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 26.120931] k3s[887]: time="2026-09-21T14:43:55Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine: (finished: waiting for success: kubectl get ns farm, in 2.51 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key machine # [ 26.482133] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 26.485828] k3s[887]: I0921 14:43:56.265638 887 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb.key, in 0.14 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key machine # [ 26.493160] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/worker.key, in 0.16 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine # [ 26.675237] k3s[887]: I0921 14:43:56.455033 887 serving.go:392] Generated self-signed cert in-memory machine # [ 26.739977] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 26.745203] k3s[887]: I0921 14:43:56.525039 887 serving.go:392] Generated self-signed cert in-memory machine # [ 26.754457] k3s[887]: I0921 14:43:56.534228 887 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.16 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 26.853305] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 26.856228] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 26.858105] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 26.858422] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 26.858898] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 26.859785] k3s[887]: I0921 14:43:56.637558 887 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 26.862988] k3s[887]: I0921 14:43:56.640606 887 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.863521] k3s[887]: I0921 14:43:56.640627 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.864064] k3s[887]: I0921 14:43:56.640664 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.864637] k3s[887]: I0921 14:43:56.640681 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.865199] k3s[887]: I0921 14:43:56.640707 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.865696] k3s[887]: I0921 14:43:56.640726 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.866418] k3s[887]: I0921 14:43:56.643145 887 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 26.866835] k3s[887]: I0921 14:43:56.643214 887 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.867493] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 26.868049] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 26.868224] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 26.906092] k3s[887]: I0921 14:43:56.685662 887 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 26.906464] k3s[887]: I0921 14:43:56.685690 887 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 26.906880] k3s[887]: I0921 14:43:56.685704 887 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 26.961950] k3s[887]: I0921 14:43:56.741559 887 shared_informer.go:377] "Caches are synced" machine # [ 26.963451] k3s[887]: I0921 14:43:56.741656 887 shared_informer.go:377] "Caches are synced" machine # [ 26.964826] k3s[887]: I0921 14:43:56.741775 887 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 27.061191] k3s[887]: I0921 14:43:56.840857 887 controller.go:667] quota admission added evaluator for: deployments.apps machine # [ 27.213061] k3s[887]: I0921 14:43:56.992787 887 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 27.215088] k3s[887]: time="2026-09-21T14:43:56Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 27.264698] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 27.268666] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 27.272446] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 27.277765] k3s[887]: I0921 14:43:57.057596 887 controllermanager.go:329] Started "cloud-node-controller" machine # [ 27.278133] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 27.278623] k3s[887]: I0921 14:43:57.057811 887 node_controller.go:176] Sending events to api server. machine # [ 27.279222] k3s[887]: I0921 14:43:57.057900 887 node_controller.go:185] Waiting for informer caches to sync machine # [ 27.283254] k3s[887]: I0921 14:43:57.063089 887 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 27.283809] k3s[887]: I0921 14:43:57.063188 887 node_lifecycle_controller.go:112] Sending events to api server machine # [ 27.286639] k3s[887]: I0921 14:43:57.066494 887 controllermanager.go:329] Started "service-lb-controller" machine # [ 27.287414] k3s[887]: W0921 14:43:57.066513 887 controllermanager.go:306] "node-route-controller" is disabled machine # [ 27.287937] k3s[887]: I0921 14:43:57.066710 887 controller.go:235] Starting service controller machine # [ 27.288680] k3s[887]: I0921 14:43:57.066741 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 27.356142] k3s[887]: I0921 14:43:57.135837 887 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 27.554669] k3s[887]: I0921 14:43:57.334470 887 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 27.587303] k3s[887]: I0921 14:43:57.367076 887 shared_informer.go:377] "Caches are synced" machine # [ 27.740309] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 27.855792] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 27.864834] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 28.008948] k3s[887]: I0921 14:43:57.788688 887 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 28.013486] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 28.024636] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 28.158092] k3s[887]: I0921 14:43:57.937399 887 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 28.158654] k3s[887]: I0921 14:43:57.937432 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.161135] k3s[887]: I0921 14:43:57.940839 887 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 28.161432] k3s[887]: I0921 14:43:57.940865 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.161903] k3s[887]: I0921 14:43:57.940865 887 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 28.163109] k3s[887]: I0921 14:43:57.940892 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.163601] k3s[887]: I0921 14:43:57.940997 887 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 28.167658] k3s[887]: I0921 14:43:57.941011 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.167978] k3s[887]: I0921 14:43:57.941050 887 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 28.168596] k3s[887]: I0921 14:43:57.941063 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.169112] k3s[887]: I0921 14:43:57.941141 887 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 28.169620] k3s[887]: I0921 14:43:57.941156 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.171191] k3s[887]: I0921 14:43:57.941184 887 namespace_controller.go:202] "Starting namespace controller" machine # [ 28.171915] k3s[887]: I0921 14:43:57.941197 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.172550] k3s[887]: I0921 14:43:57.941228 887 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 28.173066] k3s[887]: I0921 14:43:57.941240 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.173569] k3s[887]: I0921 14:43:57.941280 887 horizontal.go:204] "Starting HPA controller" machine # [ 28.174125] k3s[887]: I0921 14:43:57.941292 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.175157] k3s[887]: I0921 14:43:57.941351 887 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 28.175950] k3s[887]: I0921 14:43:57.941364 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.176859] k3s[887]: I0921 14:43:57.941393 887 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 28.177753] k3s[887]: I0921 14:43:57.941405 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.178644] k3s[887]: I0921 14:43:57.941561 887 disruption.go:458] "Sending events to api server." machine # [ 28.179652] k3s[887]: I0921 14:43:57.941600 887 disruption.go:465] "Starting disruption controller" machine # [ 28.180636] k3s[887]: I0921 14:43:57.941610 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.181650] k3s[887]: I0921 14:43:57.941675 887 stateful_set.go:180] "Starting stateful set controller" machine # [ 28.182724] k3s[887]: I0921 14:43:57.941688 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.183709] k3s[887]: I0921 14:43:57.941741 887 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 28.184570] k3s[887]: I0921 14:43:57.941754 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.185543] k3s[887]: I0921 14:43:57.941782 887 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 28.186542] k3s[887]: I0921 14:43:57.941829 887 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 28.187518] k3s[887]: I0921 14:43:57.941843 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.188540] k3s[887]: I0921 14:43:57.941887 887 controller.go:174] "Starting ephemeral volume controller" machine # [ 28.189519] k3s[887]: I0921 14:43:57.941899 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.190493] k3s[887]: I0921 14:43:57.942001 887 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 28.191501] k3s[887]: I0921 14:43:57.942013 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.192502] k3s[887]: I0921 14:43:57.942039 887 controller.go:423] "Starting resource claim controller" machine # [ 28.193516] k3s[887]: I0921 14:43:57.942078 887 job_controller.go:254] "Starting job controller" machine # [ 28.194512] k3s[887]: I0921 14:43:57.942090 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.195502] k3s[887]: I0921 14:43:57.942092 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.196510] k3s[887]: I0921 14:43:57.942132 887 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 28.197473] k3s[887]: I0921 14:43:57.942147 887 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 28.198476] k3s[887]: I0921 14:43:57.942163 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.199430] k3s[887]: I0921 14:43:57.942146 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.200383] k3s[887]: I0921 14:43:57.942199 887 ttl_controller.go:127] "Starting TTL controller" machine # [ 28.201218] k3s[887]: I0921 14:43:57.942210 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.201979] k3s[887]: I0921 14:43:57.942209 887 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 28.202804] k3s[887]: I0921 14:43:57.942222 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.203604] k3s[887]: I0921 14:43:57.942330 887 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 28.204594] k3s[887]: I0921 14:43:57.942359 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.205557] k3s[887]: I0921 14:43:57.942333 887 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 28.206494] k3s[887]: I0921 14:43:57.942381 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.207463] k3s[887]: I0921 14:43:57.942407 887 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 28.208225] k3s[887]: I0921 14:43:57.942419 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.209073] k3s[887]: I0921 14:43:57.942455 887 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 28.209880] k3s[887]: I0921 14:43:57.942467 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.210676] k3s[887]: I0921 14:43:57.942483 887 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 28.211642] k3s[887]: I0921 14:43:57.942497 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.212482] k3s[887]: I0921 14:43:57.942498 887 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 28.212959] k3s[887]: I0921 14:43:57.942510 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.213808] k3s[887]: I0921 14:43:57.942543 887 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.214476] k3s[887]: I0921 14:43:57.942666 887 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 28.214957] k3s[887]: I0921 14:43:57.942688 887 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 28.215667] k3s[887]: I0921 14:43:57.942748 887 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.216193] k3s[887]: I0921 14:43:57.942804 887 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 28.216691] k3s[887]: I0921 14:43:57.944017 887 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 28.243551] k3s[887]: I0921 14:43:57.944070 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.243993] k3s[887]: I0921 14:43:57.944112 887 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 28.244316] k3s[887]: I0921 14:43:57.944125 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.244839] k3s[887]: I0921 14:43:57.944193 887 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 28.245491] k3s[887]: I0921 14:43:57.944271 887 taint_eviction.go:288] "Sending events to API server" machine # [ 28.245942] k3s[887]: I0921 14:43:57.944281 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.246632] k3s[887]: I0921 14:43:57.947202 887 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 28.247143] k3s[887]: I0921 14:43:57.947226 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.247630] k3s[887]: I0921 14:43:57.947291 887 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 28.248159] k3s[887]: I0921 14:43:57.947303 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.248632] k3s[887]: I0921 14:43:57.950307 887 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 28.249142] k3s[887]: I0921 14:43:57.950325 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.249641] k3s[887]: I0921 14:43:57.963301 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="addons.k3s.cattle.io" machine # [ 28.250118] k3s[887]: I0921 14:43:57.963345 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmcharts.helm.cattle.io" machine # [ 28.250625] k3s[887]: I0921 14:43:57.963372 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmchartconfigs.helm.cattle.io" machine # [ 28.251204] k3s[887]: I0921 14:43:57.963398 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.251650] k3s[887]: time="2026-09-21T14:43:57Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 28.252200] k3s[887]: I0921 14:43:58.026868 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.252657] k3s[887]: I0921 14:43:58.027858 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.253165] k3s[887]: I0921 14:43:58.027951 887 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 28.253622] k3s[887]: I0921 14:43:58.027984 887 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 28.254136] k3s[887]: I0921 14:43:58.027997 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.254635] k3s[887]: I0921 14:43:58.028028 887 expand_controller.go:328] "Starting expand controller" machine # [ 28.255124] k3s[887]: I0921 14:43:58.028041 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.255652] k3s[887]: I0921 14:43:58.034325 887 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 28.256106] k3s[887]: I0921 14:43:58.034343 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.256636] k3s[887]: I0921 14:43:58.034383 887 gc_controller.go:98] "Starting GC controller" machine # [ 28.257156] k3s[887]: I0921 14:43:58.034395 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.257314] k3s[887]: I0921 14:43:58.034425 887 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 28.257780] k3s[887]: I0921 14:43:58.034443 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.258449] k3s[887]: I0921 14:43:58.034534 887 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 28.284487] k3s[887]: I0921 14:43:58.041251 887 shared_informer.go:377] "Caches are synced" machine # [ 28.287133] k3s[887]: I0921 14:43:58.066977 887 shared_informer.go:377] "Caches are synced" machine # [ 28.307559] k3s[887]: I0921 14:43:58.087379 887 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 28.309472] k3s[887]: I0921 14:43:58.089256 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.313987] k3s[887]: time="2026-09-21T14:43:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 28.332722] k3s[887]: time="2026-09-21T14:43:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 28.349153] k3s[887]: I0921 14:43:58.128206 887 shared_informer.go:377] "Caches are synced" machine # [ 28.350430] k3s[887]: I0921 14:43:58.128237 887 shared_informer.go:377] "Caches are synced" machine # [ 28.355464] k3s[887]: I0921 14:43:58.135294 887 shared_informer.go:377] "Caches are synced" machine # [ 28.358148] k3s[887]: I0921 14:43:58.137946 887 shared_informer.go:377] "Caches are synced" machine # [ 28.361675] k3s[887]: I0921 14:43:58.141210 887 shared_informer.go:377] "Caches are synced" machine # [ 28.362949] k3s[887]: I0921 14:43:58.141478 887 shared_informer.go:377] "Caches are synced" machine # [ 28.364195] k3s[887]: I0921 14:43:58.141736 887 shared_informer.go:377] "Caches are synced" machine # [ 28.365385] k3s[887]: I0921 14:43:58.141797 887 shared_informer.go:377] "Caches are synced" machine # [ 28.366570] k3s[887]: I0921 14:43:58.141890 887 shared_informer.go:377] "Caches are synced" machine # [ 28.367706] k3s[887]: I0921 14:43:58.142220 887 shared_informer.go:377] "Caches are synced" machine # [ 28.368843] k3s[887]: I0921 14:43:58.142307 887 shared_informer.go:377] "Caches are synced" machine # [ 28.370024] k3s[887]: I0921 14:43:58.142458 887 shared_informer.go:377] "Caches are synced" machine # [ 28.371162] k3s[887]: I0921 14:43:58.142508 887 shared_informer.go:377] "Caches are synced" machine # [ 28.372299] k3s[887]: I0921 14:43:58.142553 887 shared_informer.go:377] "Caches are synced" machine # [ 28.373547] k3s[887]: I0921 14:43:58.142598 887 shared_informer.go:377] "Caches are synced" machine # [ 28.373974] k3s[887]: I0921 14:43:58.147352 887 shared_informer.go:377] "Caches are synced" machine # [ 28.374561] k3s[887]: I0921 14:43:58.147727 887 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.375036] k3s[887]: I0921 14:43:58.151036 887 shared_informer.go:377] "Caches are synced" machine # [ 28.375482] k3s[887]: I0921 14:43:58.152426 887 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 28.447273] k3s[887]: I0921 14:43:58.226996 887 shared_informer.go:377] "Caches are synced" machine # [ 28.448606] k3s[887]: I0921 14:43:58.228458 887 shared_informer.go:377] "Caches are synced" machine # [ 28.455221] k3s[887]: I0921 14:43:58.235019 887 shared_informer.go:377] "Caches are synced" machine # [ 28.455441] k3s[887]: I0921 14:43:58.235038 887 shared_informer.go:377] "Caches are synced" machine # [ 28.462099] k3s[887]: I0921 14:43:58.241937 887 shared_informer.go:377] "Caches are synced" machine # [ 28.462590] k3s[887]: I0921 14:43:58.241991 887 shared_informer.go:377] "Caches are synced" machine # [ 28.463049] k3s[887]: I0921 14:43:58.241996 887 shared_informer.go:377] "Caches are synced" machine # [ 28.463557] k3s[887]: I0921 14:43:58.242043 887 range_allocator.go:177] "Sending events to api server" machine # [ 28.464136] k3s[887]: I0921 14:43:58.242048 887 shared_informer.go:377] "Caches are synced" machine # [ 28.464786] k3s[887]: I0921 14:43:58.242075 887 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 28.465506] k3s[887]: I0921 14:43:58.242086 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 28.466087] k3s[887]: I0921 14:43:58.242096 887 shared_informer.go:377] "Caches are synced" machine # [ 28.466645] k3s[887]: I0921 14:43:58.242201 887 shared_informer.go:377] "Caches are synced" machine # [ 28.467158] k3s[887]: I0921 14:43:58.242246 887 shared_informer.go:377] "Caches are synced" machine # [ 28.467684] k3s[887]: I0921 14:43:58.242412 887 shared_informer.go:377] "Caches are synced" machine # [ 28.468516] k3s[887]: I0921 14:43:58.242533 887 shared_informer.go:377] "Caches are synced" machine # [ 28.469044] k3s[887]: I0921 14:43:58.242571 887 shared_informer.go:377] "Caches are synced" machine # [ 28.469458] k3s[887]: I0921 14:43:58.242601 887 shared_informer.go:377] "Caches are synced" machine # [ 28.469988] k3s[887]: I0921 14:43:58.242641 887 shared_informer.go:377] "Caches are synced" machine # [ 28.470764] k3s[887]: I0921 14:43:58.242831 887 shared_informer.go:377] "Caches are synced" machine # [ 28.471545] k3s[887]: I0921 14:43:58.242883 887 shared_informer.go:377] "Caches are synced" machine # [ 28.472174] k3s[887]: I0921 14:43:58.242978 887 shared_informer.go:377] "Caches are synced" machine # [ 28.472361] k3s[887]: I0921 14:43:58.244525 887 shared_informer.go:377] "Caches are synced" machine # [ 28.472895] k3s[887]: I0921 14:43:58.244570 887 shared_informer.go:377] "Caches are synced" machine # [ 28.473595] k3s[887]: I0921 14:43:58.245067 887 shared_informer.go:377] "Caches are synced" machine # [ 28.643086] k3s[887]: time="2026-09-21T14:43:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 28.654714] k3s[887]: I0921 14:43:58.434541 887 shared_informer.go:377] "Caches are synced" machine # [ 28.683815] k3s[887]: I0921 14:43:58.463612 887 shared_informer.go:377] "Caches are synced" machine # [ 28.742919] k3s[887]: time="2026-09-21T14:43:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.813090] k3s[887]: time="2026-09-21T14:43:58Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 28.813291] k3s[887]: time="2026-09-21T14:43:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 29.026772] k3s[887]: time="2026-09-21T14:43:58Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 29.108770] k3s[887]: I0921 14:43:58.888566 887 controller.go:667] quota admission added evaluator for: replicasets.apps machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 29.663395] k3s[887]: I0921 14:43:59.443187 887 shared_informer.go:377] "Caches are synced" machine # [ 29.664731] k3s[887]: I0921 14:43:59.443220 887 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 29.666249] k3s[887]: I0921 14:43:59.443232 887 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 29.709591] k3s[887]: I0921 14:43:59.489393 887 shared_informer.go:377] "Caches are synced" machine # [ 29.740308] k3s[887]: time="2026-09-21T14:43:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.342558] postgres[1200]: [1200] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 30.343261] postgres[1200]: [1200] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 30.362850] niks3-server[1192]: 2026/09/21 14:44:00 OK 20241026095416_initial_model.sql (10.92ms) machine # [ 30.365733] niks3-server[1192]: 2026/09/21 14:44:00 OK 20251210153512_drop_unused_gin_index.sql (2.8ms) machine # [ 30.371084] niks3-server[1192]: 2026/09/21 14:44:00 OK 20251218171726_add_pins.sql (5.24ms) machine # [ 30.375781] niks3-server[1192]: 2026/09/21 14:44:00 OK 20260628120000_add_object_size_and_stats.sql (4.5ms) machine # [ 30.379143] niks3-server[1192]: 2026/09/21 14:44:00 OK 20260905000000_add_claims.sql (3.31ms) machine # [ 30.383275] niks3-server[1192]: 2026/09/21 14:44:00 OK 20260920000000_drop_claims.sql (4.09ms) machine # [ 30.384634] niks3-server[1192]: 2026/09/21 14:44:00 goose: successfully migrated database to version: 20260920000000 machine # [ 30.386633] niks3-server[1192]: 2026/09/21 14:44:00 OK 1_commit_pending_closure.sql (3.22ms) machine # [ 30.389071] niks3-server[1192]: 2026/09/21 14:44:00 OK 2_object_stats_trigger.sql (2.34ms) machine # [ 30.390364] niks3-server[1192]: 2026/09/21 14:44:00 goose: up to current file version: 2 machine # [ 30.394366] niks3-server[1192]: 2026/09/21 14:44:00 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 30.396433] niks3-server[1192]: 2026/09/21 14:44:00 INFO OIDC authentication enabled config=/nix/store/v0b0sqyzhrjsz48x3klf7b7vl89apzs0-niks3-oidc.json machine # [ 30.397195] niks3-server[1192]: 2026/09/21 14:44:00 INFO Loaded signing key name=farm-test-1 path=/nix/store/hk0nhypl37jvkn3gr36v3y7qx593p39i-key machine # [ 30.427313] niks3-server[1192]: 2026/09/21 14:44:00 INFO Read proxy enabled — serving cache objects from S3 machine # [ 30.429043] niks3-server[1192]: 2026/09/21 14:44:00 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 30.430488] niks3-server[1192]: 2026/09/21 14:44:00 INFO systemd watchdog enabled interval=15s machine # [ 30.431759] niks3-server[1192]: 2026/09/21 14:44:00 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 30.433268] systemd[1]: Started niks3 server. machine # [ 30.434073] systemd[1]: Reached target Multi-User System. machine # [ 30.434679] systemd[1]: Startup finished in 1.102s (kernel) + 3.816s (initrd) + 25.509s (userspace) = 30.428s. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.740338] k3s[887]: time="2026-09-21T14:44:00Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.006562] k3s[887]: time="2026-09-21T14:44:00Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.1" machine # [ 31.008986] k3s[887]: time="2026-09-21T14:44:00Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:7f76d2c9b8bafba975a2cf526baaeaba5efe85eef061d351124183c0b635ffa7" machine # [ 31.498221] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 7.153888273s" machine # [ 31.498860] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # [ 31.615364] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 31.616159] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 31.618320] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.619521] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 31.621201] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 31.622575] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Handling backend connection request [machine]" machine # [ 31.624199] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.625484] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 31.739687] k3s[887]: time="2026-09-21T14:44:01Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.740212] k3s[887]: time="2026-09-21T14:44:02Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.353858] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.1" machine # [ 33.357463] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:18ee6724be589622e1aee9d13c5121e7b2c992ca636c935ade90c66423e18f37" machine # [ 33.420442] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 1.921623838s" machine # [ 33.425221] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 33.640131] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::7390:e495:b878:abdf --node-labels= --read-only-port=0" machine # [ 33.652326] k3s[887]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 33.666939] k3s[887]: I0921 14:44:03.446664 887 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 33.667749] k3s[887]: I0921 14:44:03.446727 887 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 33.669212] k3s[887]: I0921 14:44:03.446788 887 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 33.671184] k3s[887]: I0921 14:44:03.446816 887 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 33.672287] k3s[887]: I0921 14:44:03.449748 887 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 33.678153] k3s[887]: I0921 14:44:03.457639 887 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 33.686843] k3s[887]: I0921 14:44:03.466607 887 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 33.687909] k3s[887]: I0921 14:44:03.466670 887 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 33.693376] k3s[887]: I0921 14:44:03.473159 887 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 33.694045] k3s[887]: I0921 14:44:03.473241 887 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 33.695206] k3s[887]: I0921 14:44:03.473613 887 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 33.696169] k3s[887]: I0921 14:44:03.473651 887 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 33.696862] k3s[887]: I0921 14:44:03.473823 887 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 33.702106] k3s[887]: I0921 14:44:03.479485 887 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 33.702936] k3s[887]: I0921 14:44:03.479905 887 kubelet.go:482] "Attempting to sync node with API server" machine # [ 33.703645] k3s[887]: I0921 14:44:03.479973 887 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 33.704536] k3s[887]: I0921 14:44:03.480021 887 kubelet.go:394] "Adding apiserver pod source" machine # [ 33.704988] k3s[887]: I0921 14:44:03.480049 887 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 33.705664] k3s[887]: I0921 14:44:03.483499 887 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 33.706120] k3s[887]: I0921 14:44:03.484731 887 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 33.706634] k3s[887]: I0921 14:44:03.484778 887 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 33.728185] k3s[887]: I0921 14:44:03.508007 887 server.go:1252] "Started kubelet" machine # [ 33.728871] k3s[887]: I0921 14:44:03.508302 887 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 33.729310] k3s[887]: I0921 14:44:03.508375 887 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 33.729782] k3s[887]: I0921 14:44:03.508542 887 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 33.730468] k3s[887]: I0921 14:44:03.508586 887 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 33.730934] k3s[887]: I0921 14:44:03.509419 887 server.go:317] "Adding debug handlers to kubelet server" machine # [ 33.734145] k3s[887]: I0921 14:44:03.513966 887 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 33.737109] k3s[887]: I0921 14:44:03.514430 887 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 33.737741] k3s[887]: E0921 14:44:03.515248 887 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 33.738453] k3s[887]: I0921 14:44:03.515294 887 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 33.738914] k3s[887]: I0921 14:44:03.515641 887 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 33.739634] k3s[887]: I0921 14:44:03.515697 887 reconciler.go:29] "Reconciler: start to sync state" machine # [ 33.743516] k3s[887]: I0921 14:44:03.523109 887 factory.go:223] Registration of the systemd container factory successfully machine # [ 33.744227] k3s[887]: I0921 14:44:03.523218 887 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 33.744866] k3s[887]: E0921 14:44:03.524711 887 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 33.749277] k3s[887]: I0921 14:44:03.529064 887 factory.go:223] Registration of the containerd container factory successfully machine # [ 33.752389] k3s[887]: E0921 14:44:03.532236 887 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 33.758982] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.764029] k3s[887]: I0921 14:44:03.543848 887 cpu_manager.go:225] "Starting" policy="none" machine # [ 33.764511] k3s[887]: I0921 14:44:03.543876 887 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 33.765123] k3s[887]: I0921 14:44:03.543898 887 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 33.771072] k3s[887]: I0921 14:44:03.550924 887 policy_none.go:50] "Start" machine # [ 33.772283] k3s[887]: I0921 14:44:03.550951 887 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 33.772740] k3s[887]: I0921 14:44:03.550969 887 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 33.780035] k3s[887]: I0921 14:44:03.559838 887 policy_none.go:44] "Start" machine # [ 33.784493] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 33.794738] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 33.798823] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 33.806367] k3s[887]: E0921 14:44:03.586219 887 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 33.806670] k3s[887]: I0921 14:44:03.586536 887 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 33.807294] k3s[887]: I0921 14:44:03.587146 887 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 33.808337] k3s[887]: I0921 14:44:03.588189 887 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 33.809082] k3s[887]: E0921 14:44:03.588942 887 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 33.809313] k3s[887]: E0921 14:44:03.588987 887 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 33.851956] k3s[887]: I0921 14:44:03.631781 887 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 33.857903] k3s[887]: I0921 14:44:03.637599 887 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 33.858589] k3s[887]: I0921 14:44:03.637627 887 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 33.858996] k3s[887]: I0921 14:44:03.637664 887 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 33.859308] k3s[887]: E0921 14:44:03.637714 887 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 33.910876] k3s[887]: I0921 14:44:03.690630 887 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 33.916407] k3s[887]: I0921 14:44:03.695791 887 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 33.917866] k3s[887]: E0921 14:44:03.695822 887 kubelet_node_status.go:474] "Error updating node status, will retry" err="error getting node \"machine\": node \"machine\" not found" machine # [ 33.919912] k3s[887]: I0921 14:44:03.696354 887 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 33.923047] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 33.924693] k3s[887]: I0921 14:44:03.700717 887 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.926105] k3s[887]: I0921 14:44:03.700770 887 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.928197] k3s[887]: E0921 14:44:03.700793 887 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.930803] k3s[887]: I0921 14:44:03.701991 887 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 33.932329] k3s[887]: I0921 14:44:03.705828 887 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.933706] k3s[887]: I0921 14:44:03.705893 887 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.935777] k3s[887]: E0921 14:44:03.705943 887 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.938223] k3s[887]: I0921 14:44:03.709409 887 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.939628] k3s[887]: I0921 14:44:03.709465 887 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.941653] k3s[887]: E0921 14:44:03.709482 887 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.944181] k3s[887]: I0921 14:44:03.716471 887 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.945600] k3s[887]: I0921 14:44:03.716528 887 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 33.947738] k3s[887]: E0921 14:44:03.716547 887 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 33.950234] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 33.951551] k3s[887]: I0921 14:44:03.723259 887 node_controller.go:429] Initializing node machine with cloud provider machine # [ 33.952882] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 33.954383] k3s[887]: I0921 14:44:03.726659 887 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 33.956212] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Starting flannel with backend vxlan" machine # [ 33.958182] k3s[887]: I0921 14:44:03.734216 887 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 34.071060] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 34.073779] k3s[887]: time="2026-09-21T14:44:03Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 34.075258] k3s[887]: I0921 14:44:03.854524 887 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 34.076765] k3s[887]: I0921 14:44:03.854956 887 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 34.079881] k3s[887]: I0921 14:44:03.859261 887 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 34.083066] k3s[887]: I0921 14:44:03.859385 887 kube.go:537] Starting kube subnet manager machine # [ 34.084745] k3s[887]: I0921 14:44:03.864590 887 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 34.093822] k3s[887]: I0921 14:44:03.873665 887 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 34.097042] k3s[887]: I0921 14:44:03.876176 887 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 34.098656] k3s[887]: I0921 14:44:03.876877 887 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.105595] k3s[887]: I0921 14:44:03.885409 887 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 34.107194] k3s[887]: I0921 14:44:03.885533 887 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 34.108743] k3s[887]: I0921 14:44:03.885553 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.110063] k3s[887]: I0921 14:44:03.885587 887 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 34.112825] k3s[887]: I0921 14:44:03.885676 887 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 34.114670] k3s[887]: I0921 14:44:03.892427 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 34.116904] k3s[887]: I0921 14:44:03.892483 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 34.118425] k3s[887]: I0921 14:44:03.892513 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 34.120750] k3s[887]: I0921 14:44:03.892528 887 shared_informer.go:370] "Waiting for caches to sync" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.580906] k3s[887]: time="2026-09-21T14:44:04Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 34.701628] k3s[887]: I0921 14:44:04.481304 887 apiserver.go:52] "Watching apiserver" machine # [ 34.705948] k3s[887]: I0921 14:44:04.485688 887 shared_informer.go:377] "Caches are synced" machine # [ 34.714910] k3s[887]: I0921 14:44:04.492723 887 shared_informer.go:377] "Caches are synced" machine # [ 34.715688] k3s[887]: I0921 14:44:04.492860 887 shared_informer.go:377] "Caches are synced" machine # [ 34.731960] k3s[887]: time="2026-09-21T14:44:04Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 34.732257] k3s[887]: I0921 14:44:04.511789 887 network_policy_controller.go:164] Starting network policy controller machine # [ 34.736303] k3s[887]: I0921 14:44:04.516143 887 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 34.739111] k3s[887]: I0921 14:44:04.518926 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/681a9281-5ab7-4899-b1cb-f6f40fcb992c-config-volume\") pod \"coredns-c5fdd76cf-7b9vn\" (UID: \"681a9281-5ab7-4899-b1cb-f6f40fcb992c\") " pod="kube-system/coredns-c5fdd76cf-7b9vn" machine # [ 34.739408] k3s[887]: I0921 14:44:04.518966 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-cache\") pod \"helm-install-nix-grpc-farm-j2d9k\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " pod="kube-system/helm-install-nix-grpc-farm-j2d9k" machine # [ 34.739906] k3s[887]: I0921 14:44:04.518992 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-tmp\") pod \"helm-install-nix-grpc-farm-j2d9k\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " pod="kube-system/helm-install-nix-grpc-farm-j2d9k" machine # [ 34.740592] k3s[887]: I0921 14:44:04.519018 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-values\") pod \"helm-install-nix-grpc-farm-j2d9k\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " pod="kube-system/helm-install-nix-grpc-farm-j2d9k" machine # [ 34.741069] k3s[887]: I0921 14:44:04.519044 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/b952e891-bca8-4d99-a338-a42765ea812b-content\") pod \"helm-install-nix-grpc-farm-j2d9k\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " pod="kube-system/helm-install-nix-grpc-farm-j2d9k" machine # [ 34.741582] k3s[887]: I0921 14:44:04.519070 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/681a9281-5ab7-4899-b1cb-f6f40fcb992c-custom-config-volume\") pod \"coredns-c5fdd76cf-7b9vn\" (UID: \"681a9281-5ab7-4899-b1cb-f6f40fcb992c\") " pod="kube-system/coredns-c5fdd76cf-7b9vn" machine # [ 34.744265] k3s[887]: I0921 14:44:04.519092 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svft8\" (UniqueName: \"kubernetes.io/projected/681a9281-5ab7-4899-b1cb-f6f40fcb992c-kube-api-access-svft8\") pod \"coredns-c5fdd76cf-7b9vn\" (UID: \"681a9281-5ab7-4899-b1cb-f6f40fcb992c\") " pod="kube-system/coredns-c5fdd76cf-7b9vn" machine # [ 34.744687] k3s[887]: I0921 14:44:04.519118 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-helm\") pod \"helm-install-nix-grpc-farm-j2d9k\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " pod="kube-system/helm-install-nix-grpc-farm-j2d9k" machine # [ 34.745256] k3s[887]: I0921 14:44:04.519141 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-config\") pod \"helm-install-nix-grpc-farm-j2d9k\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " pod="kube-system/helm-install-nix-grpc-farm-j2d9k" machine # [ 34.745749] k3s[887]: I0921 14:44:04.519165 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxkf2\" (UniqueName: \"kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-kube-api-access-fxkf2\") pod \"helm-install-nix-grpc-farm-j2d9k\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " pod="kube-system/helm-install-nix-grpc-farm-j2d9k" machine # [ 34.746192] systemd[1]: Created slice libcontainer container kubepods-burstable-pod681a9281_5ab7_4899_b1cb_f6f40fcb992c.slice. machine # [ 34.781955] k3s[887]: time="2026-09-21T14:44:04Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 34.794248] systemd[1]: Created slice libcontainer container kubepods-burstable-podb952e891_bca8_4d99_a338_a42765ea812b.slice. machine # [ 34.800767] k3s[887]: I0921 14:44:04.580571 887 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::7390:e495:b878:abdf"] machine # [ 34.802785] k3s[887]: E0921 14:44:04.580660 887 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 34.815726] k3s[887]: I0921 14:44:04.595557 887 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 34.815852] k3s[887]: I0921 14:44:04.595595 887 server_linux.go:136] "Using iptables Proxier" machine # [ 34.831859] k3s[887]: I0921 14:44:04.611644 887 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 34.840026] k3s[887]: I0921 14:44:04.619823 887 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 34.840328] k3s[887]: I0921 14:44:04.619854 887 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 34.843100] k3s[887]: I0921 14:44:04.621714 887 config.go:200] "Starting service config controller" machine # [ 34.843576] k3s[887]: I0921 14:44:04.621740 887 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 34.844069] k3s[887]: I0921 14:44:04.621771 887 config.go:106] "Starting endpoint slice config controller" machine # [ 34.844546] k3s[887]: I0921 14:44:04.621783 887 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 34.845020] k3s[887]: I0921 14:44:04.621819 887 config.go:403] "Starting serviceCIDR config controller" machine # [ 34.845480] k3s[887]: I0921 14:44:04.621831 887 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 34.845925] k3s[887]: I0921 14:44:04.622352 887 config.go:309] "Starting node config controller" machine # [ 34.846595] k3s[887]: I0921 14:44:04.622367 887 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 34.847079] k3s[887]: I0921 14:44:04.622378 887 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 35.009989] k3s[887]: I0921 14:44:04.789784 887 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 35.080434] k3s[887]: I0921 14:44:04.860207 887 kube.go:163] Node controller sync successful machine # [ 35.081042] k3s[887]: I0921 14:44:04.860275 887 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 35.083517] k3s[887]: I0921 14:44:04.863247 887 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::7390:e495:b878:abdf", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::7390:e495:b878:abdf", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 35.104589] (udev-worker)[1284]: Network interface NamePolicy= disabled on kernel command line. machine # [ 35.112828] k3s[887]: I0921 14:44:04.892641 887 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 35.116345] k3s[887]: I0921 14:44:04.895266 887 iptables.go:50] Starting flannel in iptables mode... machine # [ 35.117809] k3s[887]: time="2026-09-21T14:44:04Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.119597] k3s[887]: time="2026-09-21T14:44:04Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.121389] k3s[887]: time="2026-09-21T14:44:04Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 35.123703] k3s[887]: time="2026-09-21T14:44:04Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 35.125918] k3s[887]: I0921 14:44:04.895364 887 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 35.137123] dhcpcd[698]: flannel.1: IAID b8:1a:79:a9 machine # [ 35.137422] dhcpcd[698]: flannel.1: adding address fe80::f018:b8ff:fe1a:79a9 machine # [ 35.142175] k3s[887]: I0921 14:44:04.922007 887 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 35.142568] k3s[887]: I0921 14:44:04.922055 887 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 35.145084] k3s[887]: I0921 14:44:04.924933 887 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 35.196927] k3s[887]: I0921 14:44:04.976733 887 iptables.go:111] Setting up masking rules machine # [ 35.203845] k3s[887]: E0921 14:44:04.983660 887 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b11b83d33e447edd730ac93879d2fce994d93fc86315cad41e13305a61a3cdf7\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 35.208788] k3s[887]: E0921 14:44:04.983763 887 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b11b83d33e447edd730ac93879d2fce994d93fc86315cad41e13305a61a3cdf7\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-j2d9k" machine # [ 35.214201] k3s[887]: E0921 14:44:04.983789 887 kuberuntime_manager.go:1568] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"b11b83d33e447edd730ac93879d2fce994d93fc86315cad41e13305a61a3cdf7\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/helm-install-nix-grpc-farm-j2d9k" machine # [ 35.219688] k3s[887]: E0921 14:44:04.983868 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"helm-install-nix-grpc-farm-j2d9k_kube-system(b952e891-bca8-4d99-a338-a42765ea812b)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"helm-install-nix-grpc-farm-j2d9k_kube-system(b952e891-bca8-4d99-a338-a42765ea812b)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"b11b83d33e447edd730ac93879d2fce994d93fc86315cad41e13305a61a3cdf7\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/helm-install-nix-grpc-farm-j2d9k" podUID="b952e891-bca8-4d99-a338-a42765ea812b" machine # [ 35.228050] k3s[887]: E0921 14:44:05.004753 887 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"19ca76fdd33dcb108f5d3d9175144b53df0d7d6ed4b39c96f72fa53cf18266a8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" machine # [ 35.232313] k3s[887]: E0921 14:44:05.004794 887 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"19ca76fdd33dcb108f5d3d9175144b53df0d7d6ed4b39c96f72fa53cf18266a8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-c5fdd76cf-7b9vn" machine # [ 35.237455] k3s[887]: E0921 14:44:05.004814 887 kuberuntime_manager.go:1568] "CreatePodSandbox for pod failed" err="rpc error: code = Unknown desc = failed to setup network for sandbox \"19ca76fdd33dcb108f5d3d9175144b53df0d7d6ed4b39c96f72fa53cf18266a8\": plugin type=\"flannel\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory" pod="kube-system/coredns-c5fdd76cf-7b9vn" machine # [ 35.242559] k3s[887]: E0921 14:44:05.004865 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"CreatePodSandbox\" for \"coredns-c5fdd76cf-7b9vn_kube-system(681a9281-5ab7-4899-b1cb-f6f40fcb992c)\" with CreatePodSandboxError: \"Failed to create sandbox for pod \\\"coredns-c5fdd76cf-7b9vn_kube-system(681a9281-5ab7-4899-b1cb-f6f40fcb992c)\\\": rpc error: code = Unknown desc = failed to setup network for sandbox \\\"19ca76fdd33dcb108f5d3d9175144b53df0d7d6ed4b39c96f72fa53cf18266a8\\\": plugin type=\\\"flannel\\\" failed (add): loadFlannelSubnetEnv failed: open /run/flannel/subnet.env: no such file or directory\"" pod="kube-system/coredns-c5fdd76cf-7b9vn" podUID="681a9281-5ab7-4899-b1cb-f6f40fcb992c" machine # [ 35.250497] k3s[887]: E0921 14:44:05.022144 887 proxier.go:807] "Failed to ensure chain jumps" err=< machine # [ 35.251898] k3s[887]: error appending rule: exit status 2: iptables v1.8.13 (nf_tables): Chain 'KUBE-NODEPORTS' does not exist machine # [ 35.253620] k3s[887]: Try `iptables -h' or 'iptables --help' for more information. machine # [ 35.254853] k3s[887]: > ipFamily="IPv4" table="filter" srcChain="INPUT" dstChain="KUBE-NODEPORTS" machine # [ 35.256204] k3s[887]: I0921 14:44:05.022282 887 proxier.go:770] "Sync failed" ipFamily="IPv4" retryingTime="30s" machine # [ 35.257726] k3s[887]: I0921 14:44:05.030819 887 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 35.264178] k3s[887]: time="2026-09-21T14:44:05Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 35.266532] k3s[887]: time="2026-09-21T14:44:05Z" level=info msg="Running flannel backend" machine # [ 35.268110] k3s[887]: I0921 14:44:05.044116 887 vxlan_network.go:68] watching for new subnet leases machine # [ 35.269499] k3s[887]: I0921 14:44:05.044153 887 vxlan_network.go:115] starting vxlan device watcher machine # [ 35.312588] k3s[887]: I0921 14:44:05.092399 887 iptables.go:358] bootstrap done machine # [ 35.350064] k3s[887]: I0921 14:44:05.129414 887 iptables.go:358] bootstrap done machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.862091] systemd[1]: run-netns-cni\x2df922f161\x2dda9d\x2d637b\x2df0da\x2d049ec5a6e5b0.mount: Deactivated successfully. machine # [ 36.538102] dhcpcd[698]: flannel.1: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.472543] dhcpcd[698]: flannel.1: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.452127] k3s[887]: I0921 14:44:08.231519 887 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 38.452297] k3s[887]: I0921 14:44:08.231639 887 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 38.452925] k3s[887]: I0921 14:44:08.231715 887 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 38.519586] k3s[887]: time="2026-09-21T14:44:08Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.1" machine # [ 38.523523] k3s[887]: time="2026-09-21T14:44:08Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:50b706a70586bb68c041cb63c3808bd4cecf44a8068632650ed9cad7a47a0284" machine # [ 38.913310] k3s[887]: time="2026-09-21T14:44:08Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 5.488349496s" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 41.538931] dhcpcd[698]: flannel.1: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.580274] dhcpcd[698]: flannel.1: using IPv4LL address 169.254.167.110 machine # [ 46.582773] dhcpcd[698]: flannel.1: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.084594] cni0: port 1(veth58274632) entered blocking state machine # [ 48.085987] cni0: port 1(veth58274632) entered disabled state machine # [ 48.087639] veth58274632: entered allmulticast mode machine # [ 48.089108] veth58274632: entered promiscuous mode machine # [ 48.102946] cni0: port 1(veth58274632) entered blocking state machine # [ 48.104183] cni0: port 1(veth58274632) entered forwarding state machine # [ 47.973157] (udev-worker)[1827]: Network interface NamePolicy= disabled on kernel command line. machine # [ 47.976335] (udev-worker)[1830]: Network interface NamePolicy= disabled on kernel command line. machine # [ 47.996728] dhcpcd[698]: veth58274632: IAID 57:c8:8b:02 machine # [ 47.997570] dhcpcd[698]: veth58274632: adding address fe80::c472:57ff:fec8:8b02 machine # [ 48.015521] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4282593308.mount: Deactivated successfully. machine # [ 48.084802] systemd[1]: Started libcontainer container 0285cf2078c84225a8fa06511c5f6f77b494cec4d1f12eafde906058c427c0d4. machine # [ 48.825146] dhcpcd[698]: veth58274632: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.971343] systemd[1]: Started libcontainer container d4d65196ea34261f70a2fa46e4e4cc14b2648acc10ce6c79f1f206f2f7318508. machine # [ 49.168871] systemd[1]: cri-containerd-d4d65196ea34261f70a2fa46e4e4cc14b2648acc10ce6c79f1f206f2f7318508.scope: Deactivated successfully. machine # [ 49.169105] systemd[1]: cri-containerd-d4d65196ea34261f70a2fa46e4e4cc14b2648acc10ce6c79f1f206f2f7318508.scope: Consumed 213ms CPU time over 196ms wall clock time, 14.8M memory peak, 120B outgoing IP traffic. machine # [ 49.198914] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-d4d65196ea34261f70a2fa46e4e4cc14b2648acc10ce6c79f1f206f2f7318508-rootfs.mount: Deactivated successfully. machine # [ 49.476728] dhcpcd[698]: flannel.1: no IPv6 Routers available machine # [ 50.057459] cni0: port 2(vethc5dc1749) entered blocking state machine # [ 49.904642] ([ 50.059404] cni0: port 2(vethc5dc1749) entered disabled state machine # udev-worker)[1840]: Network inte[ 50.061688] vethc5dc1749: entered allmulticast mode machine # rface NamePolicy= disabled on kernel command line. machine # [ 50.064970] vethc5dc1749: entered promiscuous mode machine # [ 49.929190] k3s[887]: I0921 14:44:19.704499 887 scope.go:122] "RemoveContainer" containerID="d4d65196ea34261f70a2fa46e4e4cc14b2648acc10ce6c79f1f206f2f7318508" machine # [ 50.091246] cni0: port 2(vethc5dc1749) entered blocking state machine # [ 50.091907] cni0: port 2(vethc5dc1749) entered forwarding state machine # [ 49.957930] dhcpcd[698]: vethc5dc1749: IAID 47:57:84:35 machine # [ 49.958584] dhcpcd[698]: vethc5dc1749: adding address fe80::5c79:47ff:fe57:8435 machine # [ 50.002480] systemd[1]: Started libcontainer container c39c4a816c8e39cca134fb5ebd11be05609f3149743a67baae7ac9e4d84e6b9e. machine # [ 50.060349] systemd[1]: Started libcontainer container db6060a18b88d2ac28748d06397483221fa8036ad3e6c93300c89e563aa082ff. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.243525] systemd[1]: cri-containerd-c39c4a816c8e39cca134fb5ebd11be05609f3149743a67baae7ac9e4d84e6b9e.scope: Deactivated successfully. machine # [ 50.244053] systemd[1]: cri-containerd-c39c4a816c8e39cca134fb5ebd11be05609f3149743a67baae7ac9e4d84e6b9e.scope: Consumed 206ms CPU time over 240ms wall clock time, 14.5M memory peak, 120B outgoing IP traffic. machine # [ 50.396367] dhcpcd[698]: veth58274632: soliciting an IPv6 router machine # [ 50.793572] systemd[1]: Started libcontainer container 12cb3736385fc43a424ac6b9a093386d603c2c0ecce923b55d71f69cc7136f7f. machine # [ 50.934093] k3s[887]: I0921 14:44:20.713261 887 scope.go:122] "RemoveContainer" containerID="d4d65196ea34261f70a2fa46e4e4cc14b2648acc10ce6c79f1f206f2f7318508" machine # [ 50.934865] k3s[887]: I0921 14:44:20.714457 887 scope.go:122] "RemoveContainer" containerID="c39c4a816c8e39cca134fb5ebd11be05609f3149743a67baae7ac9e4d84e6b9e" machine # [ 50.938242] k3s[887]: E0921 14:44:20.718019 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 10s restarting failed container=helm pod=helm-install-nix-grpc-farm-j2d9k_kube-system(b952e891-bca8-4d99-a338-a42765ea812b)\"" pod="kube-system/helm-install-nix-grpc-farm-j2d9k" podUID="b952e891-bca8-4d99-a338-a42765ea812b" machine # [ 50.961979] k3s[887]: I0921 14:44:20.741771 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-7b9vn" podStartSLOduration=21.741752228 podStartE2EDuration="21.741752228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 14:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 14:44:20.740655162 +0000 UTC m=+33.519356508" watchObservedRunningTime="2026-09-21 14:44:20.741752228 +0000 UTC m=+33.520450222" machine # [ 51.005062] dhcpcd[698]: vethc5dc1749: soliciting a DHCP lease machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.953146] k3s[887]: I0921 14:44:21.732220 887 scope.go:122] "RemoveContainer" containerID="c39c4a816c8e39cca134fb5ebd11be05609f3149743a67baae7ac9e4d84e6b9e" machine # [ 51.953533] k3s[887]: E0921 14:44:21.732539 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 10s restarting failed container=helm pod=helm-install-nix-grpc-farm-j2d9k_kube-system(b952e891-bca8-4d99-a338-a42765ea812b)\"" pod="kube-system/helm-install-nix-grpc-farm-j2d9k" podUID="b952e891-bca8-4d99-a338-a42765ea812b" machine # [ 52.104885] dhcpcd[698]: vethc5dc1749: soliciting an IPv6 router machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 53.826713] dhcpcd[698]: veth58274632: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 56.005936] dhcpcd[698]: vethc5dc1749: probing for an IPv4LL address machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 59.276408] dhcpcd[698]: veth58274632: using IPv4LL address 169.254.154.10 machine # [ 59.279164] dhcpcd[698]: veth58274632: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 61.112506] dhcpcd[698]: vethc5dc1749: using IPv4LL address 169.254.236.54 machine # [ 61.113458] dhcpcd[698]: vethc5dc1749: adding route to 169.254.0.0/16 machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 62.399094] dhcpcd[698]: veth58274632: no IPv6 Routers available machine # [ 62.860136] k3s[887]: I0921 14:44:32.639172 887 scope.go:122] "RemoveContainer" containerID="c39c4a816c8e39cca134fb5ebd11be05609f3149743a67baae7ac9e4d84e6b9e" machine # [ 62.938267] systemd[1]: Started libcontainer container 8171ca9d7b2e1454783427ff23de4890b32db96e71ab8bb37250622eb34a5402. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 64.013816] k3s[887]: I0921 14:44:33.793317 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-j2d9k" podStartSLOduration=35.79329537 podStartE2EDuration="35.79329537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 14:43:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 14:44:33.792089351 +0000 UTC m=+46.570787624" watchObservedRunningTime="2026-09-21 14:44:33.79329537 +0000 UTC m=+46.571993364" machine # [ 64.106472] dhcpcd[698]: vethc5dc1749: no IPv6 Routers available machine # [ 64.135096] k3s[887]: I0921 14:44:33.914513 887 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.61.57"} machine # [ 64.173908] systemd[1]: cri-containerd-8171ca9d7b2e1454783427ff23de4890b32db96e71ab8bb37250622eb34a5402.scope: Deactivated successfully. machine # [ 64.178529] systemd[1]: cri-containerd-8171ca9d7b2e1454783427ff23de4890b32db96e71ab8bb37250622eb34a5402.scope: Consumed 698ms CPU time over 1.235s wall clock time, 31.5M memory peak, 2.4M incoming IP traffic, 140.7K outgoing IP traffic. machine # [ 64.206818] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-8171ca9d7b2e1454783427ff23de4890b32db96e71ab8bb37250622eb34a5402-rootfs.mount: Deactivated successfully. machine # [ 64.680425] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod0cf22c0a_f50d_48b7_b8fe_3d269011c0af.slice. machine # [ 64.698898] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod04e8e238_a2d4_4472_8887_2b4493677309.slice. machine # [ 64.709819] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode526e35c_dd9a_4abe_b94b_ee91ed06fced.slice. machine # [ 64.722699] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod66e30b5b_5f21_40fb_beed_6e248a1e74f7.slice. machine # [ 64.763680] k3s[887]: I0921 14:44:34.543146 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj4qr\" (UniqueName: \"kubernetes.io/projected/04e8e238-a2d4-4472-8887-2b4493677309-kube-api-access-wj4qr\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n\" (UID: \"04e8e238-a2d4-4472-8887-2b4493677309\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n" machine # [ 64.764207] k3s[887]: I0921 14:44:34.544021 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m58d\" (UniqueName: \"kubernetes.io/projected/0cf22c0a-f50d-48b7-b8fe-3d269011c0af-kube-api-access-9m58d\") pod \"nix-grpc-farm-scheduler-5844ddf54b-kgnf9\" (UID: \"0cf22c0a-f50d-48b7-b8fe-3d269011c0af\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-kgnf9" machine # [ 64.764896] k3s[887]: I0921 14:44:34.544055 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/04e8e238-a2d4-4472-8887-2b4493677309-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n\" (UID: \"04e8e238-a2d4-4472-8887-2b4493677309\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n" machine # [ 64.766087] k3s[887]: I0921 14:44:34.544146 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw" machine # [ 64.766762] k3s[887]: I0921 14:44:34.544224 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0cf22c0a-f50d-48b7-b8fe-3d269011c0af-ca\") pod \"nix-grpc-farm-scheduler-5844ddf54b-kgnf9\" (UID: \"0cf22c0a-f50d-48b7-b8fe-3d269011c0af\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-kgnf9" machine # [ 64.767392] k3s[887]: I0921 14:44:34.544348 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/0cf22c0a-f50d-48b7-b8fe-3d269011c0af-oidc\") pod \"nix-grpc-farm-scheduler-5844ddf54b-kgnf9\" (UID: \"0cf22c0a-f50d-48b7-b8fe-3d269011c0af\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-kgnf9" machine # [ 64.767844] k3s[887]: I0921 14:44:34.544512 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/04e8e238-a2d4-4472-8887-2b4493677309-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n\" (UID: \"04e8e238-a2d4-4472-8887-2b4493677309\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n" machine # [ 64.768494] k3s[887]: I0921 14:44:34.544641 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e526e35c-dd9a-4abe-b94b-ee91ed06fced-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-zstrv\" (UID: \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-zstrv" machine # [ 64.768965] k3s[887]: I0921 14:44:34.544695 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-zstrv\" (UID: \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-zstrv" machine # [ 64.769600] k3s[887]: I0921 14:44:34.544832 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/04e8e238-a2d4-4472-8887-2b4493677309-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n\" (UID: \"04e8e238-a2d4-4472-8887-2b4493677309\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n" machine # [ 64.770071] k3s[887]: I0921 14:44:34.544980 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/0cf22c0a-f50d-48b7-b8fe-3d269011c0af-tls\") pod \"nix-grpc-farm-scheduler-5844ddf54b-kgnf9\" (UID: \"0cf22c0a-f50d-48b7-b8fe-3d269011c0af\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-kgnf9" machine # [ 64.770571] k3s[887]: I0921 14:44:34.545004 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/04e8e238-a2d4-4472-8887-2b4493677309-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n\" (UID: \"04e8e238-a2d4-4472-8887-2b4493677309\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n" machine # [ 64.771993] k3s[887]: I0921 14:44:34.545028 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/04e8e238-a2d4-4472-8887-2b4493677309-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n\" (UID: \"04e8e238-a2d4-4472-8887-2b4493677309\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n" machine # [ 64.811930] k3s[887]: I0921 14:44:34.545113 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw" machine # [ 64.812639] k3s[887]: I0921 14:44:34.545138 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw" machine # [ 64.813102] k3s[887]: I0921 14:44:34.545168 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-zstrv\" (UID: \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-zstrv" machine # [ 64.813626] k3s[887]: I0921 14:44:34.545191 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/0cf22c0a-f50d-48b7-b8fe-3d269011c0af-niks3-token\") pod \"nix-grpc-farm-scheduler-5844ddf54b-kgnf9\" (UID: \"0cf22c0a-f50d-48b7-b8fe-3d269011c0af\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-kgnf9" machine # [ 64.814095] k3s[887]: I0921 14:44:34.545216 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/04e8e238-a2d4-4472-8887-2b4493677309-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n\" (UID: \"04e8e238-a2d4-4472-8887-2b4493677309\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n" machine # [ 64.814580] k3s[887]: I0921 14:44:34.545317 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw" machine # [ 64.815135] k3s[887]: I0921 14:44:34.545340 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw" machine # [ 64.815574] k3s[887]: I0921 14:44:34.545365 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw" machine # [ 64.816080] k3s[887]: I0921 14:44:34.545395 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-zstrv\" (UID: \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-zstrv" machine # [ 64.816585] k3s[887]: I0921 14:44:34.545420 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/04e8e238-a2d4-4472-8887-2b4493677309-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n\" (UID: \"04e8e238-a2d4-4472-8887-2b4493677309\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n" machine # [ 64.817065] k3s[887]: I0921 14:44:34.545447 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw" machine # [ 64.819692] k3s[887]: I0921 14:44:34.545471 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffv5l\" (UniqueName: \"kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-kube-api-access-ffv5l\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw" machine # [ 65.003600] k3s[887]: I0921 14:44:34.783360 887 scope.go:122] "RemoveContainer" containerID="c39c4a816c8e39cca134fb5ebd11be05609f3149743a67baae7ac9e4d84e6b9e" machine # [ 65.205427] cni0: port 3(veth23b06570) entered blocking state machine # [ 65.206412] cni0: port 3(veth23b06570) entered disabled state machine # [ 65.207255] veth23b06570: entered allmulticast mode machine # [ 65.207994] veth23b06570: entered promiscuous mode machine # [ 65.217996] cni0: port 3(veth23b06570) entered blocking state machine # [ 65.218664] cni0: port 3(veth23b06570) entered forwarding state machine # [ 65.220227] cni0: port 4(veth21b3f44a) entered blocking state machine # [ 65.221371] cni0: port 4(veth21b3f44a) entered disabled state machine # [ 65.222099] veth21b3f44a: entered allmulticast mode machine # [ 65.222765] veth21b3f44a: entered promiscuous mode machine # [ 65.225455] cni0: port 5(vethc1ae2496) entered blocking state machine # [ 65.226677] cni0: port 5(vethc1ae2496) entered disabled state machine # [ 65.227331] vethc1ae2496: entered allmulticast mode machine # [ 65.229346] vethc1ae2496: entered promiscuous mode machine # [ 65.234470] cni0: port 4(veth21b3f44a) entered blocking state machine # [ 65.235208] cni0: port 4(veth21b3f44a) entered forwarding state machine # [ 65.237611] cni0: port 6(vethb3a7b8fa) entered blocking state machine # [ 65.238884] cni0: port 6(vethb3a7b8fa) entered disabled state machine # [ 65.239553] vethb3a7b8fa: entered allmulticast mode machine # [ 65.240533] vethb3a7b8fa: entered promiscuous mode machine # [ 65.245922] cni0: port 5(vethc1ae2496) entered blocking state machine # [ 65.246560] cni0: port 5(vethc1ae2496) entered forwarding state machine # [ 65.250407] cni0: port 6(vethb3a7b8fa) entered blocking state machine # [ 65.251171] cni0: port 6(vethb3a7b8fa) entered forwarding state machine # [ 65.103182] (udev-worker)[2805]: Network interface NamePolicy= disabled on kernel command line. machine # [ 65.110794] (udev-worker)[2809]: Network interface NamePolicy= disabled on kernel command line. machine # [ 65.112275] (udev-worker)[2813]: Network interface NamePolicy= disabled on kernel command line. machine # [ 65.113715] (udev-worker)[2816]: Network interface NamePolicy= disabled on kernel command line. machine # [ 65.138335] dhcpcd[698]: veth23b06570: IAID e4:1f:30:f3 machine # [ 65.139738] dhcpcd[698]: veth23b06570: adding address fe80::28f2:e4ff:fe1f:30f3 machine # [ 65.152084] dhcpcd[698]: veth21b3f44a: IAID 92:c5:15:64 machine # [ 65.152985] dhcpcd[698]: veth21b3f44a: adding address fe80::9cb5:92ff:fec5:1564 machine # [ 65.163731] dhcpcd[698]: vethc1ae2496: IAID 66:12:f2:05 machine # [ 65.164635] dhcpcd[698]: vethc1ae2496: adding address fe80::d481:66ff:fe12:f205 machine # [ 65.175746] dhcpcd[698]: vethb3a7b8fa: IAID a2:e6:24:e6 machine # [ 65.177891] dhcpcd[698]: vethb3a7b8fa: adding address fe80::1854:a2ff:fee6:24e6 machine # [ 65.200713] systemd[1]: Started libcontainer container a9a7008df1bc5a983dc4f663e3907080453bf91771f4bc0e16d73d5011c6ff1d. machine # [ 65.254329] systemd[1]: Started libcontainer container c152faf308404e2579fde40c7eefcd40102824d4506fb092ea6669b5d07e8988. machine # [ 65.261144] systemd[1]: Started libcontainer container c9610d1e14d048338311d50e3595042085f0f5f0ca77f832aa7a5f2177a8d870. machine # [ 65.291263] systemd[1]: Started libcontainer container 9f72023514130d1df4a7a9a93edae2d5769a52dd33fb3789e310f797650b4b47. machine # [ 65.293278] dhcpcd[698]: veth23b06570: soliciting a DHCP lease machine # [ 65.920213] dhcpcd[698]: vethb3a7b8fa: soliciting a DHCP lease machine # [ 66.012120] dhcpcd[698]: veth21b3f44a: soliciting a DHCP lease machine # [ 66.051368] systemd[1]: cri-containerd-0285cf2078c84225a8fa06511c5f6f77b494cec4d1f12eafde906058c427c0d4.scope: Deactivated successfully. machine # [ 66.211228] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-0285cf2078c84225a8fa06511c5f6f77b494cec4d1f12eafde906058c427c0d4-rootfs.mount: Deactivated successfully. machine # [ 66.230659] dhcpcd[698]: vethc1ae2496: soliciting a DHCP lease machine # [ 66.400323] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-0285cf2078c84225a8fa06511c5f6f77b494cec4d1f12eafde906058c427c0d4-shm.mount: Deactivated successfully. machine # [ 66.438156] dhcpcd[698]: veth58274632: carrie[ 66.592216] cni0: port 1(veth58274632) entered disabled state machine # r lost machine # [ 66.594076] veth58274632 (unregistering): left allmulticast mode machine # [ 66.595008] veth58274632 (unregistering): left promiscuous mode machine # [ 66.595818] cni0: port 1(veth58274632) entered disabled state machine # [ 66.454954] systemd[1]: run-netns-cni\x2d5cc1280d\x2de792\x2d9c76\x2dab25\x2d9b7abd94385e.mount: Deactivated successfully. machine # [ 66.462209] dhcpcd[698]: veth58274632: deleting address fe80::c472:57ff:fec8:8b02 machine # [ 66.463417] dhcpcd[698]: veth58274632: deleting route to 169.254.0.0/16 machine # [ 66.522345] dhcpcd[698]: veth58274632: removing interface machine # [ 66.538301] dhcpcd[698]: veth21b3f44a: soliciting an IPv6 router machine # [ 66.584556] k3s[887]: I0921 14:44:36.364067 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b952e891-bca8-4d99-a338-a42765ea812b-content\" (UniqueName: \"kubernetes.io/configmap/b952e891-bca8-4d99-a338-a42765ea812b-content\") pod \"b952e891-bca8-4d99-a338-a42765ea812b\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " machine # [ 66.588911] k3s[887]: I0921 14:44:36.364131 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-cache\") pod \"b952e891-bca8-4d99-a338-a42765ea812b\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " machine # [ 66.595222] k3s[887]: I0921 14:44:36.364158 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-config\") pod \"b952e891-bca8-4d99-a338-a42765ea812b\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " machine # [ 66.600588] k3s[887]: I0921 14:44:36.364205 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-tmp\") pod \"b952e891-bca8-4d99-a338-a42765ea812b\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " machine # [ 66.605166] k3s[887]: I0921 14:44:36.364233 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-values\" (UniqueName: \"kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-values\") pod \"b952e891-bca8-4d99-a338-a42765ea812b\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " machine # [ 66.605546] k3s[887]: I0921 14:44:36.364265 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-helm\") pod \"b952e891-bca8-4d99-a338-a42765ea812b\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " machine # [ 66.606199] k3s[887]: I0921 14:44:36.364291 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-kube-api-access-fxkf2\" (UniqueName: \"kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-kube-api-access-fxkf2\") pod \"b952e891-bca8-4d99-a338-a42765ea812b\" (UID: \"b952e891-bca8-4d99-a338-a42765ea812b\") " machine # [ 66.606714] k3s[887]: I0921 14:44:36.364475 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b952e891-bca8-4d99-a338-a42765ea812b-content" pod "b952e891-bca8-4d99-a338-a42765ea812b" (UID: "b952e891-bca8-4d99-a338-a42765ea812b"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 66.607394] k3s[887]: I0921 14:44:36.371902 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-tmp" pod "b952e891-bca8-4d99-a338-a42765ea812b" (UID: "b952e891-bca8-4d99-a338-a42765ea812b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 66.607833] k3s[887]: I0921 14:44:36.374591 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-kube-api-access-fxkf2" pod "b952e891-bca8-4d99-a338-a42765ea812b" (UID: "b952e891-bca8-4d99-a338-a42765ea812b"). InnerVolumeSpecName "kube-api-access-fxkf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 66.608505] k3s[887]: I0921 14:44:36.374784 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-values" pod "b952e891-bca8-4d99-a338-a42765ea812b" (UID: "b952e891-bca8-4d99-a338-a42765ea812b"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 66.609489] systemd[1]: var-lib-kubelet-pods-b952e891\x2dbca8\x2d4d99\x2da338\x2da42765ea812b-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 66.610298] k3s[887]: I0921 14:44:36.385753 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-helm" pod "b952e891-bca8-4d99-a338-a42765ea812b" (UID: "b952e891-bca8-4d99-a338-a42765ea812b"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 66.610962] k3s[887]: I0921 14:44:36.385856 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-cache" pod "b952e891-bca8-4d99-a338-a42765ea812b" (UID: "b952e891-bca8-4d99-a338-a42765ea812b"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 66.611770] k3s[887]: I0921 14:44:36.385949 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-config" pod "b952e891-bca8-4d99-a338-a42765ea812b" (UID: "b952e891-bca8-4d99-a338-a42765ea812b"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 66.612416] systemd[1]: var-lib-kubelet-pods-b952e891\x2dbca8\x2d4d99\x2da338\x2da42765ea812b-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 66.613057] systemd[1]: var-lib-kubelet-pods-b952e891\x2dbca8\x2d4d99\x2da338\x2da42765ea812b-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dfxkf2.mount: Deactivated successfully. machine # [ 66.685253] k3s[887]: I0921 14:44:36.465050 887 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 66.685458] k3s[887]: I0921 14:44:36.465084 887 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-values\") on node \"machine\" DevicePath \"\"" machine # [ 66.685741] k3s[887]: I0921 14:44:36.465099 887 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 66.686635] k3s[887]: I0921 14:44:36.465129 887 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxkf2\" (UniqueName: \"kubernetes.io/projected/b952e891-bca8-4d99-a338-a42765ea812b-kube-api-access-fxkf2\") on node \"machine\" DevicePath \"\"" machine # [ 66.687507] k3s[887]: I0921 14:44:36.465141 887 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/b952e891-bca8-4d99-a338-a42765ea812b-content\") on node \"machine\" DevicePath \"\"" machine # [ 66.688040] k3s[887]: I0921 14:44:36.465153 887 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 66.688342] k3s[887]: I0921 14:44:36.465165 887 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/b952e891-bca8-4d99-a338-a42765ea812b-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 66.737452] dhcpcd[698]: vethc1ae2496: soliciting an IPv6 router machine # [ 66.772379] systemd[1]: Started libcontainer container 2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc. machine # [ 66.971930] dhcpcd[698]: veth23b06570: soliciting an IPv6 router machine # [ 67.079898] k3s[887]: I0921 14:44:36.859725 887 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0285cf2078c84225a8fa06511c5f6f77b494cec4d1f12eafde906058c427c0d4" machine # [ 67.089088] k3s[887]: I0921 14:44:36.868406 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-zstrv" podStartSLOduration=2.868384522 podStartE2EDuration="2.868384522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 14:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 14:44:36.867128776 +0000 UTC m=+49.645827608" watchObservedRunningTime="2026-09-21 14:44:36.868384522 +0000 UTC m=+49.647082795" machine # [ 67.096641] systemd[1]: Removed slice libcontainer container kubepods-burstable-podb952e891_bca8_4d99_a338_a42765ea812b.slice. machine # [ 67.098748] systemd[1]: kubepods-burstable-podb952e891_bca8_4d99_a338_a42765ea812b.slice: Consumed 1.146s CPU time over 32.294s wall clock time, 32.1M memory peak, 2.4M incoming IP traffic, 140.9K outgoing IP traffic. machine # [ 67.209763] systemd[1]: var-lib-kubelet-pods-b952e891\x2dbca8\x2d4d99\x2da338\x2da42765ea812b-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 67.210028] systemd[1]: var-lib-kubelet-pods-b952e891\x2dbca8\x2d4d99\x2da338\x2da42765ea812b-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 67.211306] systemd[1]: var-lib-kubelet-pods-b952e891\x2dbca8\x2d4d99\x2da338\x2da42765ea812b-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 67.308921] dhcpcd[698]: vethb3a7b8fa: soliciting an IPv6 router machine # [ 70.293836] dhcpcd[698]: veth23b06570: probing for an IPv4LL address machine # [ 70.920747] dhcpcd[698]: vethb3a7b8fa: probing for an IPv4LL address machine # [ 71.013150] dhcpcd[698]: veth21b3f44a: probing for an IPv4LL address machine # [ 71.030385] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2929795719.mount: Deactivated successfully. machine # [ 71.046722] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount493203792.mount: Deactivated successfully. machine # [ 71.094616] systemd[1]: Started libcontainer container 6b962953c04ddf424e42de5e196cd08c95886f8d683933472bc6dd0a87cbe8cd. machine # [ 71.096509] systemd[1]: Started libcontainer container e40d01ddcd828040cebc270a54bf926043981bd93bf1ca89556141cb268eb02e. machine # [ 71.101650] systemd[1]: Started libcontainer container b6d0a4be63135c01444f29448ad64df11bb81514c54c10af11b93505cc8c612f. machine # [ 71.231454] dhcpcd[698]: vethc1ae2496: probing for an IPv4LL address machine # [ 71.389913] niks3-server[1192]: 2026/09/21 14:44:41 INFO lead: acquired remote=10.42.0.4:46910 machine # [ 72.143386] k3s[887]: I0921 14:44:41.921794 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-kgnf9" podStartSLOduration=7.921764211 podStartE2EDuration="7.921764211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 14:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 14:44:41.920234687 +0000 UTC m=+54.698932681" watchObservedRunningTime="2026-09-21 14:44:41.921764211 +0000 UTC m=+54.700462205" machine # [ 73.127508] systemd[1]: cri-containerd-e40d01ddcd828040cebc270a54bf926043981bd93bf1ca89556141cb268eb02e.scope: Deactivated successfully. machine # [ 73.130648] systemd[1]: cri-containerd-e40d01ddcd828040cebc270a54bf926043981bd93bf1ca89556141cb268eb02e.scope: Consumed 760ms CPU time over 2.032s wall clock time, 340.2M memory peak, 85.3M read from disk, 183.3M written to disk. machine # [ 73.133506] systemd[1]: cri-containerd-b6d0a4be63135c01444f29448ad64df11bb81514c54c10af11b93505cc8c612f.scope: Deactivated successfully. machine # [ 73.135279] systemd[1]: cri-containerd-b6d0a4be63135c01444f29448ad64df11bb81514c54c10af11b93505cc8c612f.scope: Consumed 743ms CPU time over 2.029s wall clock time, 349.9M memory peak, 88.7M read from disk, 183.3M written to disk. machine # [ 73.184693] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-b6d0a4be63135c01444f29448ad64df11bb81514c54c10af11b93505cc8c612f-rootfs.mount: Deactivated successfully. machine # [ 73.186907] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e40d01ddcd828040cebc270a54bf926043981bd93bf1ca89556141cb268eb02e-rootfs.mount: Deactivated successfully. machine # [ 74.147492] k3s[887]: E0921 14:44:43.924532 887 watch.go:301] "Unhandled Error" err="http2: stream closed" logger="UnhandledError" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 47.36 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 74.223451] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount82492712.mount: Deactivated successfully. machine # [ 74.226950] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2448738989.mount: Deactivated successfully. machine # [ 74.230831] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount797867089.mount: Deactivated successfully. machine # [ 74.273338] systemd[1]: Started libcontainer container 29faeac771843d7de64365cfba9d7fbb8271874f91e3a563e51c1e56a94b070e. machine # [ 74.275955] systemd[1]: Started libcontainer container 900716afcb1c4ad8531a7a29ab343ce830ff28659cd83dd132f0b068847ce114. machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 0.24 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 74.418668] systemd[1]: Started libcontainer container 7835013643fc72e1991654b5e55f3067b7e9d103b11a3fd46885841d6125dbc8. machine # [ 74.458469] systemd[1]: Started libcontainer container 9d8e5fc29dc0cd2c2319e4f7d9bfe7701e027bbb5458593fe16fb249e316b0f1. machine # [ 74.552845] systemd[1]: Started libcontainer container 4d8339f31be2998e730f3832192c465e49ea32e059af974287ddb7c11e7ef062. machine # [ 74.604438] systemd[1]: Started libcontainer container 1ba9061a5e5dbd1689ebfdee216a8648c5efba1d4692e011bb76fab569096ee5. machine # [ 75.219264] k3s[887]: I0921 14:44:44.998156 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n" podStartSLOduration=9.001858189 podStartE2EDuration="10.998122239s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.99626405s" isStatefulPod=false podCreationTimestamp="2026-09-21 14:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 14:44:44.998058544 +0000 UTC m=+57.776759890" watchObservedRunningTime="2026-09-21 14:44:44.998122239 +0000 UTC m=+57.776823027" machine # [ 75.231127] k3s[887]: I0921 14:44:44.998323 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw" podStartSLOduration=9.003751167 podStartE2EDuration="10.998303547s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.99455238s" isStatefulPod=false podCreationTimestamp="2026-09-21 14:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 14:44:44.970658693 +0000 UTC m=+57.749361715" watchObservedRunningTime="2026-09-21 14:44:44.998303547 +0000 UTC m=+57.777004614" machine # [ 75.662797] dhcpcd[698]: vethb3a7b8fa: using IPv4LL address 169.254.17.136 machine # [ 75.665352] dhcpcd[698]: vethb3a7b8fa: adding route to 169.254.0.0/16 machine # [ 76.098225] dhcpcd[698]: veth23b06570: using IPv4LL address 169.254.150.103 machine # [ 76.099166] dhcpcd[698]: veth23b06570: adding route to 169.254.0.0/16 machine # [ 76.148242] dhcpcd[698]: veth21b3f44a: using IPv4LL address 169.254.248.230 machine # [ 76.150731] dhcpcd[698]: veth21b3f44a: adding route to 169.254.0.0/16 machine # [ 76.248215] dhcpcd[698]: vethc1ae2496: using IPv4LL address 169.254.54.185 machine # [ 76.250809] dhcpcd[698]: vethc1ae2496: adding route to 169.254.0.0/16 machine # [ 78.540417] dhcpcd[698]: veth21b3f44a: no IPv6 Routers available machine # [ 78.739527] dhcpcd[698]: vethc1ae2496: no IPv6 Routers available machine # [ 78.974347] dhcpcd[698]: veth23b06570: no IPv6 Routers available machine # [ 79.312283] dhcpcd[698]: vethb3a7b8fa: no IPv6 Routers available machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 5.88 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.04 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.32 seconds) machine: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.5:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 2.19 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.23 seconds) machine: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.4:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.05 seconds) (finished: subtest: chart deploys and workers become Ready, in 56.31 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.21 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.14 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1 machine # [ 120.126852] niks3-server[1192]: 2026/09/21 14:45:29 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 120.152386] niks3-server[1192]: 2026/09/21 14:45:29 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 120.154606] niks3-server[1192]: 2026/09/21 14:45:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 120.156262] niks3-server[1192]: 2026/09/21 14:45:29 INFO Signed narinfos id=1 count=1 machine # [ 120.161912] niks3-server[1192]: 2026/09/21 14:45:29 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 120.164457] niks3-server[1192]: 2026/09/21 14:45:29 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 120.168535] niks3-server[1192]: 2026/09/21 14:45:29 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 120.172818] niks3-server[1192]: 2026/09/21 14:45:29 INFO Completed upload id=1 machine # [ 145.261646] niks3-server[1192]: 2026/09/21 14:45:55 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 145.282779] niks3-server[1192]: 2026/09/21 14:45:55 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 145.283779] niks3-server[1192]: 2026/09/21 14:45:55 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 145.293199] niks3-server[1192]: 2026/09/21 14:45:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 145.294214] niks3-server[1192]: 2026/09/21 14:45:55 INFO Signed narinfos id=2 count=1 machine # [ 145.301895] niks3-server[1192]: 2026/09/21 14:45:55 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 145.305534] niks3-server[1192]: 2026/09/21 14:45:55 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 145.310480] niks3-server[1192]: 2026/09/21 14:45:55 INFO Completed upload id=2 machine # [ 145.311640] niks3-server[1192]: 2026/09/21 14:45:55 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 145.393864] niks3-server[1192]: 2026/09/21 14:45:55 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 145.406773] niks3-server[1192]: 2026/09/21 14:45:55 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 145.407177] niks3-server[1192]: 2026/09/21 14:45:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 145.408148] niks3-server[1192]: 2026/09/21 14:45:55 INFO Signed narinfos id=3 count=1 machine # [ 145.409985] niks3-server[1192]: 2026/09/21 14:45:55 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 145.416272] niks3-server[1192]: 2026/09/21 14:45:55 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 145.418726] niks3-server[1192]: 2026/09/21 14:45:55 INFO Completed upload id=3 machine # [ 145.419896] niks3-server[1192]: 2026/09/21 14:45:55 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 169.924525] niks3-server[1192]: 2026/09/21 14:46:19 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 169.947206] niks3-server[1192]: 2026/09/21 14:46:19 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 169.949112] niks3-server[1192]: 2026/09/21 14:46:19 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 169.950948] niks3-server[1192]: 2026/09/21 14:46:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 169.953315] niks3-server[1192]: 2026/09/21 14:46:19 INFO Signed narinfos id=4 count=1 machine # [ 169.956060] niks3-server[1192]: 2026/09/21 14:46:19 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 169.961140] niks3-server[1192]: 2026/09/21 14:46:19 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 169.964063] niks3-server[1192]: 2026/09/21 14:46:19 INFO Completed upload id=4 machine # [ 169.969661] niks3-server[1192]: 2026/09/21 14:46:19 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 170.050744] niks3-server[1192]: 2026/09/21 14:46:19 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 170.064895] niks3-server[1192]: 2026/09/21 14:46:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 170.065356] niks3-server[1192]: 2026/09/21 14:46:19 INFO Signed narinfos id=5 count=1 machine # [ 170.066193] niks3-server[1192]: 2026/09/21 14:46:19 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 170.076708] niks3-server[1192]: 2026/09/21 14:46:19 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 170.079487] niks3-server[1192]: 2026/09/21 14:46:19 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 170.081694] niks3-server[1192]: 2026/09/21 14:46:19 INFO Completed upload id=5 machine # [ 170.084282] niks3-server[1192]: 2026/09/21 14:46:19 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 194.783095] niks3-server[1192]: 2026/09/21 14:46:44 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 194.798839] niks3-server[1192]: 2026/09/21 14:46:44 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 194.803492] niks3-server[1192]: 2026/09/21 14:46:44 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 194.809578] niks3-server[1192]: 2026/09/21 14:46:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 194.813746] niks3-server[1192]: 2026/09/21 14:46:44 INFO Signed narinfos id=6 count=1 machine # [ 194.814392] niks3-server[1192]: 2026/09/21 14:46:44 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 194.819702] niks3-server[1192]: 2026/09/21 14:46:44 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 194.822194] niks3-server[1192]: 2026/09/21 14:46:44 INFO Completed upload id=6 machine # [ 194.823163] niks3-server[1192]: 2026/09/21 14:46:44 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 2>&1, in 111.39 seconds) machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t1 outPath, in 0.12 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.01 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.18 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1 machine # [ 220.105601] niks3-server[1192]: 2026/09/21 14:47:09 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 220.126705] niks3-server[1192]: 2026/09/21 14:47:09 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 220.127993] niks3-server[1192]: 2026/09/21 14:47:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 220.130338] niks3-server[1192]: 2026/09/21 14:47:09 INFO Signed narinfos id=7 count=1 machine # [ 220.135507] niks3-server[1192]: 2026/09/21 14:47:09 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 220.143604] niks3-server[1192]: 2026/09/21 14:47:09 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 220.148359] niks3-server[1192]: 2026/09/21 14:47:09 INFO Completed upload id=7 machine # [ 220.152844] niks3-server[1192]: 2026/09/21 14:47:09 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 244.443699] niks3-server[1192]: 2026/09/21 14:47:34 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 244.464152] niks3-server[1192]: 2026/09/21 14:47:34 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 244.467540] niks3-server[1192]: 2026/09/21 14:47:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 244.469247] niks3-server[1192]: 2026/09/21 14:47:34 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 244.470940] niks3-server[1192]: 2026/09/21 14:47:34 INFO Signed narinfos id=8 count=1 machine # [ 244.476910] niks3-server[1192]: 2026/09/21 14:47:34 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 244.484168] niks3-server[1192]: 2026/09/21 14:47:34 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 244.486696] niks3-server[1192]: 2026/09/21 14:47:34 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 244.488821] niks3-server[1192]: 2026/09/21 14:47:34 INFO Completed upload id=8 machine # [ 244.567149] niks3-server[1192]: 2026/09/21 14:47:34 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 244.582371] niks3-server[1192]: 2026/09/21 14:47:34 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 244.584354] niks3-server[1192]: 2026/09/21 14:47:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 244.586032] niks3-server[1192]: 2026/09/21 14:47:34 INFO Signed narinfos id=9 count=1 machine # [ 244.587461] niks3-server[1192]: 2026/09/21 14:47:34 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 244.589693] niks3-server[1192]: 2026/09/21 14:47:34 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 244.591179] niks3-server[1192]: 2026/09/21 14:47:34 INFO Completed upload id=9 machine # [ 269.095617] niks3-server[1192]: 2026/09/21 14:47:58 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 269.111626] niks3-server[1192]: 2026/09/21 14:47:58 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 269.112892] niks3-server[1192]: 2026/09/21 14:47:58 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 269.115874] niks3-server[1192]: 2026/09/21 14:47:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 269.117643] niks3-server[1192]: 2026/09/21 14:47:58 INFO Signed narinfos id=10 count=1 machine # [ 269.121763] niks3-server[1192]: 2026/09/21 14:47:58 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 269.127122] niks3-server[1192]: 2026/09/21 14:47:58 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 269.131630] niks3-server[1192]: 2026/09/21 14:47:58 INFO Completed upload id=10 machine # [ 269.137359] niks3-server[1192]: 2026/09/21 14:47:58 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 269.217708] niks3-server[1192]: 2026/09/21 14:47:58 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 269.232431] niks3-server[1192]: 2026/09/21 14:47:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 269.233267] niks3-server[1192]: 2026/09/21 14:47:59 INFO Signed narinfos id=11 count=1 machine # [ 269.235505] niks3-server[1192]: 2026/09/21 14:47:59 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 269.239844] niks3-server[1192]: 2026/09/21 14:47:59 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 269.243505] niks3-server[1192]: 2026/09/21 14:47:59 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 269.244813] niks3-server[1192]: 2026/09/21 14:47:59 INFO Completed upload id=11 machine # [ 269.246597] niks3-server[1192]: 2026/09/21 14:47:59 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 293.955371] niks3-server[1192]: 2026/09/21 14:48:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 293.971794] niks3-server[1192]: 2026/09/21 14:48:23 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 293.980399] niks3-server[1192]: 2026/09/21 14:48:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 293.981709] niks3-server[1192]: 2026/09/21 14:48:23 INFO Signed narinfos id=12 count=1 machine # [ 293.983292] niks3-server[1192]: 2026/09/21 14:48:23 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 293.989901] niks3-server[1192]: 2026/09/21 14:48:23 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 293.993376] niks3-server[1192]: 2026/09/21 14:48:23 INFO Completed upload id=12 machine # [ 293.996153] niks3-server[1192]: 2026/09/21 14:48:23 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t2 2>&1, in 99.87 seconds) (finished: subtest: build through the balancer lands in the cache, in 211.58 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt, in 0.22 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --from-file=flake.nix=/nix/store/x8s8k9cql05dy59sjsy1ih3fnyg9zksh-flake.nix, in 0.15 seconds) machine: must succeed: kubectl apply -f /nix/store/r1c20r6fvmcx0m38prrp0nbq0k6mls0f-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/r1c20r6fvmcx0m38prrp0nbq0k6mls0f-ci-job.json, in 0.17 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 295.664907] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod1696e9bd_daff_4363_a054_cf0689a9d4bd.slice. machine # [ 295.733767] k3s[887]: I0921 14:48:25.513278 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2tc\" (UniqueName: \"kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-kube-api-access-kd2tc\") pod \"ci-gwd56\" (UID: \"1696e9bd-daff-4363-a054-cf0689a9d4bd\") " pod="ci/ci-gwd56" machine # [ 295.737760] k3s[887]: I0921 14:48:25.513436 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/1696e9bd-daff-4363-a054-cf0689a9d4bd-job\") pod \"ci-gwd56\" (UID: \"1696e9bd-daff-4363-a054-cf0689a9d4bd\") " pod="ci/ci-gwd56" machine # [ 295.741366] k3s[887]: I0921 14:48:25.513468 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-nix-grpc-farm\") pod \"ci-gwd56\" (UID: \"1696e9bd-daff-4363-a054-cf0689a9d4bd\") " pod="ci/ci-gwd56" machine # [ 296.162738] cni0: port 1(veth9bfb3c67) entered blocking state machine # [ 296.164399] cni0: port 1(veth9bfb3c67) entered disabled state machine # [ 296.167020] veth9bfb3c67: entered allmulticast mode machine # [ 296.169329] veth9bfb3c67: entered promiscuous mode machine # [ 296.187962] cni0: port 1(veth9bfb3c67) entered blocking state machine # [ 296.190155] cni0: port 1(veth9bfb3c67) entered forwarding state machine # [ 296.083540] (udev-worker)[5301]: Network interface NamePolicy= disabled on kernel command line. machine # [ 296.110064] dhcpcd[698]: veth9bfb3c67: IAID 52:b6:88:58 machine # [ 296.110483] dhcpcd[698]: veth9bfb3c67: adding address fe80::30a1:52ff:feb6:8858 machine # [ 296.134262] systemd[1]: Started libcontainer container 866bbcb6b8aef2d72e7bc2afd043c92361895b05e5d3bf7b12a8ac9a26ed6df1. machine # [ 296.807232] dhcpcd[698]: veth9bfb3c67: soliciting a DHCP lease machine # [ 297.990353] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1073836087.mount: Deactivated successfully. machine # [ 298.044311] systemd[1]: Started libcontainer container 11c11c5892c7abe4c870eddeb98e0d631945ede526dcd2a7915c0b0da67a605b. machine # [ 298.213157] dhcpcd[698]: veth9bfb3c67: soliciting an IPv6 router machine # [ 298.996108] k3s[887]: I0921 14:48:28.775063 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-gwd56" podStartSLOduration=3.775022909 podStartE2EDuration="3.775022909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 14:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 14:48:28.774736001 +0000 UTC m=+281.553439303" watchObservedRunningTime="2026-09-21 14:48:28.775022909 +0000 UTC m=+281.553725652" machine # [ 299.393577] niks3-server[1192]: 2026/09/21 14:48:29 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 299.404787] niks3-server[1192]: 2026/09/21 14:48:29 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 299.406795] niks3-server[1192]: 2026/09/21 14:48:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 299.408523] niks3-server[1192]: 2026/09/21 14:48:29 INFO Signed narinfos id=13 count=1 machine # [ 299.410179] niks3-server[1192]: 2026/09/21 14:48:29 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 299.412672] niks3-server[1192]: 2026/09/21 14:48:29 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 299.414982] niks3-server[1192]: 2026/09/21 14:48:29 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 299.417949] niks3-server[1192]: 2026/09/21 14:48:29 INFO Completed upload id=13 machine # [ 301.808227] dhcpcd[698]: veth9bfb3c67: probing for an IPv4LL address machine # [ 306.179771] dhcpcd[698]: veth9bfb3c67: using IPv4LL address 169.254.8.134 machine # [ 306.180264] dhcpcd[698]: veth9bfb3c67: adding route to 169.254.0.0/16 machine # [ 310.157142] postgres[760]: [760] LOG: checkpoint starting: time machine # [ 310.226940] dhcpcd[698]: veth9bfb3c67: no IPv6 Routers available machine # [ 323.921691] niks3-server[1192]: 2026/09/21 14:48:53 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 323.939908] niks3-server[1192]: 2026/09/21 14:48:53 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 323.944104] niks3-server[1192]: 2026/09/21 14:48:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 323.945786] niks3-server[1192]: 2026/09/21 14:48:53 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 323.947464] niks3-server[1192]: 2026/09/21 14:48:53 INFO Signed narinfos id=14 count=1 machine # [ 323.951114] niks3-server[1192]: 2026/09/21 14:48:53 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 323.957583] niks3-server[1192]: 2026/09/21 14:48:53 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 323.959862] niks3-server[1192]: 2026/09/21 14:48:53 INFO Completed upload id=14 machine # [ 323.962834] niks3-server[1192]: 2026/09/21 14:48:53 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 324.038723] niks3-server[1192]: 2026/09/21 14:48:53 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 324.049871] niks3-server[1192]: 2026/09/21 14:48:53 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 324.050475] niks3-server[1192]: 2026/09/21 14:48:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 324.051527] niks3-server[1192]: 2026/09/21 14:48:53 INFO Signed narinfos id=15 count=1 machine # [ 324.055706] niks3-server[1192]: 2026/09/21 14:48:53 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 324.058462] niks3-server[1192]: 2026/09/21 14:48:53 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 324.061423] niks3-server[1192]: 2026/09/21 14:48:53 INFO Completed upload id=15 machine # [ 324.064232] niks3-server[1192]: 2026/09/21 14:48:53 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 349.363339] niks3-server[1192]: 2026/09/21 14:49:19 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 349.380561] niks3-server[1192]: 2026/09/21 14:49:19 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 349.382117] niks3-server[1192]: 2026/09/21 14:49:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 349.383220] niks3-server[1192]: 2026/09/21 14:49:19 INFO Signed narinfos id=16 count=1 machine # [ 349.385375] niks3-server[1192]: 2026/09/21 14:49:19 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 349.387772] niks3-server[1192]: 2026/09/21 14:49:19 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 349.392467] niks3-server[1192]: 2026/09/21 14:49:19 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 349.396635] niks3-server[1192]: 2026/09/21 14:49:19 INFO Completed upload id=16 machine # [ 349.402245] niks3-server[1192]: 2026/09/21 14:49:19 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 349.487688] niks3-server[1192]: 2026/09/21 14:49:19 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 349.502750] niks3-server[1192]: 2026/09/21 14:49:19 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 349.506939] niks3-server[1192]: 2026/09/21 14:49:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 349.507528] niks3-server[1192]: 2026/09/21 14:49:19 INFO Signed narinfos id=17 count=1 machine # [ 349.510418] niks3-server[1192]: 2026/09/21 14:49:19 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 349.518061] niks3-server[1192]: 2026/09/21 14:49:19 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 349.519790] niks3-server[1192]: 2026/09/21 14:49:19 INFO Completed upload id=17 machine # [ 374.408207] niks3-server[1192]: 2026/09/21 14:49:44 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 374.420558] niks3-server[1192]: 2026/09/21 14:49:44 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 374.423510] niks3-server[1192]: 2026/09/21 14:49:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 374.425223] niks3-server[1192]: 2026/09/21 14:49:44 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 374.427174] niks3-server[1192]: 2026/09/21 14:49:44 INFO Signed narinfos id=18 count=1 machine # [ 374.428445] niks3-server[1192]: 2026/09/21 14:49:44 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 374.430292] niks3-server[1192]: 2026/09/21 14:49:44 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 374.434541] niks3-server[1192]: 2026/09/21 14:49:44 INFO Completed upload id=18 machine # [ 374.435699] niks3-server[1192]: 2026/09/21 14:49:44 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 377.125364] niks3-server[1192]: 2026/09/21 14:49:46 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 377.143724] niks3-server[1192]: 2026/09/21 14:49:46 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 377.146227] niks3-server[1192]: 2026/09/21 14:49:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 377.148316] niks3-server[1192]: 2026/09/21 14:49:46 INFO Signed narinfos id=19 count=1 machine # [ 377.150217] niks3-server[1192]: 2026/09/21 14:49:46 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 377.157187] niks3-server[1192]: 2026/09/21 14:49:46 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 377.160554] niks3-server[1192]: 2026/09/21 14:49:46 INFO Completed upload id=19 machine # [ 377.163837] niks3-server[1192]: 2026/09/21 14:49:46 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 401.469711] niks3-server[1192]: 2026/09/21 14:50:11 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 401.484677] niks3-server[1192]: 2026/09/21 14:50:11 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 401.490357] niks3-server[1192]: 2026/09/21 14:50:11 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 401.495430] niks3-server[1192]: 2026/09/21 14:50:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 401.500151] niks3-server[1192]: 2026/09/21 14:50:11 INFO Signed narinfos id=20 count=1 machine # [ 401.503375] niks3-server[1192]: 2026/09/21 14:50:11 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 401.507910] niks3-server[1192]: 2026/09/21 14:50:11 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 401.512103] niks3-server[1192]: 2026/09/21 14:50:11 INFO Completed upload id=20 machine # [ 401.514548] niks3-server[1192]: 2026/09/21 14:50:11 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 401.633943] systemd[1]: cri-containerd-11c11c5892c7abe4c870eddeb98e0d631945ede526dcd2a7915c0b0da67a605b.scope: Deactivated successfully. machine # [ 401.636682] systemd[1]: cri-containerd-11c11c5892c7abe4c870eddeb98e0d631945ede526dcd2a7915c0b0da67a605b.scope: Consumed 922ms CPU time over 1min 43.590s wall clock time, 111.1M memory peak, 41.8M read from disk, 428K written to disk, 16.4K incoming IP traffic, 44.1K outgoing IP traffic. machine # [ 401.672955] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-11c11c5892c7abe4c870eddeb98e0d631945ede526dcd2a7915c0b0da67a605b-rootfs.mount: Deactivated successfully. machine # [ 403.374132] systemd[1]: cri-containerd-866bbcb6b8aef2d72e7bc2afd043c92361895b05e5d3bf7b12a8ac9a26ed6df1.scope: Deactivated successfully. machine # [ 403.434465] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-866bbcb6b8aef2d72e7bc2afd043c92361895b05e5d3bf7b12a8ac9a26ed6df1-rootfs.mount: Deactivated successfully. machine # [ 403.476213] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-866bbcb6b8aef2d72e7bc2afd043c92361895b05e5d3bf7b12a8ac9a26ed6df1-shm.mount: Deactivated successfully. machine # [ 403.672412] cni0: port 1(veth9bfb3c67) entered disabled state machine # [ 403.523164] dhcpcd[698]: veth[ 403.675431] veth9bfb3c67 (unregistering): left allmulticast mode machine # 9bfb3c67: carrier lost machine # [ 403.676735] veth9bfb3c67 (unregistering): left promiscuous mode machine # [ 403.677795] cni0: port 1(veth9bfb3c67) entered disabled state machine # [ 403.546751] systemd[1]: run-netns-cni\x2d517c3f57\x2de716\x2d7fcb\x2da580\x2d12ee0fbbe5e6.mount: Deactivated successfully. machine # [ 403.562854] dhcpcd[698]: veth9bfb3c67: deleting address fe80::30a1:52ff:feb6:8858 machine # [ 403.565259] dhcpcd[698]: veth9bfb3c67: deleting route to 169.254.0.0/16 machine # [ 403.570047] k3s[887]: I0921 14:50:13.349572 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-nix-grpc-farm\") pod \"1696e9bd-daff-4363-a054-cf0689a9d4bd\" (UID: \"1696e9bd-daff-4363-a054-cf0689a9d4bd\") " machine # [ 403.574361] k3s[887]: I0921 14:50:13.349741 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-kube-api-access-kd2tc\" (UniqueName: \"kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-kube-api-access-kd2tc\") pod \"1696e9bd-daff-4363-a054-cf0689a9d4bd\" (UID: \"1696e9bd-daff-4363-a054-cf0689a9d4bd\") " machine # [ 403.578849] k3s[887]: I0921 14:50:13.349831 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1696e9bd-daff-4363-a054-cf0689a9d4bd-job\" (UniqueName: \"kubernetes.io/configmap/1696e9bd-daff-4363-a054-cf0689a9d4bd-job\") pod \"1696e9bd-daff-4363-a054-cf0689a9d4bd\" (UID: \"1696e9bd-daff-4363-a054-cf0689a9d4bd\") " machine # [ 403.582838] k3s[887]: I0921 14:50:13.350429 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1696e9bd-daff-4363-a054-cf0689a9d4bd-job" pod "1696e9bd-daff-4363-a054-cf0689a9d4bd" (UID: "1696e9bd-daff-4363-a054-cf0689a9d4bd"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 403.586725] k3s[887]: I0921 14:50:13.355046 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-kube-api-access-kd2tc" pod "1696e9bd-daff-4363-a054-cf0689a9d4bd" (UID: "1696e9bd-daff-4363-a054-cf0689a9d4bd"). InnerVolumeSpecName "kube-api-access-kd2tc". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 403.590860] k3s[887]: I0921 14:50:13.355141 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-nix-grpc-farm" pod "1696e9bd-daff-4363-a054-cf0689a9d4bd" (UID: "1696e9bd-daff-4363-a054-cf0689a9d4bd"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 403.594806] systemd[1]: var-lib-kubelet-pods-1696e9bd\x2ddaff\x2d4363\x2da054\x2dcf0689a9d4bd-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 403.596829] systemd[1]: var-lib-kubelet-pods-1696e9bd\x2ddaff\x2d4363\x2da054\x2dcf0689a9d4bd-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dkd2tc.mount: Deactivated successfully. machine # [ 403.633352] dhcpcd[698]: veth9bfb3c67: removing interface machine # [ 403.670622] k3s[887]: I0921 14:50:13.450449 887 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd2tc\" (UniqueName: \"kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-kube-api-access-kd2tc\") on node \"machine\" DevicePath \"\"" machine # [ 403.670929] k3s[887]: I0921 14:50:13.450477 887 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/1696e9bd-daff-4363-a054-cf0689a9d4bd-job\") on node \"machine\" DevicePath \"\"" machine # [ 403.671397] k3s[887]: I0921 14:50:13.450491 887 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/1696e9bd-daff-4363-a054-cf0689a9d4bd-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 403.878698] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod1696e9bd_daff_4363_a054_cf0689a9d4bd.slice. machine # [ 403.879625] systemd[1]: kubepods-besteffort-pod1696e9bd_daff_4363_a054_cf0689a9d4bd.slice: Consumed 951ms CPU time over 1min 48.213s wall clock time, 111.4M memory peak, 41.8M read from disk, 632K written to disk, 16.4K incoming IP traffic, 44.1K outgoing IP traffic. machine # [ 404.355714] k3s[887]: I0921 14:50:14.135462 887 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="866bbcb6b8aef2d72e7bc2afd043c92361895b05e5d3bf7b12a8ac9a26ed6df1" machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 109.92 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.13 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpryyjf0m5/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (25s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag ci outPath, in 0.14 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.04 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 111.04 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.crt --key=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.27 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.30 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-zstrv -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 406.942098] k3s[887]: E0921 14:50:16.721532 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58394: use of closed network connection machine # [ 408.194856] k3s[887]: E0921 14:50:17.974253 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58438: use of closed network connection machine # [ 409.441508] k3s[887]: E0921 14:50:19.220725 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58462: use of closed network connection machine # [ 410.695736] k3s[887]: E0921 14:50:20.475221 887 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:53896->127.0.0.1:10010: write tcp 127.0.0.1:53896->127.0.0.1:10010: write: broken pipe machine # [ 410.696365] k3s[887]: time="2026-09-21T14:50:20Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:33756->127.0.0.1:10250: read: connection reset by peer" machine # [ 410.697094] k3s[887]: E0921 14:50:20.475582 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58484: use of closed network connection machine # [ 412.001432] k3s[887]: E0921 14:50:21.780844 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:58524: use of closed network connection machine # [ 413.250117] k3s[887]: E0921 14:50:23.029545 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60288: use of closed network connection machine # [ 414.126149] postgres[760]: [760] LOG: checkpoint complete: wrote 1037 buffers (6.3%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=103.879 s, sync=0.054 s, total=103.969 s; sync files=364, longest=0.004 s, average=0.001 s; distance=4969 kB, estimate=4969 kB; lsn=0/1C73BF0, redo lsn=0/1C40750 machine # [ 414.495621] k3s[887]: E0921 14:50:24.274795 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60326: use of closed network connection machine # [ 415.762531] k3s[887]: E0921 14:50:25.541674 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60346: use of closed network connection machine # [ 417.031472] k3s[887]: E0921 14:50:26.810600 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60368: use of closed network connection machine # [ 418.270055] k3s[887]: E0921 14:50:28.049508 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60374: use of closed network connection machine # [ 419.505351] k3s[887]: E0921 14:50:29.283664 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60390: use of closed network connection machine # [ 420.768177] k3s[887]: E0921 14:50:30.547271 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60416: use of closed network connection machine # [ 420.771172] k3s[887]: E0921 14:50:30.547647 887 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:40894->127.0.0.1:10010: write tcp 127.0.0.1:40894->127.0.0.1:10010: write: broken pipe machine # [ 422.029759] k3s[887]: E0921 14:50:31.809245 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60448: use of closed network connection machine # [ 423.336197] k3s[887]: E0921 14:50:33.114522 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:32910: use of closed network connection machine # [ 425.836859] k3s[887]: E0921 14:50:35.615671 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:32962: use of closed network connection machine # [ 427.078390] k3s[887]: E0921 14:50:36.857465 887 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:57438->127.0.0.1:10010: write tcp 127.0.0.1:57438->127.0.0.1:10010: write: broken pipe machine # [ 427.079418] k3s[887]: E0921 14:50:36.857601 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:32976: use of closed network connection machine # [ 427.080292] k3s[887]: time="2026-09-21T14:50:36Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:50634->127.0.0.1:10250: read: connection reset by peer" machine # [ 428.336871] k3s[887]: E0921 14:50:38.116220 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:32994: use of closed network connection machine # [ 429.576202] k3s[887]: time="2026-09-21T14:50:39Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:50650->127.0.0.1:10250: read: connection reset by peer" machine # [ 429.576696] k3s[887]: time="2026-09-21T14:50:39Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:50650->127.0.0.1:10250: write: broken pipe" machine # [ 429.577879] k3s[887]: E0921 14:50:39.354574 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33010: use of closed network connection machine # [ 430.864297] k3s[887]: E0921 14:50:40.643462 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33026: use of closed network connection machine # [ 432.131583] k3s[887]: E0921 14:50:41.910934 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:33062: use of closed network connection machine # [ 433.413184] k3s[887]: time="2026-09-21T14:50:43Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:48758->127.0.0.1:10250: write: broken pipe" machine # [ 433.413675] k3s[887]: E0921 14:50:43.192437 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44414: use of closed network connection machine # [ 434.688262] k3s[887]: E0921 14:50:44.467782 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44434: use of closed network connection machine # [ 435.922702] k3s[887]: E0921 14:50:45.700822 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44454: use of closed network connection machine # [ 437.185295] k3s[887]: E0921 14:50:46.964660 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44474: use of closed network connection machine # [ 438.444097] k3s[887]: E0921 14:50:48.223409 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44498: use of closed network connection machine # [ 438.444685] k3s[887]: time="2026-09-21T14:50:48Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:48790->127.0.0.1:10250: write: broken pipe" machine # [ 439.703688] k3s[887]: E0921 14:50:49.483117 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44514: use of closed network connection machine # [ 440.946190] k3s[887]: E0921 14:50:50.725697 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44528: use of closed network connection machine # [ 442.169874] k3s[887]: E0921 14:50:51.949309 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44562: use of closed network connection machine # [ 443.450321] k3s[887]: E0921 14:50:53.229320 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37742: use of closed network connection machine # [ 444.735170] k3s[887]: E0921 14:50:54.514375 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37772: use of closed network connection machine # [ 444.735582] k3s[887]: E0921 14:50:54.514562 887 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:51670->127.0.0.1:10010: write tcp 127.0.0.1:51670->127.0.0.1:10010: write: broken pipe machine # [ 446.018187] k3s[887]: E0921 14:50:55.797301 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37806: use of closed network connection machine # [ 447.288638] k3s[887]: E0921 14:50:57.067991 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37826: use of closed network connection machine # [ 448.566276] k3s[887]: E0921 14:50:58.345755 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37852: use of closed network connection machine # [ 449.841874] k3s[887]: E0921 14:50:59.621376 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37864: use of closed network connection machine # [ 451.132902] k3s[887]: E0921 14:51:00.912345 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37892: use of closed network connection machine # [ 452.399509] k3s[887]: E0921 14:51:02.178820 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:37924: use of closed network connection machine # [ 453.615751] k3s[887]: E0921 14:51:03.394865 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36486: use of closed network connection machine # [ 454.869405] k3s[887]: E0921 14:51:04.648711 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36514: use of closed network connection machine # [ 456.104278] k3s[887]: E0921 14:51:05.883540 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36552: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-zstrv -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 50.71 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.04 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1 machine # [ 457.596425] niks3-server[1192]: 2026/09/21 14:51:07 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 457.609711] niks3-server[1192]: 2026/09/21 14:51:07 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 457.611401] niks3-server[1192]: 2026/09/21 14:51:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 457.612154] niks3-server[1192]: 2026/09/21 14:51:07 INFO Signed narinfos id=21 count=1 machine # [ 457.615770] niks3-server[1192]: 2026/09/21 14:51:07 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 457.618623] niks3-server[1192]: 2026/09/21 14:51:07 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 457.620357] niks3-server[1192]: 2026/09/21 14:51:07 INFO Completed upload id=21 machine # [ 457.622247] niks3-server[1192]: 2026/09/21 14:51:07 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 482.538490] niks3-server[1192]: 2026/09/21 14:51:32 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 482.559499] niks3-server[1192]: 2026/09/21 14:51:32 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 482.562443] niks3-server[1192]: 2026/09/21 14:51:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 482.564546] niks3-server[1192]: 2026/09/21 14:51:32 INFO Signed narinfos id=22 count=1 machine # [ 482.565253] niks3-server[1192]: 2026/09/21 14:51:32 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 482.568305] niks3-server[1192]: 2026/09/21 14:51:32 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 482.576345] niks3-server[1192]: 2026/09/21 14:51:32 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 482.578505] niks3-server[1192]: 2026/09/21 14:51:32 INFO Completed upload id=22 machine # [ 482.580788] niks3-server[1192]: 2026/09/21 14:51:32 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 482.668328] niks3-server[1192]: 2026/09/21 14:51:32 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 482.681609] niks3-server[1192]: 2026/09/21 14:51:32 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 482.682459] niks3-server[1192]: 2026/09/21 14:51:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 482.685279] niks3-server[1192]: 2026/09/21 14:51:32 INFO Signed narinfos id=23 count=1 machine # [ 482.688720] niks3-server[1192]: 2026/09/21 14:51:32 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 482.692395] niks3-server[1192]: 2026/09/21 14:51:32 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 482.694195] niks3-server[1192]: 2026/09/21 14:51:32 INFO Completed upload id=23 machine # [ 482.695605] niks3-server[1192]: 2026/09/21 14:51:32 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 507.203870] niks3-server[1192]: 2026/09/21 14:51:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 507.220668] niks3-server[1192]: 2026/09/21 14:51:56 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 507.225888] niks3-server[1192]: 2026/09/21 14:51:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 507.230196] niks3-server[1192]: 2026/09/21 14:51:57 INFO Signed narinfos id=24 count=1 machine # [ 507.232993] niks3-server[1192]: 2026/09/21 14:51:57 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 507.237793] niks3-server[1192]: 2026/09/21 14:51:57 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 507.241870] niks3-server[1192]: 2026/09/21 14:51:57 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 507.246188] niks3-server[1192]: 2026/09/21 14:51:57 INFO Completed upload id=24 machine # [ 507.248857] niks3-server[1192]: 2026/09/21 14:51:57 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 507.329437] niks3-server[1192]: 2026/09/21 14:51:57 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 507.343363] niks3-server[1192]: 2026/09/21 14:51:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 507.343672] niks3-server[1192]: 2026/09/21 14:51:57 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 507.344868] niks3-server[1192]: 2026/09/21 14:51:57 INFO Signed narinfos id=25 count=1 machine # [ 507.346551] niks3-server[1192]: 2026/09/21 14:51:57 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 507.348915] niks3-server[1192]: 2026/09/21 14:51:57 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 507.350926] niks3-server[1192]: 2026/09/21 14:51:57 INFO Completed upload id=25 machine # [ 507.353686] niks3-server[1192]: 2026/09/21 14:51:57 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 531.671227] niks3-server[1192]: 2026/09/21 14:52:21 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 531.685419] niks3-server[1192]: 2026/09/21 14:52:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 531.685902] niks3-server[1192]: 2026/09/21 14:52:21 INFO Signed narinfos id=26 count=1 machine # [ 531.688589] niks3-server[1192]: 2026/09/21 14:52:21 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 531.690057] niks3-server[1192]: 2026/09/21 14:52:21 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 531.695546] niks3-server[1192]: 2026/09/21 14:52:21 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 531.696316] niks3-server[1192]: 2026/09/21 14:52:21 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 531.698315] niks3-server[1192]: 2026/09/21 14:52:21 INFO Completed upload id=26 machine # [ 531.702756] niks3-server[1192]: 2026/09/21 14:52:21 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/4m7mpr04a8dziray8jhdxrxsvaq1bzrn-job.nix --argstr tag t-renewed 2>&1, in 74.32 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 125.64 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.13 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw"', in 0.02 seconds) (finished: subtest: metrics carry build_info, in 0.15 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 532.027556] k3s[887]: E0921 14:52:21.806838 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36146: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.15 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 532.258462] k3s[887]: E0921 14:52:22.038275 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36166: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.23 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc -- sh -c 'fallocate -l 11441561600 /nix/fill' machine # [ 532.428626] k3s[887]: E0921 14:52:22.208422 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36196: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc -- sh -c 'fallocate -l 11441561600 /nix/fill', in 0.17 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc --since=30s | grep -q 'store paths deleted', in 3.76 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc -- sh -c 'rm /nix/fill' machine # [ 536.373032] k3s[887]: E0921 14:52:26.152529 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39800: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc -- sh -c 'rm /nix/fill', in 0.18 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.13 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 536.699959] k3s[887]: E0921 14:52:26.479629 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39834: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.19 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 4.83 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1 machine # Running as unit: vialb.service; invocation ID: 05cfaf55957f496ea9abda5bee58e620 machine # [ 536.723189] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1. machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag lb1, in 0.02 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 536.839710] nix[10781]: don't know how to build these paths: machine # [ 536.842051] nix[10781]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 536.866804] nix[10781]: copying 1 paths to '127.0.0.1:30051'... machine # [ 536.868466] nix[10781]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 536.945494] niks3-server[1192]: 2026/09/21 14:52:26 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 536.957687] niks3-server[1192]: 2026/09/21 14:52:26 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 536.959923] niks3-server[1192]: 2026/09/21 14:52:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 536.961661] niks3-server[1192]: 2026/09/21 14:52:26 INFO Signed narinfos id=27 count=1 machine # [ 536.963216] niks3-server[1192]: 2026/09/21 14:52:26 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 536.968372] niks3-server[1192]: 2026/09/21 14:52:26 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 536.970064] niks3-server[1192]: 2026/09/21 14:52:26 INFO Completed upload id=27 machine # [ 536.971649] niks3-server[1192]: 2026/09/21 14:52:26 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 536.978497] nix[10781]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 536.978768] nix[10781]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.05 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.19 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 537.982789] nix[10781]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 537.983209] nix[10781]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 538.005146] systemd[1]: cri-containerd-2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc.scope: Deactivated successfully. machine # [ 538.006747] systemd[1]: cri-containerd-2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc.scope: Consumed 4.364s CPU time over 7min 51.232s wall clock time, 57.6M memory peak, 36M read from disk, 717.3K incoming IP traffic, 681.3K outgoing IP traffic. machine # [ 538.034097] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc-rootfs.mount: Deactivated successfully. machine # [ 538.063323] systemd[1]: cri-containerd-c152faf308404e2579fde40c7eefcd40102824d4506fb092ea6669b5d07e8988.scope: Deactivated successfully. machine # [ 538.089896] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c152faf308404e2579fde40c7eefcd40102824d4506fb092ea6669b5d07e8988-rootfs.mount: Deactivated successfully. machine # [ 538.112311] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-c152faf308404e2579fde40c7eefcd40102824d4506fb092ea6669b5d07e8988-shm.mount: Deactivated successfully. machine # [ 538.291198] cni0: port 4(veth21b3f44a) entered disabled state machine # [ 538.140074] dhcpcd[698]: veth21b3f44a: carrier lost machine # [ 538.293358] veth21b3f44a (unregistering): left allmulticast mode machine # [ 538.294549] veth21b3f44a (unregistering): left promiscuous mode machine # [ 538.295437] cni0: port 4(veth21b3f44a) entered disabled state machine # [ 538.162940] systemd[1]: run-netns-cni\x2d2de359fb\x2d5348\x2d5a96\x2d2f62\x2dc28609cd6a16.mount: Deactivated successfully. machine # [ 538.168061] dhcpcd[698]: veth21b3f44a: deleting address fe80::9cb5:92ff:fec5:1564 machine # [ 538.172219] dhcpcd[698]: veth21b3f44a: deleting route to 169.254.0.0/16 machine # [ 538.215040] systemd[1]: Created slice libcontainer container kubepods-besteffort-poda751f7d4_23c7_463b_a255_62a137ff8382.slice. machine # [ 538.244316] dhcpcd[698]: veth21b3f44a: removing interface machine # [ 538.261682] k3s[887]: I0921 14:52:28.041267 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-lb\" (UniqueName: \"kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-lb\") pod \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\" (UID: \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\") " machine # [ 538.261834] k3s[887]: I0921 14:52:28.041306 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-ca\" (UniqueName: \"kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-ca\") pod \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\" (UID: \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\") " machine # [ 538.262745] k3s[887]: I0921 14:52:28.041337 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e526e35c-dd9a-4abe-b94b-ee91ed06fced-config\" (UniqueName: \"kubernetes.io/configmap/e526e35c-dd9a-4abe-b94b-ee91ed06fced-config\") pod \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\" (UID: \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\") " machine # [ 538.263189] k3s[887]: I0921 14:52:28.041370 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tmp\") pod \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\" (UID: \"e526e35c-dd9a-4abe-b94b-ee91ed06fced\") " machine # [ 538.263656] k3s[887]: I0921 14:52:28.041418 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a751f7d4-23c7-463b-a255-62a137ff8382-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-9r8vc\" (UID: \"a751f7d4-23c7-463b-a255-62a137ff8382\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-9r8vc" machine # [ 538.264143] k3s[887]: I0921 14:52:28.041443 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/a751f7d4-23c7-463b-a255-62a137ff8382-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-9r8vc\" (UID: \"a751f7d4-23c7-463b-a255-62a137ff8382\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-9r8vc" machine # [ 538.264607] k3s[887]: I0921 14:52:28.041469 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/a751f7d4-23c7-463b-a255-62a137ff8382-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-9r8vc\" (UID: \"a751f7d4-23c7-463b-a255-62a137ff8382\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-9r8vc" machine # [ 538.265082] k3s[887]: I0921 14:52:28.041499 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a751f7d4-23c7-463b-a255-62a137ff8382-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-9r8vc\" (UID: \"a751f7d4-23c7-463b-a255-62a137ff8382\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-9r8vc" machine # [ 538.291984] systemd[1]: var-lib-kubelet-pods-e526e35c\x2ddd9a\x2d4abe\x2db94b\x2dee91ed06fced-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 538.292575] systemd[1]: var-lib-kubelet-pods-e526e35c\x2ddd9a\x2d4abe\x2db94b\x2dee91ed06fced-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 538.293024] k3s[887]: I0921 14:52:28.071830 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-ca" pod "e526e35c-dd9a-4abe-b94b-ee91ed06fced" (UID: "e526e35c-dd9a-4abe-b94b-ee91ed06fced"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 538.293489] k3s[887]: I0921 14:52:28.072147 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-lb" pod "e526e35c-dd9a-4abe-b94b-ee91ed06fced" (UID: "e526e35c-dd9a-4abe-b94b-ee91ed06fced"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 538.293974] systemd[1]: var-lib-kubelet-pods-e526e35c\x2ddd9a\x2d4abe\x2db94b\x2dee91ed06fced-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 538.305830] k3s[887]: I0921 14:52:28.085665 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tmp" pod "e526e35c-dd9a-4abe-b94b-ee91ed06fced" (UID: "e526e35c-dd9a-4abe-b94b-ee91ed06fced"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 538.311194] k3s[887]: I0921 14:52:28.090843 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e526e35c-dd9a-4abe-b94b-ee91ed06fced-config" pod "e526e35c-dd9a-4abe-b94b-ee91ed06fced" (UID: "e526e35c-dd9a-4abe-b94b-ee91ed06fced"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 538.362031] k3s[887]: I0921 14:52:28.141826 887 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 538.364853] k3s[887]: I0921 14:52:28.141858 887 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e526e35c-dd9a-4abe-b94b-ee91ed06fced-config\") on node \"machine\" DevicePath \"\"" machine # [ 538.365104] k3s[887]: I0921 14:52:28.141884 887 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 538.365788] k3s[887]: I0921 14:52:28.141900 887 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/e526e35c-dd9a-4abe-b94b-ee91ed06fced-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 538.705811] cni0: port 1(veth7f578c45) entered blocking state machine # [ 538.707885] cni0: port 1(veth7f578c45) entered disabled state machine # [ 538.709792] veth7f578c45: entered allmulticast mode machine # [ 538.711622] veth7f578c45: entered promiscuous mode machine # [ 538.563087] (udev-worker)[10965]: Network interface NamePolicy= disabled on kernel command line. machine # [ 538.725937] cni0: port 1(veth7f578c45) entered blocking state machine # [ 538.726738] cni0: port 1(veth7f578c45) entered forwarding state machine # [ 538.589069] dhcpcd[698]: veth7f578c45: IAID 4d:92:8a:bd machine # [ 538.589230] dhcpcd[698]: veth7f578c45: adding address fe80::d8b4:4dff:fe92:8abd machine # [ 538.666307] systemd[1]: Started libcontainer container adcb79a86fbc226e42363c757c5653a0532ca819d196b837ac83cddc7314d6b1. machine # [ 538.800303] systemd[1]: Started libcontainer container 393a3213646fb0cf26899cbdb0f1219220c4a0af9db0bd4819d83a318133da11. machine # [ 538.856830] k3s[887]: I0921 14:52:28.636640 887 scope.go:122] "RemoveContainer" containerID="2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc" machine # [ 538.867496] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pode526e35c_dd9a_4abe_b94b_ee91ed06fced.slice. machine # [ 538.867840] k3s[887]: I0921 14:52:28.647217 887 scope.go:122] "RemoveContainer" containerID="2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc" machine # [ 538.868416] systemd[1]: kubepods-besteffort-pode526e35c_dd9a_4abe_b94b_ee91ed06fced.slice: Consumed 4.395s CPU time over 7min 54.155s wall clock time, 57.9M memory peak, 36M read from disk, 717.3K incoming IP traffic, 681.3K outgoing IP traffic. machine # [ 538.873499] k3s[887]: E0921 14:52:28.653283 887 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc\": not found" containerID="2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc" machine # [ 538.873764] k3s[887]: I0921 14:52:28.653328 887 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc"} err="failed to get container status \"2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc\": rpc error: code = NotFound desc = an error occurred when try to find container \"2429787ab8d77ce54bd2cf30040dbafcfd4c97dfafaa17327b4f8e34d7e475fc\": not found" machine # [ 539.042233] systemd[1]: var-lib-kubelet-pods-e526e35c\x2ddd9a\x2d4abe\x2db94b\x2dee91ed06fced-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 539.042646] systemd[1]: var-lib-kubelet-pods-e526e35c\x2ddd9a\x2d4abe\x2db94b\x2dee91ed06fced-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 539.043218] systemd[1]: var-lib-kubelet-pods-e526e35c\x2ddd9a\x2d4abe\x2db94b\x2dee91ed06fced-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 539.385473] dhcpcd[698]: veth7f578c45: soliciting a DHCP lease machine # [ 539.867525] k3s[887]: I0921 14:52:29.646222 887 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e526e35c-dd9a-4abe-b94b-ee91ed06fced" path="/var/lib/kubelet/pods/e526e35c-dd9a-4abe-b94b-ee91ed06fced/volumes" machine # [ 539.915499] k3s[887]: I0921 14:52:29.695199 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-9r8vc" podStartSLOduration=2.695168319 podStartE2EDuration="2.695168319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-21 14:52:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 14:52:29.67717525 +0000 UTC m=+522.455877714" watchObservedRunningTime="2026-09-21 14:52:29.695168319 +0000 UTC m=+522.473869107" machine # [ 540.191440] dhcpcd[698]: veth7f578c45: soliciting an IPv6 router machine # [ 540.485822] nix[10781]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 541.519090] nix[10781]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 541.522853] nix[10781]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-gsl5n: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 544.386274] dhcpcd[698]: veth7f578c45: probing for an IPv4LL address machine # [ 549.820323] dhcpcd[698]: veth7f578c45: using IPv4LL address 169.254.248.81 machine # [ 549.822861] dhcpcd[698]: veth7f578c45: adding route to 169.254.0.0/16 machine # [ 552.194590] dhcpcd[698]: veth7f578c45: no IPv6 Routers available machine # [ 586.050732] niks3-server[1192]: 2026/09/21 14:53:15 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 586.068614] niks3-server[1192]: 2026/09/21 14:53:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 586.074358] niks3-server[1192]: 2026/09/21 14:53:15 INFO Signed narinfos id=28 count=1 machine # [ 586.076929] niks3-server[1192]: 2026/09/21 14:53:15 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 586.080592] niks3-server[1192]: 2026/09/21 14:53:15 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 586.085126] niks3-server[1192]: 2026/09/21 14:53:15 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 586.089297] niks3-server[1192]: 2026/09/21 14:53:15 INFO Completed upload id=28 machine # [ 586.090959] niks3-server[1192]: 2026/09/21 14:53:15 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 586.140809] systemd[1]: vialb.service: Deactivated successfully. machine # [ 586.141743] systemd[1]: vialb.service: Consumed 169ms CPU time over 49.418s wall clock time, 44.5M memory peak, 4K written to disk, 7.9K incoming IP traffic, 17.1K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 48.51 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.03 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.25 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 50.06 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 machine # [ 586.793980] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 894cb57b16494ac3adae6e6a614f11d8 machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/b2prb199a55q32qawjagqrylwrml5g74-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1, in 0.03 seconds) machine # [ 586.908586] nix[11791]: don't know how to build these paths: machine # [ 586.909198] nix[11791]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 586.930195] nix[11791]: copying 1 paths to '127.0.0.1:30051'... machine # [ 586.931638] nix[11791]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 586.981396] k3s[887]: E0921 14:53:16.760938 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35544: use of closed network connection machine # command terminated with exit code 1 machine # [ 586.993358] niks3-server[1192]: 2026/09/21 14:53:16 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 587.006247] niks3-server[1192]: 2026/09/21 14:53:16 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 587.007442] niks3-server[1192]: 2026/09/21 14:53:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 587.009216] niks3-server[1192]: 2026/09/21 14:53:16 INFO Signed narinfos id=29 count=1 machine # [ 587.011777] niks3-server[1192]: 2026/09/21 14:53:16 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 587.013757] niks3-server[1192]: 2026/09/21 14:53:16 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 587.015858] niks3-server[1192]: 2026/09/21 14:53:16 INFO Completed upload id=29 machine # [ 587.017785] niks3-server[1192]: 2026/09/21 14:53:16 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 587.027660] nix[11791]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 587.028154] nix[11791]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 587.158167] k3s[887]: E0921 14:53:16.937898 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35582: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 588.392523] k3s[887]: E0921 14:53:18.170570 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35602: use of closed network connection machine # [ 588.557476] k3s[887]: E0921 14:53:18.337279 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35620: use of closed network connection machine # command terminated with exit code 1 machine # [ 589.793205] k3s[887]: E0921 14:53:19.572646 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35654: use of closed network connection machine # command terminated with exit code 1 machine # [ 589.960139] k3s[887]: E0921 14:53:19.739961 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35678: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 591.202457] k3s[887]: E0921 14:53:20.981438 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35702: use of closed network connection machine # [ 591.373481] k3s[887]: E0921 14:53:21.153248 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35714: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 592.669699] k3s[887]: E0921 14:53:22.447304 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35726: use of closed network connection machine # [ 592.865346] k3s[887]: E0921 14:53:22.645151 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:35756: use of closed network connection machine # command terminated with exit code 1 machine # [ 594.122356] k3s[887]: E0921 14:53:23.901864 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36262: use of closed network connection machine # command terminated with exit code 1 machine # [ 594.275565] k3s[887]: E0921 14:53:24.055376 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36280: use of closed network connection machine # command terminated with exit code 1 machine # [ 595.521825] k3s[887]: E0921 14:53:25.301241 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36290: use of closed network connection machine # command terminated with exit code 1 machine # [ 595.702177] k3s[887]: E0921 14:53:25.481865 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36304: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 596.945676] k3s[887]: E0921 14:53:26.724692 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36336: use of closed network connection machine # [ 597.143530] k3s[887]: E0921 14:53:26.923272 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36370: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 598.379877] k3s[887]: E0921 14:53:28.159024 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36396: use of closed network connection machine # [ 598.558409] k3s[887]: E0921 14:53:28.338175 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36432: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 599.842869] k3s[887]: E0921 14:53:29.621167 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36468: use of closed network connection machine # [ 599.846535] k3s[887]: time="2026-09-21T14:53:29Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:48084->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 600.031264] k3s[887]: E0921 14:53:29.810834 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36496: use of closed network connection machine # [ 601.351512] k3s[887]: E0921 14:53:31.131008 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36516: use of closed network connection machine # command terminated with exit code 1 machine # [ 601.515410] k3s[887]: E0921 14:53:31.294844 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36546: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 602.771433] k3s[887]: E0921 14:53:32.550991 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:36574: use of closed network connection machine # [ 602.941304] k3s[887]: E0921 14:53:32.721104 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60042: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 604.198830] k3s[887]: E0921 14:53:33.978200 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60068: use of closed network connection machine # [ 604.199909] k3s[887]: time="2026-09-21T14:53:33Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:40596->127.0.0.1:10250: write: broken pipe" machine # [ 604.368608] k3s[887]: E0921 14:53:34.148410 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60104: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 605.605919] k3s[887]: E0921 14:53:35.385029 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60128: use of closed network connection machine # [ 605.761185] k3s[887]: E0921 14:53:35.540995 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60164: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 606.972446] k3s[887]: E0921 14:53:36.751614 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60198: use of closed network connection machine # [ 607.135588] k3s[887]: E0921 14:53:36.915295 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60218: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 608.323186] k3s[887]: E0921 14:53:38.099332 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60240: use of closed network connection machine # [ 608.504412] k3s[887]: E0921 14:53:38.284208 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60264: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 609.746457] k3s[887]: E0921 14:53:39.525888 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60290: use of closed network connection machine # [ 609.917072] k3s[887]: E0921 14:53:39.696848 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60322: use of closed network connection machine # command terminated with exit code 1 machine # [ 610.227354] postgres[760]: [760] LOG: checkpoint starting: time machine # [ 611.156750] k3s[887]: E0921 14:53:40.936304 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60342: use of closed network connection machine # command terminated with exit code 1 machine # [ 611.317757] k3s[887]: E0921 14:53:41.097524 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60374: use of closed network connection machine # command terminated with exit code 1 machine # [ 612.569372] k3s[887]: E0921 14:53:42.348891 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60396: use of closed network connection machine # [ 612.734451] k3s[887]: E0921 14:53:42.514193 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60422: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-2jmrw --wait=false, in 0.13 seconds) machine: must succeed: sleep 5.0 machine # [ 612.903516] systemd[1]: cri-containerd-4d8339f31be2998e730f3832192c465e49ea32e059af974287ddb7c11e7ef062.scope: Deactivated successfully. machine # [ 612.904766] systemd[1]: cri-containerd-4d8339f31be2998e730f3832192c465e49ea32e059af974287ddb7c11e7ef062.scope: Consumed 504ms CPU time over 8min 58.350s wall clock time, 13.4M memory peak, 5.4M read from disk. machine # [ 612.933795] systemd[1]: Created slice libcontainer container kubepods-besteffort-podc8aaf89b_e865_4200_9238_15edfcf8f3df.slice. machine # [ 612.944029] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4d8339f31be2998e730f3832192c465e49ea32e059af974287ddb7c11e7ef062-rootfs.mount: Deactivated successfully. machine # [ 613.096835] k3s[887]: I0921 14:53:42.876584 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/c8aaf89b-e865-4200-9238-15edfcf8f3df-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm\" (UID: \"c8aaf89b-e865-4200-9238-15edfcf8f3df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm" machine # [ 613.097294] k3s[887]: I0921 14:53:42.876658 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/c8aaf89b-e865-4200-9238-15edfcf8f3df-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm\" (UID: \"c8aaf89b-e865-4200-9238-15edfcf8f3df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm" machine # [ 613.097791] k3s[887]: I0921 14:53:42.876690 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/c8aaf89b-e865-4200-9238-15edfcf8f3df-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm\" (UID: \"c8aaf89b-e865-4200-9238-15edfcf8f3df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm" machine # [ 613.098656] k3s[887]: I0921 14:53:42.876718 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnrsn\" (UniqueName: \"kubernetes.io/projected/c8aaf89b-e865-4200-9238-15edfcf8f3df-kube-api-access-pnrsn\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm\" (UID: \"c8aaf89b-e865-4200-9238-15edfcf8f3df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm" machine # [ 613.099151] k3s[887]: I0921 14:53:42.876748 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/c8aaf89b-e865-4200-9238-15edfcf8f3df-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm\" (UID: \"c8aaf89b-e865-4200-9238-15edfcf8f3df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm" machine # [ 613.099656] k3s[887]: I0921 14:53:42.876770 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c8aaf89b-e865-4200-9238-15edfcf8f3df-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm\" (UID: \"c8aaf89b-e865-4200-9238-15edfcf8f3df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm" machine # [ 613.100179] k3s[887]: I0921 14:53:42.876795 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/c8aaf89b-e865-4200-9238-15edfcf8f3df-build\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm\" (UID: \"c8aaf89b-e865-4200-9238-15edfcf8f3df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm" machine # [ 613.100649] k3s[887]: I0921 14:53:42.876822 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/c8aaf89b-e865-4200-9238-15edfcf8f3df-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm\" (UID: \"c8aaf89b-e865-4200-9238-15edfcf8f3df\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm" machine # [ 613.259654] postgres[760]: [760] LOG: checkpoint complete: wrote 30 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=3.012 s, sync=0.005 s, total=3.032 s; sync files=24, longest=0.001 s, average=0.001 s; distance=243 kB, estimate=4496 kB; lsn=0/1C7D3B0, redo lsn=0/1C7D358 machine # [ 613.425306] cni0: port 4(veth6444e236) entered blocking state machine # [ 613.429128] cni0: port 4(veth6444e236) entered disabled state machine # [ 613.433248] veth6444e236: entered allmulticast mode machine # [ 613.434169] veth6444e236: entered promiscuous mode machine # [ 613.445398] cni0: port 4(veth6444e236) entered blocking state machine # [ 613.446292] cni0: port 4(veth6444e236) entered forwarding state machine # [ 613.328777] (udev-worker)[13471]: Network interface NamePolicy= disabled on kernel command line. machine # [ 613.356526] dhcpcd[698]: veth6444e236: IAID 60:14:5c:f8 machine # [ 613.356858] dhcpcd[698]: veth6444e236: adding address fe80::98f5:60ff:fe14:5cf8 machine # [ 613.373275] systemd[1]: Started libcontainer container 5ce1822e0d4ccbc6d3eede56de87226f66e4b115ce462eb4e0e52e14ea32e519. machine # [ 613.458309] systemd[1]: Started libcontainer container e5ff0ae0480b275c7a24fadd0c657f534701747f77434a39dc1c175d2f0ba27d. machine # [ 613.941052] dhcpcd[698]: veth6444e236: soliciting a DHCP lease machine # [ 615.238166] dhcpcd[698]: veth6444e236: soliciting an IPv6 router machine # [ 615.456934] systemd[1]: cri-containerd-e5ff0ae0480b275c7a24fadd0c657f534701747f77434a39dc1c175d2f0ba27d.scope: Deactivated successfully. machine # [ 615.459983] systemd[1]: cri-containerd-e5ff0ae0480b275c7a24fadd0c657f534701747f77434a39dc1c175d2f0ba27d.scope: Consumed 753ms CPU time over 1.999s wall clock time, 468M memory peak, 184.9M read from disk, 168.8M written to disk. machine # [ 615.526142] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-e5ff0ae0480b275c7a24fadd0c657f534701747f77434a39dc1c175d2f0ba27d-rootfs.mount: Deactivated successfully. machine # [ 616.191359] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2756544071.mount: Deactivated successfully. machine # [ 616.236309] systemd[1]: Started libcontainer container 1f6af78b15d43bdefcb29338a35e1e5b886854c2645cead42619258e27ad3ff9. machine # [ 616.357332] systemd[1]: Started libcontainer container 86b3e8cdc4566682e44b585c67b6b235b68105d72ecd347bf8d212ca821e9720. machine # [ 616.454336] systemd[1]: Started libcontainer container 32ff24cd2b936a28a8992ba57658fe8200a6a25e6f05787cc08ef0b606efe603. machine: (finished: must succeed: sleep 5.0, in 5.03 seconds) machine # [ 618.126546] k3s[887]: E0921 14:53:47.905663 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38426: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 618.265899] k3s[887]: I0921 14:53:48.045586 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-5f5fdb9885-g9ssm" podStartSLOduration=4.070121551 podStartE2EDuration="6.045547199s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.975425648s" isStatefulPod=false podCreationTimestamp="2026-09-21 14:53:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-21 14:53:46.96262856 +0000 UTC m=+599.741480763" watchObservedRunningTime="2026-09-21 14:53:48.045547199 +0000 UTC m=+600.824249942" machine # [ 618.942591] dhcpcd[698]: veth6444e236: probing for an IPv4LL address machine # [ 620.182766] k3s[887]: I0921 14:53:49.959661 887 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 624.161827] dhcpcd[698]: veth6444e236: using IPv4LL address 169.254.31.203 machine # [ 624.162484] dhcpcd[698]: veth6444e236: adding route to 169.254.0.0/16 machine # [ 627.241888] dhcpcd[698]: veth6444e236: no IPv6 Routers available machine # [ 631.560872] niks3-server[1192]: 2026/09/21 14:54:01 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 631.582894] niks3-server[1192]: 2026/09/21 14:54:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 631.584291] niks3-server[1192]: 2026/09/21 14:54:01 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 631.587575] niks3-server[1192]: 2026/09/21 14:54:01 INFO Signed narinfos id=30 count=1 machine # [ 631.588344] niks3-server[1192]: 2026/09/21 14:54:01 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 631.595563] niks3-server[1192]: 2026/09/21 14:54:01 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 631.597979] niks3-server[1192]: 2026/09/21 14:54:01 INFO Completed upload id=30 machine # [ 631.629406] systemd[1]: slow.service: Deactivated successfully. machine # [ 631.630330] systemd[1]: slow.service: Consumed 143ms CPU time over 44.835s wall clock time, 38.5M memory peak, 4K written to disk, 4.6K incoming IP traffic, 11.3K outgoing IP traffic. machine # [ 631.983604] systemd[1]: cri-containerd-7835013643fc72e1991654b5e55f3067b7e9d103b11a3fd46885841d6125dbc8.scope: Deactivated successfully. machine # [ 631.985405] systemd[1]: cri-containerd-7835013643fc72e1991654b5e55f3067b7e9d103b11a3fd46885841d6125dbc8.scope: Consumed 3.011s CPU time over 9min 17.565s wall clock time, 78M memory peak, 40.4M read from disk, 270K incoming IP traffic, 346K outgoing IP traffic. machine # [ 632.042810] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-7835013643fc72e1991654b5e55f3067b7e9d103b11a3fd46885841d6125dbc8-rootfs.mount: Deactivated successfully. machine # [ 632.050737] systemd[1]: cri-containerd-29faeac771843d7de64365cfba9d7fbb8271874f91e3a563e51c1e56a94b070e.scope: Deactivated successfully. machine # [ 632.052612] systemd[1]: cri-containerd-29faeac771843d7de64365cfba9d7fbb8271874f91e3a563e51c1e56a94b070e.scope: Consumed 21.863s CPU time over 9min 17.777s wall clock time, 41.6M memory peak, 24M read from disk, 1.1M written to disk, 48.5K incoming IP traffic, 33K outgoing IP traffic. machine # [ 632.097602] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-29faeac771843d7de64365cfba9d7fbb8271874f91e3a563e51c1e56a94b070e-rootfs.mount: Deactivated successfully. machine # [ 632.116508] systemd[1]: cri-containerd-9f72023514130d1df4a7a9a93edae2d5769a52dd33fb3789e310f797650b4b47.scope: Deactivated successfully. machine # [ 632.142291] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9f72023514130d1df4a7a9a93edae2d5769a52dd33fb3789e310f797650b4b47-rootfs.mount: Deactivated successfully. machine # [ 632.164229] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-9f72023514130d1df4a7a9a93edae2d5769a52dd33fb3789e310f797650b4b47-shm.mount: Deactivated successfully. machine # [ 632.191847] dhcpcd[698]: vethb3a7b8fa: carrier lost machine # [ 632.342741] cni0: port 6(vethb3a7b8fa) entered disabled state machine # [ 632.345285] vethb3a7b8fa (unregistering): left allmulticast mode machine # [ 632.346714] vethb3a7b8fa (unregistering): left promiscuous mode machine # [ 632.348001] cni0: port 6(vethb3a7b8fa) entered disabled state machine # [ 632.212839] systemd[1]: run-netns-cni\x2dd5f17c2f\x2dc8af\x2dfdc5\x2d2b6a\x2d928f6ec4e70a.mount: Deactivated successfully. machine # [ 632.218537] k3s[887]: I0921 14:54:01.997822 887 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f72023514130d1df4a7a9a93edae2d5769a52dd33fb3789e310f797650b4b47" machine # [ 632.221446] dhcpcd[698]: vethb3a7b8fa: deleting address fe80::1854:a2ff:fee6:24e6 machine # [ 632.223295] dhcpcd[698]: vethb3a7b8fa: deleting route to 169.254.0.0/16 machine # [ 632.289348] dhcpcd[698]: vethb3a7b8fa: removing interface machine # [ 632.331257] k3s[887]: I0921 14:54:02.111054 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-build\" (UniqueName: \"kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-build\") pod \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " machine # [ 632.331604] k3s[887]: I0921 14:54:02.111097 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nix\" (UniqueName: \"kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nix\") pod \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " machine # [ 632.332436] k3s[887]: I0921 14:54:02.111142 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nixconf\" (UniqueName: \"kubernetes.io/configmap/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nixconf\") pod \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " machine # [ 632.333110] k3s[887]: I0921 14:54:02.111172 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-tls\" (UniqueName: \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-tls\") pod \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " machine # [ 632.333779] k3s[887]: I0921 14:54:02.111209 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-kube-api-access-ffv5l\" (UniqueName: \"kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-kube-api-access-ffv5l\") pod \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " machine # [ 632.334686] k3s[887]: I0921 14:54:02.111238 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-niks3-token\" (UniqueName: \"kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-niks3-token\") pod \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " machine # [ 632.335617] k3s[887]: I0921 14:54:02.111265 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-ca\" (UniqueName: \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-ca\") pod \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " machine # [ 632.336486] k3s[887]: I0921 14:54:02.111291 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-oidc\" (UniqueName: \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-oidc\") pod \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\" (UID: \"66e30b5b-5f21-40fb-beed-6e248a1e74f7\") " machine # [ 632.337110] k3s[887]: I0921 14:54:02.111633 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-build" pod "66e30b5b-5f21-40fb-beed-6e248a1e74f7" (UID: "66e30b5b-5f21-40fb-beed-6e248a1e74f7"). InnerVolumeSpecName "build". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 632.337835] k3s[887]: I0921 14:54:02.115456 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nixconf" pod "66e30b5b-5f21-40fb-beed-6e248a1e74f7" (UID: "66e30b5b-5f21-40fb-beed-6e248a1e74f7"). InnerVolumeSpecName "nixconf". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 632.371452] k3s[887]: I0921 14:54:02.151273 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-niks3-token" pod "66e30b5b-5f21-40fb-beed-6e248a1e74f7" (UID: "66e30b5b-5f21-40fb-beed-6e248a1e74f7"). InnerVolumeSpecName "niks3-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 632.372226] k3s[887]: I0921 14:54:02.151322 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-ca" pod "66e30b5b-5f21-40fb-beed-6e248a1e74f7" (UID: "66e30b5b-5f21-40fb-beed-6e248a1e74f7"). InnerVolumeSpecName "ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 632.373144] k3s[887]: I0921 14:54:02.152861 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-tls" pod "66e30b5b-5f21-40fb-beed-6e248a1e74f7" (UID: "66e30b5b-5f21-40fb-beed-6e248a1e74f7"). InnerVolumeSpecName "tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 632.373781] k3s[887]: I0921 14:54:02.152948 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-oidc" pod "66e30b5b-5f21-40fb-beed-6e248a1e74f7" (UID: "66e30b5b-5f21-40fb-beed-6e248a1e74f7"). InnerVolumeSpecName "oidc". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 632.376678] k3s[887]: I0921 14:54:02.156523 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-kube-api-access-ffv5l" pod "66e30b5b-5f21-40fb-beed-6e248a1e74f7" (UID: "66e30b5b-5f21-40fb-beed-6e248a1e74f7"). InnerVolumeSpecName "kube-api-access-ffv5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 632.431886] k3s[887]: I0921 14:54:02.211690 887 reconciler_common.go:299] "Volume detached for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-build\") on node \"machine\" DevicePath \"\"" machine # [ 632.432091] k3s[887]: I0921 14:54:02.211722 887 reconciler_common.go:299] "Volume detached for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nixconf\") on node \"machine\" DevicePath \"\"" machine # [ 632.432376] k3s[887]: I0921 14:54:02.211735 887 reconciler_common.go:299] "Volume detached for volume \"tls\" (UniqueName: \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-tls\") on node \"machine\" DevicePath \"\"" machine # [ 632.432867] k3s[887]: I0921 14:54:02.211749 887 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffv5l\" (UniqueName: \"kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-kube-api-access-ffv5l\") on node \"machine\" DevicePath \"\"" machine # [ 632.435088] k3s[887]: I0921 14:54:02.211764 887 reconciler_common.go:299] "Volume detached for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/66e30b5b-5f21-40fb-beed-6e248a1e74f7-niks3-token\") on node \"machine\" DevicePath \"\"" machine # [ 632.436023] k3s[887]: I0921 14:54:02.211776 887 reconciler_common.go:299] "Volume detached for volume \"ca\" (UniqueName: \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-ca\") on node \"machine\" DevicePath \"\"" machine # [ 632.436496] k3s[887]: I0921 14:54:02.211787 887 reconciler_common.go:299] "Volume detached for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/66e30b5b-5f21-40fb-beed-6e248a1e74f7-oidc\") on node \"machine\" DevicePath \"\"" machine # [ 632.524059] k3s[887]: I0921 14:54:02.303791 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nix" pod "66e30b5b-5f21-40fb-beed-6e248a1e74f7" (UID: "66e30b5b-5f21-40fb-beed-6e248a1e74f7"). InnerVolumeSpecName "nix". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 632.532797] k3s[887]: I0921 14:54:02.312618 887 reconciler_common.go:299] "Volume detached for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/66e30b5b-5f21-40fb-beed-6e248a1e74f7-nix\") on node \"machine\" DevicePath \"\"" machine: (finished: waiting for success: ! systemctl is-active slow, in 14.49 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.03 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.02 seconds) machine: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zffvrw2ldylpxwxig3cnh0pmwsfs2fm8-slow.nix --argstr tag s1 outPath, in 0.16 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 46.11 seconds) (finished: run the VM test script, in 633.78 seconds) test script finished in 633.83s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/d64q19q1xjdwfhqx6czvrjgrhq0n3lcc-python3-3.14.7/bin/python3.14) machine # [2026-09-21T14:54:02Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-21T14:54:02Z INFO virtiofsd] Client disconnected, shutting down machine # [2026-09-21T14:54:02Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.01 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh