tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.AJ8fyU9kXQ', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 10d162fc-e8f2-4e85-a444-7c5bef78cd66 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:08.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fkda0d8zal2a0y4fvklsp82jv571g1cx-nixos-system-machine-test/init regInfo=/nix/store/0nq9din1111vlmd00adp3av2g5kwp060-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 454644428 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000005] tsc: Detected 2400.012 MHz processor machine # [ 0.000813] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000882] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002741] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002752] Using GB pages for direct mapping machine # [ 0.002799] RAMDISK: [mem 0x7e367000-0x7ffcffff] machine # [ 0.002808] ACPI: Early table checksum verification disabled machine # [ 0.002810] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002814] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002819] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002826] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002828] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002830] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002831] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002833] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002834] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002835] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002836] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002837] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002837] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002838] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002838] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002839] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003078] No NUMA configuration found machine # [ 0.003079] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003081] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005350] Zone ranges: machine # [ 0.005351] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005353] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005354] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005355] Device empty machine # [ 0.005356] Movable zone start for each node machine # [ 0.005356] Early memory node ranges machine # [ 0.005357] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005358] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005359] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005360] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005392] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005874] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.077726] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.078216] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.078231] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.078266] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.078269] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.078271] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.078273] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.078274] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.078274] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.078277] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.078278] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.078284] TSC deadline timer available machine # [ 0.078288] CPU topo: Max. logical packages: 1 machine # [ 0.078289] CPU topo: Max. logical dies: 1 machine # [ 0.078289] CPU topo: Max. dies per package: 1 machine # [ 0.078295] CPU topo: Max. threads per core: 1 machine # [ 0.078295] CPU topo: Num. cores per package: 4 machine # [ 0.078296] CPU topo: Num. threads per package: 4 machine # [ 0.078296] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.078321] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.078338] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.078341] kvm-guest: setup PV sched yield machine # [ 0.078351] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.078352] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.078353] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.078355] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.078357] Booting paravirtualized kernel on KVM machine # [ 0.078361] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.082861] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.085018] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.085069] kvm-guest: PV spinlocks enabled machine # [ 0.085071] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.085074] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fkda0d8zal2a0y4fvklsp82jv571g1cx-nixos-system-machine-test/init regInfo=/nix/store/0nq9din1111vlmd00adp3av2g5kwp060-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.085173] Unknown kernel command line parameters "regInfo=/nix/store/0nq9din1111vlmd00adp3av2g5kwp060-closure-info/registration", will be passed to user space. machine # [ 0.085186] random: crng init done machine # [ 0.085187] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.089467] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.091819] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.091891] software IO TLB: area num 4. machine # [ 0.167172] Fallback order for Node 0: 0 machine # [ 0.167181] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.167183] Policy zone: Normal machine # [ 0.169736] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.176681] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.185760] allocated 8388608 bytes of page_ext machine # [ 0.195739] ftrace: allocating 48731 entries in 192 pages machine # [ 0.195740] ftrace: allocated 192 pages with 2 groups machine # [ 0.196625] Dynamic Preempt: lazy machine # [ 0.196801] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.196802] rcu: RCU event tracing is enabled. machine # [ 0.196802] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.196804] Trampoline variant of Tasks RCU enabled. machine # [ 0.196804] Rude variant of Tasks RCU enabled. machine # [ 0.196805] Tracing variant of Tasks RCU enabled. machine # [ 0.196806] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.196806] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.196826] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.196828] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.196829] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.201247] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.201565] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.201575] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.201688] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.205512] Console: colour VGA+ 80x25 machine # [ 0.205515] printk: legacy console [tty0] enabled machine # [ 0.237264] printk: legacy console [ttyS0] enabled machine # [ 0.350015] ACPI: Core revision 20250807 machine # [ 0.350981] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.352600] APIC: Switch to symmetric I/O mode setup machine # [ 0.353619] x2apic enabled machine # [ 0.354371] APIC: Switched APIC routing to: physical x2apic machine # [ 0.355327] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.356618] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.358150] kvm-guest: setup PV IPIs machine # [ 0.359755] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.360819] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.365224] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.366310] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.367354] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.368222] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.369225] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.371221] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.372221] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.374039] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.375221] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.376221] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.377229] Spectre V2 : Enabling IBPB for BPF machine # [ 0.378222] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.379222] active return thunk: srso_alias_return_thunk machine # [ 0.380936] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.382221] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.383221] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.384220] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.385221] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.386220] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.387221] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.389221] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.390221] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.391221] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.392221] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.393221] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.394221] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.423798] Freeing SMP alternatives memory: 44K machine # [ 0.424224] pid_max: default: 32768 minimum: 301 machine # [ 0.425307] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.426343] landlock: Up and running. machine # [ 0.427222] Yama: becoming mindful. machine # [ 0.428435] LSM support for eBPF active machine # [ 0.429387] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.430294] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.433270] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.434801] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.435230] ... version: 2 machine # [ 0.436022] ... bit width: 48 machine # [ 0.436224] ... generic counters: 6 machine # [ 0.436959] ... generic bitmap: 000000000000003f machine # [ 0.437223] ... fixed-purpose counters: 0 machine # [ 0.437995] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.438223] ... value mask: 0000ffffffffffff machine # [ 0.439183] ... max period: 00007fffffffffff machine # [ 0.439983] ... global_ctrl mask: 000000000000003f machine # [ 0.440341] signal: max sigframe size: 3376 machine # [ 0.441189] rcu: Hierarchical SRCU implementation. machine # [ 0.441893] rcu: Max phase no-delay instances is 400. machine # [ 0.442452] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.447793] smp: Bringing up secondary CPUs ... machine # [ 0.448616] smpboot: x86: Booting SMP configuration: machine # [ 0.449226] .... node #0, CPUs: #1 #2 #3 machine # [ 0.451370] smp: Brought up 1 node, 4 CPUs machine # [ 0.452950] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.453618] Memory: 3957560K/4193752K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 220888K reserved, 0K cma-reserved) machine # [ 0.454541] devtmpfs: initialized machine # [ 0.455913] x86/mm: Memory block size: 128MB machine # [ 0.458266] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.459317] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.460323] pinctrl core: initialized pinctrl subsystem machine # [ 0.461543] PM: RTC time: 10:55:28, date: 2026-09-22 machine # [ 0.465133] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.466851] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.467262] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.468773] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.469236] audit: initializing netlink subsys (disabled) machine # [ 0.470284] audit: type=2000 audit(1790074529.503:1): state=initialized audit_enabled=0 res=1 machine # [ 0.470502] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.471225] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.472224] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.473224] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.474224] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.475252] cpuidle: using governor menu machine # [ 0.477419] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.478517] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.479228] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.480238] PCI: Using configuration type 1 for base access machine # [ 0.481348] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.483268] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.484234] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.485224] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.486224] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.488792] ACPI: Added _OSI(Module Device) machine # [ 0.489226] ACPI: Added _OSI(Processor Device) machine # [ 0.490036] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.493586] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.496494] ACPI: Interpreter enabled machine # [ 0.497240] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.497991] ACPI: Using IOAPIC for interrupt routing machine # [ 0.498280] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.499226] PCI: Using E820 reservations for host bridge windows machine # [ 0.500380] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.505381] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.506230] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.507303] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.508348] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.509592] PCI host bridge to bus 0000:00 machine # [ 0.510230] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.511224] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.512224] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.513224] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.514224] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.515224] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.516224] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.517323] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.518661] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.521290] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.522237] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.523246] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.524408] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.526011] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.528255] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.529252] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.530246] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.531230] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.532786] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.534255] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.535190] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.536043] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.537813] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.540290] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.541231] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.542246] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.543941] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.546233] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] machine # [ 0.547136] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.548058] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.549791] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.552270] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] machine # [ 0.553233] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.554246] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.555819] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.558295] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.559239] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.560251] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.562044] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.565262] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] machine # [ 0.566139] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.566978] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.568175] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.569643] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.572225] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.573204] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.574758] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.577271] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] machine # [ 0.578176] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.579009] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.581320] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.584174] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] machine # [ 0.584892] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.585247] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.586874] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.588163] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] machine # [ 0.589470] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.591055] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] machine # [ 0.592172] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.594021] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] machine # [ 0.595210] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.597226] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.598562] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.599533] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.600495] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.602281] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] machine # [ 0.603209] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.604427] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.606047] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.610120] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.611152] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.612117] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.613152] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.614305] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.615325] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.616328] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.617331] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.618259] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.619238] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.620241] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.621238] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.622240] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.623241] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.624238] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.625238] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.627542] iommu: Default domain type: Translated machine # [ 0.628986] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.630437] ACPI: bus type USB registered machine # [ 0.631294] usbcore: registered new interface driver usbfs machine # [ 0.632253] usbcore: registered new interface driver hub machine # [ 0.633245] usbcore: registered new device driver usb machine # [ 0.635820] NetLabel: Initializing machine # [ 0.636226] NetLabel: domain hash size = 128 machine # [ 0.637022] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.638061] NetLabel: unlabeled traffic allowed by default machine # [ 0.639005] PCI: Using ACPI for IRQ routing machine # [ 0.683345] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.684220] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.684220] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.684232] vgaarb: loaded machine # [ 0.685087] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.685952] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.689424] clocksource: Switched to clocksource kvm-clock machine # [ 0.693574] VFS: Disk quotas dquot_6.6.0 machine # [ 0.694324] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.695966] pnp: PnP ACPI init machine # [ 0.696903] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.697962] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.699668] pnp: PnP ACPI: found 6 devices machine # [ 0.709033] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.710621] clocksource: Switched to clocksource acpi_pm machine # [ 0.711735] NET: Registered PF_INET protocol family machine # [ 0.713373] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.732968] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.734568] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.736051] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.737540] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.738933] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.740179] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.741582] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.742968] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.744387] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.745441] NET: Registered PF_XDP protocol family machine # [ 0.746328] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.747428] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.748526] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.749772] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.750957] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.752151] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.754270] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.756551] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.758892] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.761069] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.762949] PCI: CLS 0 bytes, default 64 machine # [ 0.763887] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.764447] Trying to unpack rootfs image as initramfs... machine # [ 0.765029] software IO TLB: mapped [mem 0x000000007a367000-0x000000007e367000] (64MB) machine # [ 0.765174] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.788821] Initialise system trusted keyrings machine # [ 0.790199] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.801824] Key type asymmetric registered machine # [ 0.802596] Asymmetric key parser 'x509' registered machine # [ 0.803558] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.805285] io scheduler mq-deadline registered machine # [ 0.806098] io scheduler kyber registered machine # [ 0.811946] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.813442] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.816183] Linux agpgart interface v0.103 machine # [ 0.816987] ACPI: bus type drm_connector registered machine # [ 0.819569] usbcore: registered new interface driver usbserial_generic machine # [ 0.820752] usbserial: USB Serial support registered for generic machine # [ 0.821829] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.821829] Please enable it if your BIOS has the CPPC option. machine # [ 0.824295] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.825809] drop_monitor: Initializing network drop monitor service machine # [ 0.827105] NET: Registered PF_INET6 protocol family machine # [ 0.828881] Segment Routing with IPv6 machine # [ 0.829635] In-situ OAM (IOAM) with IPv6 machine # [ 0.832344] IPI shorthand broadcast: enabled machine # [ 0.836986] sched_clock: Marking stable (682012331, 154646162)->(924903975, -88245482) machine # [ 0.838839] registered taskstats version 1 machine # [ 0.840102] Loading compiled-in X.509 certificates machine # [ 0.850521] Demotion targets for Node 0: null machine # [ 0.852033] Key type .fscrypt registered machine # [ 0.852859] Key type fscrypt-provisioning registered machine # [ 0.853899] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.854904] ima: Allocated hash algorithm: sha1 machine # [ 0.855787] ima: No architecture policies found machine # [ 0.856916] PM: Magic number: 10:622:932 machine # [ 0.858663] RAS: Correctable Errors collector initialized. machine # [ 0.863233] clk: Disabling unused clocks machine # [ 0.863971] PM: genpd: Disabling unused power domains machine # [ 1.043751] Freeing initrd memory: 29092K machine # [ 1.050097] Freeing unused decrypted memory: 2028K machine # [ 1.055399] Freeing unused kernel image (initmem) memory: 3644K machine # [ 1.057696] Write protecting the kernel read-only data: 32768k machine # [ 1.061765] Freeing unused kernel image (text/rodata gap) memory: 1208K machine # [ 1.063928] Freeing unused kernel image (rodata/data gap) memory: 752K machine # [ 1.115206] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.116357] Run /init as init process machine # [ 1.128037] systemd[1]: Inserted module 'autofs4' machine # [ 1.149815] fuse: init (API version 7.45) machine # [ 1.157358] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.160006] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.163638] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.166634] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.214575] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.550679] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.563140] systemd[1]: Detected virtualization kvm. machine # [ 1.565372] systemd[1]: Detected architecture x86-64. machine # [ 1.567613] systemd[1]: Running in initrd. machine # [ 1.570342] systemd[1]: Initializing machine ID from random generator. machine # [ 1.573325] systemd[1]: Hostname set to . machine # [ 1.697291] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.760214] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.769467] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.770711] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.772167] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.773299] systemd[1]: Reached target Path Units. machine # [ 1.774226] systemd[1]: Reached target Slice Units. machine # [ 1.775108] systemd[1]: Reached target Swaps. machine # [ 1.775963] systemd[1]: Reached target Timer Units. machine # [ 1.777001] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.778275] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.779423] systemd[1]: Listening on Journal Sockets. machine # [ 1.780437] systemd[1]: Listening on udev Control Socket. machine # [ 1.781527] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.782536] systemd[1]: Reached target Socket Units. machine # [ 1.784603] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.786881] systemd[1]: Starting Load Kernel Module 9pnet_virtio... machine # [ 1.789081] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.792940] systemd[1]: Starting Journal Service... machine # [ 1.804739] systemd[1]: Starting Load Kernel Modules... machine # [ 1.805784] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.815532] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.833752] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.833828] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.834353] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.838229] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.838346] systemd-journald[91]: Collecting audit messages is disabled. machine # [ 1.844736] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.848007] systemd[1]: Finished Load Kernel Modules. machine # [ 1.849354] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.852338] systemd[1]: Starting Apply Kernel Variables... machine # [ 1.858207] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.869428] netfs: FS-Cache loaded machine # [ 1.876356] 9pnet: Installing 9P2000 support machine # [ 1.881677] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. machine # [ 1.883491] systemd[1]: Finished Load Kernel Module 9pnet_virtio. machine # [ 1.885397] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.887073] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.888585] systemd[1]: Started Journal Service. machine # [ 1.734082] systemd-modules-load[93]: Using 4 probe threads machine # [ 1.736208] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 1.737281] systemd-modules-load[93]: Inserted module 'virtio_balloon' machine # [ 1.739446] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 1.740513] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.754245] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.755311] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.756269] systemd[1]: Reached target Local File Systems. machine # [ 1.757143] systemd[1]: Starting Create System Files and Directories... machine # [ 1.758128] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.779536] systemd[1]: Finished Create System Files and Directories. machine # [ 1.788625] systemd-udevd[114]: Using default interface naming scheme 'v261'. machine # [ 1.798768] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.813219] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.814736] systemd[1]: Reached target System Initialization. machine # [ 1.815572] systemd[1]: Reached target Basic System. machine # [ 2.058159] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.060496] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.061270] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.069133] virtio_blk virtio5: 4/0/0 default/read/poll queues machine # [ 2.086694] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.087559] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 machine # [ 2.090330] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.091576] virtio_blk virtio5: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.096682] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.097813] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.099055] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.099960] SCSI subsystem initialized machine # [ 2.100081] usb usb1: Product: EHCI Host Controller machine # [ 2.101394] usb usb1: Manufacturer: Linux 6.18.50 ehci_hcd machine # [ 2.102245] usb usb1: SerialNumber: 0000:00:1d.7 machine # [ 2.125080] hub 1-0:1.0: USB hub found machine # [ 1.971051] systemd[1]: Start[ 2.125729] hub 1-0:1.0: 6 ports detected machine # ing Virtual Console Setup... machine # [ 2.127147] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.127937] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 machine # [ 2.129035] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.129940] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 machine # [ 2.134850] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.136381] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 1.982447] (udev-worker)[118[ 2.137479] usb usb2: Product: UHCI Host Controller machine # ]: Network interface NamePolicy= disabled on ker[ 2.138370] usb usb2: Manufacturer: Linux 6.18.50 uhci_hcd machine # nel command line. machine # [ 2.140060] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.144656] usb usb2: SerialNumber: 0000:00:1d.0 machine # [ 1.990279] (udev-worker)[121]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.147835] hub 2-0:1.0: USB hub found machine # [ 2.148922] hub 2-0:1.0: 2 ports detected machine # [ 1.995391] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.154900] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.001084] systemd-vconsole-[ 2.155701] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # setup[144]: Configuration of first virtual console was [ 2.157207] uhci_hcd 0000:00:1d.1: detected 2 ports machine # skipped, ignoring remaining ones. machine # [ 2.158609] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 machine # [ 2.160255] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.006996] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.161489] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.163190] usb usb3: Product: UHCI Host Controller machine # [ 2.009345] systemd[1]: Finished Virtual Console Setup. machine # [ 2.163922] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.165305] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.010971] systemd[1]: Reached target Initrd Root Device. machine # [ 2.167525] hub 3-0:1.0: USB hub found machine # [ 2.013434] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... machine # [ 2.169059] hub 3-0:1.0: 2 ports detected machine # [ 2.171304] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.172435] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.173575] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.174417] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 machine # [ 2.175591] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.176840] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.177917] usb usb4: Product: UHCI Host Controller machine # [ 2.178656] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.179419] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.180435] hub 4-0:1.0: USB hub found machine # [ 2.181065] hub 4-0:1.0: 2 ports detected machine # [ 2.182582] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.184926] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.187290] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.191972] scsi host0: ahci machine # [ 2.193170] scsi host1: ahci machine # [ 2.039246] systemd-fsck[152]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.195085] scsi host2: ahci machine # [ 2.196039] scsi host3: ahci machine # [ 2.197441] scsi host4: ahci machine # [ 2.043513] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.200036] scsi host5: ahci machine # [ 2.200740] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 machine # [ 2.202354] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 machine # [ 2.203929] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 machine # [ 2.205263] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 machine # [ 2.206509] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 machine # [ 2.207852] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 machine # [ 2.363816] usb 1-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.493712] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.494912] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.495964] usb 1-1: Product: QEMU USB Tablet machine # [ 2.496632] usb 1-1: Manufacturer: QEMU machine # [ 2.497249] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.512593] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.522584] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.525021] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.527518] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.528528] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.530688] ata3.00: applying bridge limits machine # [ 2.532433] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.533503] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.535683] ata3.00: configured for UDMA/100 machine # [ 2.537491] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.544052] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.571746] usbcore: registered new interface driver usbhid machine # [ 2.573195] usbhid: USB HID core driver machine # [ 2.577413] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.579113] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.598968] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.630905] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.669413] systemd[1]: Mounting /sysroot... machine # [ 2.950252] EXT4-fs (vda): mounted filesystem 10d162fc-e8f2-4e85-a444-7c5bef78cd66 r/w with ordered data mode. Quota mode: none. machine # [ 2.798843] systemd[1]: Mounted /sysroot. machine # [ 2.799582] systemd[1]: Reached target Initrd Root File System. machine # [ 2.801198] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.802880] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.805222] systemd[1]: Mounting /sysroot/run... machine # [ 2.814413] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.816390] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.819054] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.823794] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.978460] 9p: Installing v9fs 9p2000 file system support machine # [ 2.824838] systemd[1]: Mounted /sysroot/run. machine # [ 2.830253] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.831148] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 2.831885] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 2.833855] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 2.840109] systemd-sysroot-fstab-check[193]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.842611] systemd[1]: Reload requested from client PID 193 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.844127] systemd[1]: Reloading... machine # [ 2.896772] systemd[1]: Reloading finished in 53 ms. machine # [ 2.919994] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 2.921124] systemd-sysroot-fstab-check[193]: Requesting initrd-fs.target/start/replace... machine # [ 2.922342] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 2.923238] systemd-sysroot-fstab-check[193]: Requesting swap.target/start/replace... machine # [ 2.924330] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.925329] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 2.926293] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 2.927282] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 2.935233] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 2.936570] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.670122] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.709554] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.711132] systemd[1]: Reached target Initrd File Systems. machine # [ 3.713050] systemd[1]: Starting Find NixOS closure... machine # [ 3.714768] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.739312] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.740878] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.745147] systemd[1]: Finished Find NixOS closure. machine # [ 3.746171] systemd[1]: Reached target Initrd Default Target. machine # [ 3.747722] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.767402] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.769538] systemd[1]: Stopped target Basic System. machine # [ 3.771295] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.773156] systemd[1]: Stopped target Path Units. machine # [ 3.774754] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.777552] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.780279] systemd[1]: Stopped target Slice Units. machine # [ 3.781989] systemd[1]: Stopped target Socket Units. machine # [ 3.783550] systemd[1]: Stopped target System Initialization. machine # [ 3.785285] systemd[1]: Stopped target Swaps. machine # [ 3.786750] systemd[1]: Stopped target Timer Units. machine # [ 3.788226] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.789924] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.791636] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.793703] systemd[1]: Stopped Find NixOS closure. machine # [ 3.795126] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 3.799547] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.801221] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.802395] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.803401] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.804635] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.805642] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.806994] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.808577] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.811684] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.813367] systemd[1]: Stopped target Local File Systems. machine # [ 3.815699] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.817288] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.818332] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.819123] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.820196] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.821292] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.822159] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.823188] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 3.824252] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.825649] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.826910] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 3.828204] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 3.831703] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 3.832678] systemd[1]: Closed udev Control Socket. machine # [ 3.834430] systemd[1]: Starting Cleanup udev Database... machine # [ 3.835251] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 3.836358] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 3.837237] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 3.838360] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 3.839373] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 3.840368] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 3.866413] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 3.867506] systemd[1]: Finished Cleanup udev Database. machine # [ 3.868728] systemd[1]: Reached target Switch Root. machine # [ 3.870630] systemd[1]: Starting NixOS Activation... machine # [ 4.065108] initrd-nixos-activation-start[241]: booting system configuration /nix/store/fkda0d8zal2a0y4fvklsp82jv571g1cx-nixos-system-machine-test machine # [ 4.123333] initrd-nixos-activation-start[241]: running activation script... machine # [ 4.475763] initrd-nixos-activation-start[264]: setting up /etc... machine # [ 4.702856] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 4.705839] systemd[1]: Finished NixOS Activation. machine # [ 4.709599] systemd[1]: Starting Switch Root... machine # [ 4.736184] systemd[1]: Switching root. machine # [ 4.950954] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). machine # [ 5.130429] NET: Registered PF_VSOCK protocol family machine # [ 5.547044] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.557136] systemd[1]: Detected virtualization kvm. machine # [ 5.558982] systemd[1]: Detected architecture x86-64. machine # [ 5.560913] systemd[1]: Detected first boot. machine # [ 5.567566] systemd[1]: Initializing machine ID from random generator. machine # [ 5.729497] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 5.841722] systemd[1]: Applying preset policy. machine # [ 6.218596] systemd[1]: Populated /etc with preset unit settings. machine # [ 6.708961] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 6.710520] systemd[1]: Stopped initrd-switch-root.service. machine # [ 6.713839] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 6.716417] systemd[1]: Created slice Slice /system/getty. machine # [ 6.717837] systemd[1]: Created slice User and Session Slice. machine # [ 6.718832] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 6.720105] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 6.721199] systemd[1]: Expecting device /dev/hvc0... machine # [ 6.721925] systemd[1]: Expecting device /dev/ttyS0... machine # [ 6.722719] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 6.723602] systemd[1]: Stopped target initrd-fs.target. machine # [ 6.724409] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 6.725284] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 6.726258] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 6.727210] systemd[1]: Reached target Path Units. machine # [ 6.727969] systemd[1]: Reached target Remote File Systems. machine # [ 6.728825] systemd[1]: Reached target Slice Units. machine # [ 6.729693] systemd[1]: Reached target Swaps. machine # [ 6.733010] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 6.736877] systemd[1]: Listening on Process Core Dump Socket. machine # [ 6.739551] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 6.742225] systemd[1]: Listening on Factory Reset Management. machine # [ 6.743180] systemd[1]: Listening on Hostname Service Socket. machine # [ 6.747051] systemd[1]: Starting Journal Log Access Socket... machine # [ 6.748639] systemd[1]: Listening on Journal Audit Socket. machine # [ 6.751439] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 6.752802] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 6.754699] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.756256] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 6.765095] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 6.766184] systemd[1]: Listening on udev Control Socket. machine # [ 6.767157] systemd[1]: Listening on udev Varlink Socket. machine # [ 6.771834] systemd[1]: Mounting Huge Pages File System... machine # [ 6.775017] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 6.778204] systemd[1]: Mounting Kernel Debug File System... machine # [ 6.781287] systemd[1]: Mounting Kernel Trace File System... machine # [ 6.786985] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 6.794206] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 6.805810] systemd[1]: Starting Load Kernel Module configfs... machine # [ 6.807874] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 6.809876] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 6.812048] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 6.833320] systemd[1]: Mounting FUSE Control File System... machine # [ 6.835459] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 6.843427] systemd[1]: Starting Journal Service... machine # [ 6.856070] systemd[1]: Starting Load Kernel Modules... machine # [ 6.861134] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 6.866151] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 6.867672] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.871770] systemd[1]: Starting Coldplug All udev Devices... machine # [ 6.876271] systemd[1]: Listening on Journal Log Access Socket. machine # [ 6.879778] systemd[1]: Mounted Huge Pages File System. machine # [ 6.882488] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 6.884739] systemd[1]: Mounted Kernel Debug File System. machine # [ 6.887697] systemd[1]: Mounted Kernel Trace File System. machine # [ 6.889799] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 6.891370] systemd-journald[334]: Collecting audit messages is enabled. machine # [ 6.892113] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 6.895849] systemd[1]: Finished Load Kernel Module configfs. machine # [ 6.897798] systemd[1]: Mounted FUSE Control File System. machine # [ 6.901449] systemd[1]: Mounting Kernel Configuration File System... machine # [ 6.905550] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 6.752208] systemd[1]: Queued start job for default target Multi-User System. machine # [ 6.907400] systemd[1]: Started Journal Service. machine # [ 6.756553] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 6.760184] systemd-modules-load[336]: Using 2 probe threads machine # [ 6.915929] EXT4-fs (vda): re-mounted 10d162fc-e8f2-4e85-a444-7c5bef78cd66. machine # [ 6.765810] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 6.770986] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 6.927149] loop: module loaded machine # [ 6.773734] systemd-modules-load[336]: Inserted module 'loop' machine # [ 6.774976] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 6.776523] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 6.779646] systemd-oomd[337]: No swap; memory pressure usage will be degraded machine # [ 6.781388] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 6.782565] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 6.784235] systemd[1]: Finished Load Kernel Modules. machine # [ 6.786840] systemd[1]: Starting Apply Kernel Variables... machine # [ 6.788361] systemd[1]: Mounted Kernel Configuration File System. machine # [ 6.792184] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 6.962915] systemd-journald[334]: Received client request to flush runtime journal. machine # [ 6.859967] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 6.861793] systemd[1]: Reached target First Boot Complete. machine # [ 6.862817] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 6.863837] systemd[1]: Finished Apply Kernel Variables. machine # [ 6.864770] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 6.866062] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 6.885360] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 6.886335] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 6.888118] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 6.913683] systemd[1]: Finished Coldplug All udev Devices. machine # [ 6.956200] systemd-udevd[367]: Using default interface naming scheme 'v261'. machine # [ 7.053507] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 7.125216] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 7.155123] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 7.169070] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 7.182722] (udev-worker)[373]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 7.185540] (udev-worker)[380]: Network interface NamePolicy= disabled on kernel command line. machine # [ 7.186868] (udev-worker)[373]: Network interface NamePolicy= disabled on kernel command line. machine # [ 7.213080] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 7.214951] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 7.216727] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 7.219411] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 7.221247] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os[ 7.376701] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # machine # [ 7.223802] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.382536] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 7.383965] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 machine # [ 7.384734] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 7.398170] Console: switching to colour dummy device 80x25 machine # [ 7.399309] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 7.399311] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 7.403569] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 7.404708] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 7.420682] ACPI: button: Power Button [PWRF] machine # [ 7.423025] Console: switching to colour frame buffer device 160x50 machine # [ 7.425184] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 7.436204] rtc_cmos 00:04: RTC can wake from S4 machine # [ 7.440861] mousedev: PS/2 mouse device common for all mice machine # [ 7.445254] rtc_cmos 00:04: registered as rtc0 machine # [ 7.445971] rtc_cmos 00:04: setting system clock to 2026-09-22T10:55:36 UTC (1790074536) machine # [ 7.447653] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 7.449260] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 7.450060] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 7.469323] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.470307] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 7.488803] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.511937] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 7.372262] systemd[1]: Starting Virtual Console Setup... machine # [ 7.545246] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 7.551887] ppdev: user-space parallel port driver machine # [ 7.558009] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 7.407453] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 7.410052] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.417208] systemd[1]: Starting Virtual Console Setup... machine # [ 7.649005] kvm_amd: TSC scaling supported machine # [ 7.649583] kvm_amd: Nested Virtualization enabled machine # [ 7.650265] kvm_amd: Nested Paging enabled machine # [ 7.650783] kvm_amd: LBR virtualization supported machine # [ 7.651342] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 7.651968] kvm_amd: Virtual GIF supported machine # [ 7.652467] kvm_amd: Virtual NMI enabled machine # [ 7.556710] systemd[1]: Mounting /run/wrappers... machine # [ 7.592115] systemd[1]: Mounted /run/wrappers. machine # [ 7.593914] systemd[1]: Reached target Local File Systems. machine # [ 7.596504] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.599454] systemd[1]: Starting register-nix-paths.service... machine # [ 7.602301] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.758090] EDAC MC: Ver: 3.0.0 machine # [ 7.603536] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.607653] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.613337] systemd[1]: Starting Create System Files and Directories... machine # [ 7.650359] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 7.651864] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 7.673088] systemd[1]: Finished Create System Files and Directories. machine # [ 7.675857] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 7.678434] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 7.704753] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 7.729520] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 7.731573] systemd[1]: Starting Update is Completed... machine # [ 7.756973] systemd[1]: Finished Update is Completed. machine # [ 7.808783] systemd-vconsole-setup[409]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 7.811750] systemd[1]: Finished Virtual Console Setup. machine # [ 7.912036] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 7.913230] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 8.406227] systemd[1]: Finished register-nix-paths.service. machine # [ 8.407491] systemd[1]: Reached target System Initialization. machine # [ 8.408456] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 8.409603] systemd[1]: Started niks3 garbage collection timer. machine # [ 8.410599] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 8.411690] systemd[1]: Reached target Timer Units. machine # [ 8.412533] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 8.420849] systemd[1]: Listening on niks3 server socket. machine # [ 8.421780] systemd[1]: Listening on Nix Daemon Socket. machine # [ 8.422649] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 8.424112] systemd[1]: Reached target Socket Units. machine # [ 8.425110] systemd[1]: Reached target Basic System. machine # [ 8.426444] systemd[1]: Started backdoor.service. machine # [ 8.428633] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 8.430991] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.434549] systemd[1]: Starting Post-Boot Actions... machine # [ 8.440978] systemd[1]: Started Reset console on configuration changes. machine # [ 8.445843] systemd[1]: Starting resolvconf update... machine # [ 8.447676] systemd[1]: Started rustfs.service. machine # [ 8.450671] systemd[1]: Starting rustfs-bucket.service... machine # [ 8.453895] systemd[1]: Starting D-Bus System Message Bus... machine # [ 8.472731] systemd[1]: Finished Post-Boot Actions. machine # connecting to host... machine # [ 8.500498] nsncd[492]: Sep 22 10:55:37.708 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.502128] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.505783] systemd[1]: Finished Import lastlog data into lastlog2 database. machine # [ 8.508168] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.510042] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.516332] systemd[1]: Starting User Login Management... machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 9.22 seconds) machine: (finished: waiting for the VM to finish booting, in 9.67 seconds) machine # [ 8.544034] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 8.561613] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.562362] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.562920] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.563608] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.564141] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.567515] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.568496] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.570800] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync' machine # [ 8.571813] dbus-broker-launch[499]: Invalid user-name in /nix/store/sjdn8ydiry7lgasbr6jfz0ilm5vcd4dl-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 8.573405] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.589645] systemd-logind[526]: New seat seat0. machine # [ 8.594057] systemd-logind[526]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 8.594777] systemd-logind[526]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 8.595037] systemd-logind[526]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 8.613886] systemd[1]: Started D-Bus System Message Bus. machine # [ 8.614874] systemd[1]: Started User Login Management. machine # [ 8.616359] systemd[1]: Starting linger-users.service... machine # [ 8.620340] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.621457] nsncd[577]: Sep 22 10:55:37.828 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.622389] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.623125] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.629680] dbus-broker-launch[499]: Ready machine # [ 8.649384] systemd[1]: Finished resolvconf update. machine # [ 8.650344] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.650830] systemd[1]: Finished linger-users.service. machine # [ 8.654282] systemd[1]: Reached target Preparation for Network. machine # [ 8.657797] systemd[1]: Starting DHCP Client... machine # [ 8.659676] systemd[1]: Starting Address configuration of eth1... machine # [ 8.661827] systemd[1]: Starting Extra networking commands.... machine # [ 8.734594] network-addresses-eth1-start[612]: adding address 192.168.1.1/24... done machine # [ 8.744347] network-addresses-eth1-start[612]: adding address 2001:db8:1::1/64... done machine # [ 8.757094] systemd[1]: Finished Address configuration of eth1. machine # [ 8.758491] dhcpcd[621]: dhcpcd-10.3.2 starting machine # [ 8.767074] dhcpcd[663]: dev: loaded udev machine # [ 8.942224] 8021q: 802.1Q VLAN Support v1.8 machine # [ 8.943517] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 8.791116] systemd[1]: Finished Extra networking commands.. machine # [ 8.791789] systemd[1]: Reached target Network. machine # [ 8.794731] systemd[1]: Starting PostgreSQL Server... machine # [ 8.798246] systemd[1]: Starting Permit User Sessions... machine # [ 8.816118] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 8.830125] systemd[1]: Finished Permit User Sessions. machine # [ 8.833049] systemd[1]: Started Getty on tty1. machine # [ 8.833958] systemd[1]: Reached target Login Prompts. machine # [ 9.057511] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 9.079884] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 9.081626] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 9.084981] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 9.086576] cfg80211: failed to load regulatory.db machine # [ 8.954310] postgresql-pre-start[700]: The files belonging to this database system will be owned by user "postgres". machine # [ 8.956761] postgresql-pre-start[700]: This user must also own the server process. machine # [ 8.962216] postgresql-pre-start[700]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 8.964107] postgresql-pre-start[700]: The default database encoding has accordingly been set to "UTF8". machine # [ 8.966072] postgresql-pre-start[700]: The default text search configuration will be set to "english". machine # [ 8.968088] postgresql-pre-start[700]: Data page checksums are enabled. machine # [ 8.969593] postgresql-pre-start[700]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 8.971765] postgresql-pre-start[700]: creating subdirectories ... ok machine # [ 8.973057] postgresql-pre-start[700]: selecting dynamic shared memory implementation ... posix machine # [ 9.135431] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 8.983224] dhcpcd[663]: eth0: waiting for carrier machine # [ 8.983849] dhcpcd[663]: eth0: carrier acquired machine # [ 8.991448] dhcpcd[663]: DUID 00:01:00:01:32:45:1b:2a:52:54:00:12:34:56 machine # [ 8.992070] dhcpcd[663]: eth0: IAID 00:12:34:56 machine # [ 8.992651] dhcpcd[663]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 9.041521] postgresql-pre-start[700]: selecting default "max_connections" ... 100 machine # [ 9.100373] postgresql-pre-start[700]: selecting default "shared_buffers" ... 128MB machine # [ 10.749352] dhcpcd[663]: eth0: soliciting a DHCP lease machine # [ 10.924259] NET: Registered PF_PACKET protocol family machine # [ 10.780563] dhcpcd[663]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 10.785190] dhcpcd[663]: eth0: probing address 10.0.2.15/24 machine # [ 10.796066] postgresql-pre-start[700]: selecting default time zone ... UTC machine # [ 10.799143] postgresql-pre-start[700]: creating configuration files ... ok machine # [ 11.034324] postgresql-pre-start[700]: running bootstrap script ... ok machine # [ 11.246960] dhcpcd[663]: eth0: soliciting an IPv6 router machine # [ 11.249469] dhcpcd[663]: eth0: Router Advertisement from fe80::2 machine # [ 11.251658] dhcpcd[663]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 11.254068] dhcpcd[663]: eth0: adding route to fec0::/64 machine # [ 11.256373] dhcpcd[663]: eth0: adding default route via fe80::2 machine # [ 11.641556] postgresql-pre-start[700]: performing post-bootstrap initialization ... ok machine # [ 11.811532] postgresql-pre-start[700]: syncing data to disk ... ok machine # [ 11.814711] postgresql-pre-start[700]: initdb: warning: enabling "trust" authentication for local connections machine # [ 11.819217] postgresql-pre-start[700]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 11.829534] postgresql-pre-start[700]: Success. You can now start the database server using: machine # [ 11.834720] postgresql-pre-start[700]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 11.960291] postgres[761]: [761] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 11.966657] postgres[761]: [761] LOG: listening on IPv6 address "::1", port 5432 machine # [ 11.969705] postgres[761]: [761] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 11.972714] postgres[761]: [761] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 11.980755] postgres[775]: [775] LOG: database system was shut down at 2026-09-22 10:55:40 GMT machine # [ 11.985629] postgres[761]: [761] LOG: database system is ready to accept connections machine # [ 11.989880] systemd[1]: Started PostgreSQL Server. machine # [ 11.996229] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 12.291857] postgresql-setup-start[786]: CREATE DATABASE machine # [ 12.332277] postgresql-setup-start[791]: CREATE ROLE machine # [ 12.356248] postgresql-setup-start[793]: ALTER DATABASE machine # [ 12.361126] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 12.362264] systemd[1]: Reached target PostgreSQL. machine # [ 16.130214] dhcpcd[663]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 16.130976] dhcpcd[663]: eth0: adding route to 10.0.2.0/24 machine # [ 16.131616] dhcpcd[663]: eth0: adding default route via 10.0.2.2 machine # [ 16.248104] systemd[1]: Started DHCP Client. machine # [ 16.249957] systemd[1]: Reached target Network is Online. machine # [ 16.253603] systemd[1]: Starting k3s service... machine # [ 16.364092] k3s[893]: time="2026-09-22T10:55:45Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 16.366530] k3s[893]: time="2026-09-22T10:55:45Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/76c98da5fd74d9a243cba8d533ae287fc547ab08ccd8c5ea4811608ce7075724" machine # [ 16.914793] rustfs-bucket-start[898]: mb s3://farm machine # [ 16.920117] systemd[1]: Finished rustfs-bucket.service. machine # [ 20.196162] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 20.207995] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 20.209679] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 20.211185] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 20.232367] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Database tables and indexes are up to date" machine # [ 20.234278] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 20.243736] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Startup VACUUM completed successfully" machine # [ 20.248639] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Kine available at unix://kine.sock" machine # [ 20.250107] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 20.255730] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 20.259834] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:49.464252438 +0000 UTC notAfter=2036-09-19 09:55:49.464252438 +0000 UTC" machine # [ 20.261140] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.262395] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.263309] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.264343] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.265184] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.266137] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.267077] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790074549: notBefore=2026-09-22 09:55:49.472071309 +0000 UTC notAfter=2036-09-19 09:55:49.472071309 +0000 UTC" machine # [ 20.268085] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.268960] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.270195] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.271135] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790074549: notBefore=2026-09-22 09:55:49.476029912 +0000 UTC notAfter=2036-09-19 09:55:49.476029912 +0000 UTC" machine # [ 20.272140] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.272979] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790074549: notBefore=2026-09-22 09:55:49.477392655 +0000 UTC notAfter=2036-09-19 09:55:49.477392655 +0000 UTC" machine # [ 20.274180] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.274782] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790074549: notBefore=2026-09-22 09:55:49.478770205 +0000 UTC notAfter=2036-09-19 09:55:49.478770205 +0000 UTC" machine # [ 20.275704] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.276610] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.394251] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790074549: notBefore=2026-09-22 09:55:49 +0000 UTC notAfter=2027-09-22 09:55:49 +0000 UTC" machine # [ 20.396549] k3s[893]: time="2026-09-22T10:55:49Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 20.412833] k3s[893]: time="2026-09-22T10:55:49Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f8e_eb88_6d88_d67f-bb4b32:fec0::f8e:eb88:6d88:d67f listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=AF259E5AECAA193C83B17BB5782D294169268AAB]" machine # [ 21.429723] k3s[893]: time="2026-09-22T10:55:50Z" level=info msg="Password verified locally for node machine" machine # [ 21.433211] k3s[893]: time="2026-09-22T10:55:50Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790074549: notBefore=2026-09-22 09:55:50 +0000 UTC notAfter=2027-09-22 09:55:50 +0000 UTC" machine # [ 21.678167] k3s[893]: time="2026-09-22T10:55:50Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:50 +0000 UTC notAfter=2027-09-22 09:55:50 +0000 UTC" machine # [ 21.787489] k3s[893]: time="2026-09-22T10:55:50Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:50 +0000 UTC notAfter=2027-09-22 09:55:50 +0000 UTC" machine # [ 21.897197] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790074549: notBefore=2026-09-22 09:55:51 +0000 UTC notAfter=2027-09-22 09:55:51 +0000 UTC" machine # [ 21.983447] k3s[893]: time="2026-09-22T10:55:51Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:52618: runtime core not ready" machine # [ 22.061992] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Module overlay was already loaded" machine # [ 22.341558] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 22.349355] Bridge firewalling registered machine # [ 22.217285] k3s[893]: time="2026-09-22T10:55:51Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 22.234936] k3s[893]: time="2026-09-22T10:55:51Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 22.253631] k3s[893]: time="2026-09-22T10:55:51Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 22.357536] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 22.358948] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 22.360139] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 22.365822] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 22.372612] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 22.373946] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 22.381496] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 22.383060] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 22.386418] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Handling backend connection request [machine]" machine # [ 22.388181] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Connection to etcd is ready" machine # [ 22.389568] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="ETCD server is now running" machine # [ 22.390897] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 22.392616] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 22.394635] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 22.396591] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 22.423397] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 22.424037] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 22.424625] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 22.425201] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 22.425965] k3s[893]: I0922 10:55:51.602079 893 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 22.426756] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 22.427629] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 22.428596] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 22.430040] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 22.430936] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Run: k3s kubectl" machine # [ 22.431767] k3s[893]: I0922 10:55:51.607803 893 server.go:158] Version: v1.35.8+k3s1 machine # [ 22.432237] k3s[893]: I0922 10:55:51.607855 893 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 22.466927] k3s[893]: time="2026-09-22T10:55:51Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:52686: runtime core not ready" machine # [ 22.493220] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 22.495327] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 22.551087] k3s[893]: I0922 10:55:51.759361 893 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 22.554051] k3s[893]: I0922 10:55:51.762326 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.555308] k3s[893]: I0922 10:55:51.763818 893 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 22.560079] k3s[893]: I0922 10:55:51.763837 893 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 22.564872] k3s[893]: I0922 10:55:51.764127 893 instance.go:240] Using reconciler: lease machine # [ 22.566064] k3s[893]: I0922 10:55:51.769613 893 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 22.567577] k3s[893]: W0922 10:55:51.769633 893 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 22.569236] k3s[893]: I0922 10:55:51.772540 893 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 22.595140] k3s[893]: time="2026-09-22T10:55:51Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 22.599809] k3s[893]: I0922 10:55:51.804616 893 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 22.601413] k3s[893]: I0922 10:55:51.804795 893 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 22.621362] k3s[893]: I0922 10:55:51.829902 893 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 22.662110] k3s[893]: I0922 10:55:51.870674 893 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 22.664163] k3s[893]: W0922 10:55:51.870702 893 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 22.666348] k3s[893]: W0922 10:55:51.870714 893 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 22.668144] k3s[893]: I0922 10:55:51.871008 893 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 22.670150] k3s[893]: W0922 10:55:51.871023 893 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 22.672342] k3s[893]: I0922 10:55:51.871571 893 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 22.673838] k3s[893]: I0922 10:55:51.872008 893 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 22.675281] k3s[893]: W0922 10:55:51.872025 893 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 22.677370] k3s[893]: W0922 10:55:51.872037 893 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 22.679141] k3s[893]: I0922 10:55:51.872880 893 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 22.680668] k3s[893]: W0922 10:55:51.872896 893 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 22.682341] k3s[893]: I0922 10:55:51.873375 893 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 22.684270] k3s[893]: W0922 10:55:51.873394 893 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 22.686232] k3s[893]: W0922 10:55:51.873406 893 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 22.688274] k3s[893]: I0922 10:55:51.873755 893 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 22.690147] k3s[893]: W0922 10:55:51.873768 893 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 22.692322] k3s[893]: W0922 10:55:51.873806 893 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 22.694397] k3s[893]: I0922 10:55:51.874131 893 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 22.696186] k3s[893]: W0922 10:55:51.874145 893 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 22.698263] k3s[893]: I0922 10:55:51.875324 893 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 22.700165] k3s[893]: W0922 10:55:51.875341 893 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 22.702170] k3s[893]: I0922 10:55:51.875593 893 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 22.703991] k3s[893]: W0922 10:55:51.875606 893 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 22.706053] k3s[893]: W0922 10:55:51.875617 893 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 22.708129] k3s[893]: I0922 10:55:51.876050 893 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 22.709841] k3s[893]: W0922 10:55:51.876065 893 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 22.711751] k3s[893]: I0922 10:55:51.876920 893 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 22.713676] k3s[893]: W0922 10:55:51.876942 893 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 22.715856] k3s[893]: W0922 10:55:51.876953 893 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 22.718134] k3s[893]: I0922 10:55:51.877254 893 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 22.719961] k3s[893]: W0922 10:55:51.877274 893 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 22.721966] k3s[893]: W0922 10:55:51.877286 893 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 22.723989] k3s[893]: I0922 10:55:51.878600 893 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 22.725876] k3s[893]: W0922 10:55:51.878641 893 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 22.727732] k3s[893]: W0922 10:55:51.878671 893 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 22.729341] k3s[893]: I0922 10:55:51.879255 893 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 22.731280] k3s[893]: W0922 10:55:51.879270 893 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 22.733409] k3s[893]: W0922 10:55:51.879280 893 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 22.735521] k3s[893]: W0922 10:55:51.879290 893 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 22.737685] k3s[893]: I0922 10:55:51.881320 893 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 22.739289] k3s[893]: W0922 10:55:51.881338 893 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 22.741226] k3s[893]: W0922 10:55:51.881349 893 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 22.743092] k3s[893]: I0922 10:55:51.882619 893 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 22.745061] k3s[893]: W0922 10:55:51.882686 893 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 22.747222] k3s[893]: W0922 10:55:51.882697 893 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 22.749159] k3s[893]: I0922 10:55:51.883089 893 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 22.750688] k3s[893]: W0922 10:55:51.883103 893 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 22.752609] k3s[893]: I0922 10:55:51.884453 893 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 22.754170] k3s[893]: W0922 10:55:51.884470 893 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 22.756106] k3s[893]: W0922 10:55:51.884480 893 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 22.757918] k3s[893]: W0922 10:55:51.884490 893 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 22.759893] k3s[893]: I0922 10:55:51.887746 893 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 22.761696] k3s[893]: W0922 10:55:51.887764 893 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 23.007831] k3s[893]: I0922 10:55:52.216270 893 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 23.010386] k3s[893]: I0922 10:55:52.216447 893 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 23.012526] k3s[893]: I0922 10:55:52.216643 893 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 23.014019] k3s[893]: I0922 10:55:52.216795 893 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 23.017288] k3s[893]: I0922 10:55:52.216901 893 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 23.019058] k3s[893]: I0922 10:55:52.217134 893 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 23.020907] k3s[893]: I0922 10:55:52.217151 893 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 23.022646] k3s[893]: I0922 10:55:52.217204 893 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 23.024323] k3s[893]: I0922 10:55:52.217216 893 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 23.026145] k3s[893]: I0922 10:55:52.217264 893 aggregator.go:185] waiting for initial CRD sync... machine # [ 23.027548] k3s[893]: I0922 10:55:52.217265 893 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 23.029577] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 23.031081] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 23.032792] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 23.034320] k3s[893]: I0922 10:55:52.217574 893 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 23.036796] k3s[893]: I0922 10:55:52.217617 893 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 23.038495] k3s[893]: I0922 10:55:52.217643 893 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 23.040654] k3s[893]: I0922 10:55:52.218043 893 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 23.042335] k3s[893]: I0922 10:55:52.218137 893 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 23.043953] k3s[893]: I0922 10:55:52.218154 893 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 23.045642] k3s[893]: I0922 10:55:52.218292 893 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 23.047727] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 23.049467] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 23.051027] k3s[893]: I0922 10:55:52.218922 893 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 23.052915] k3s[893]: I0922 10:55:52.219266 893 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 23.056110] k3s[893]: I0922 10:55:52.219558 893 controller.go:78] Starting OpenAPI AggregationController machine # [ 23.057560] k3s[893]: I0922 10:55:52.219601 893 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 23.059115] k3s[893]: I0922 10:55:52.220247 893 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 23.060814] k3s[893]: I0922 10:55:52.220264 893 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 23.062724] k3s[893]: I0922 10:55:52.220641 893 controller.go:142] Starting OpenAPI controller machine # [ 23.064192] k3s[893]: I0922 10:55:52.220733 893 controller.go:90] Starting OpenAPI V3 controller machine # [ 23.065590] k3s[893]: I0922 10:55:52.220763 893 naming_controller.go:305] Starting NamingConditionController machine # [ 23.067206] k3s[893]: I0922 10:55:52.220859 893 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 23.069083] k3s[893]: I0922 10:55:52.220890 893 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 23.071199] k3s[893]: I0922 10:55:52.220919 893 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 23.072578] k3s[893]: I0922 10:55:52.221034 893 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 23.074509] k3s[893]: I0922 10:55:52.221053 893 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 23.077154] k3s[893]: I0922 10:55:52.221405 893 repairip.go:210] Starting ipallocator-repair-controller machine # [ 23.077885] k3s[893]: I0922 10:55:52.221419 893 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 23.078823] k3s[893]: I0922 10:55:52.260476 893 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 23.079696] k3s[893]: I0922 10:55:52.262925 893 shared_informer.go:377] "Caches are synced" machine # [ 23.080221] k3s[893]: I0922 10:55:52.262959 893 policy_source.go:248] refreshing policies machine # [ 23.099568] k3s[893]: E0922 10:55:52.308112 893 controller.go:201] "Failed to ensure lease exists, will retry" err="namespaces \"kube-system\" not found" interval="200ms" machine # [ 23.109068] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="Caches are synced" logger=k3s machine # [ 23.109548] k3s[893]: I0922 10:55:52.317563 893 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 23.110073] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="Caches are synced" logger=k3s machine # [ 23.110510] k3s[893]: I0922 10:55:52.317630 893 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 23.111343] k3s[893]: I0922 10:55:52.319930 893 controller.go:667] quota admission added evaluator for: namespaces machine # [ 23.115159] k3s[893]: I0922 10:55:52.323756 893 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 23.115789] k3s[893]: I0922 10:55:52.323869 893 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 23.116464] k3s[893]: I0922 10:55:52.323930 893 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 23.116992] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="Caches are synced" logger=k3s machine # [ 23.117704] k3s[893]: I0922 10:55:52.324226 893 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 23.118198] k3s[893]: I0922 10:55:52.324243 893 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 23.118746] k3s[893]: I0922 10:55:52.324753 893 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 23.119439] k3s[893]: I0922 10:55:52.324960 893 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 23.119995] k3s[893]: I0922 10:55:52.324984 893 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 23.120502] k3s[893]: I0922 10:55:52.325156 893 aggregator.go:187] initial CRD sync complete... machine # [ 23.121022] k3s[893]: I0922 10:55:52.325170 893 autoregister_controller.go:144] Starting autoregister controller machine # [ 23.121494] k3s[893]: I0922 10:55:52.325181 893 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 23.121976] k3s[893]: I0922 10:55:52.325192 893 cache.go:39] Caches are synced for autoregister controller machine # [ 23.137072] k3s[893]: I0922 10:55:52.345575 893 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 23.137697] k3s[893]: I0922 10:55:52.345673 893 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 23.148069] k3s[893]: I0922 10:55:52.354870 893 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 23.148739] k3s[893]: I0922 10:55:52.355108 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 23.187798] k3s[893]: I0922 10:55:52.396348 893 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 23.195073] k3s[893]: W0922 10:55:52.403632 893 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 23.197991] k3s[893]: I0922 10:55:52.406571 893 controller.go:667] quota admission added evaluator for: endpoints machine # [ 23.203931] k3s[893]: I0922 10:55:52.412517 893 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 23.209395] k3s[893]: E0922 10:55:52.417983 893 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 23.308231] k3s[893]: I0922 10:55:52.516530 893 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 23.500900] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="containerd is now running" machine # [ 23.511150] k3s[893]: time="2026-09-22T10:55:52Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 24.016276] k3s[893]: I0922 10:55:53.224773 893 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 24.021360] k3s[893]: I0922 10:55:53.229939 893 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 24.022138] k3s[893]: I0922 10:55:53.229965 893 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 24.371544] k3s[893]: time="2026-09-22T10:55:53Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 24.843639] k3s[893]: I0922 10:55:54.051793 893 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 24.883193] k3s[893]: I0922 10:55:54.091763 893 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 26.376599] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Kube API server is now running" machine # [ 26.377922] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="k3s is up and running" machine # [ 26.378903] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Waiting for untainted node" machine # [ 26.380027] systemd[1]: Started k3s service. machine # [ 26.380594] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 26.387490] systemd[1]: Starting niks3 server... machine # [ 26.389954] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 26.400465] k3s[893]: I0922 10:55:55.609057 893 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 26.401423] k3s[893]: I0922 10:55:55.609083 893 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 26.403552] k3s[893]: I0922 10:55:55.612134 893 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 26.404402] k3s[893]: I0922 10:55:55.612540 893 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 26.405242] k3s[893]: I0922 10:55:55.612562 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.405945] k3s[893]: I0922 10:55:55.612602 893 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 26.407265] k3s[893]: I0922 10:55:55.612714 893 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 26.408845] k3s[893]: I0922 10:55:55.612774 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 26.410338] k3s[893]: I0922 10:55:55.612790 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.411364] k3s[893]: I0922 10:55:55.612816 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 26.411957] k3s[893]: I0922 10:55:55.612830 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.417636] k3s[893]: I0922 10:55:55.625959 893 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 26.475099] k3s[893]: I0922 10:55:55.683378 893 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 26.498096] k3s[893]: I0922 10:55:55.705557 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 26.499065] k3s[893]: I0922 10:55:55.705613 893 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 26.499917] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 26.502269] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 26.504482] k3s[893]: I0922 10:55:55.713062 893 shared_informer.go:377] "Caches are synced" machine # [ 26.505503] k3s[893]: I0922 10:55:55.713206 893 shared_informer.go:377] "Caches are synced" machine # [ 26.506055] k3s[893]: I0922 10:55:55.713285 893 shared_informer.go:377] "Caches are synced" machine # [ 26.514162] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 26.516720] k3s[893]: I0922 10:55:55.724862 893 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 26.527058] k3s[893]: I0922 10:55:55.735623 893 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 26.528478] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 26.539253] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available" machine # [ 26.544446] k3s[893]: I0922 10:55:55.752991 893 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 26.547073] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Done waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available" machine # [ 26.547670] k3s[893]: time="2026-09-22T10:55:55Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 26.547951] k3s[893]: W0922 10:55:55.755273 893 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # [ 26.564644] k3s[893]: I0922 10:55:55.773209 893 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 26.569347] k3s[893]: I0922 10:55:55.777929 893 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 26.571238] k3s[893]: I0922 10:55:55.779829 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 26.671709] k3s[893]: I0922 10:55:55.880192 893 shared_informer.go:377] "Caches are synced" machine: (finished: waiting for unit k3s.service, in 27.87 seconds) machine: waiting for success: kubectl get ns farm machine # [ 26.967658] k3s[893]: I0922 10:55:56.176046 893 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 27.063880] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 27.066093] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 27.068759] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 27.071467] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 27.074087] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 27.076934] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 27.079201] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 27.081435] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 27.083378] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 27.085745] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 27.087960] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 27.126724] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::f8e:eb88:6d88:d67f 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 27.128373] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 27.395406] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f8e_eb88_6d88_d67f-bb4b32:fec0::f8e:eb88:6d88:d67f listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=AF259E5AECAA193C83B17BB5782D294169268AAB]" machine # [ 27.431180] k3s[893]: time="2026-09-22T10:55:56Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=236) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__f8e_eb88_6d88_d67f-bb4b32:fec0::f8e:eb88:6d88:d67f listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=AF259E5AECAA193C83B17BB5782D294169268AAB]" machine # [ 27.766697] k3s[893]: I0922 10:55:56.975167 893 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 28.234421] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 28.235129] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Creating deploy event broadcaster" machine # [ 28.239285] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 28.240110] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 28.243340] k3s[893]: I0922 10:55:57.451922 893 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 28.251141] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.257083] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 28.258300] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 28.267187] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 28.271760] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 28.272245] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 28.278384] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 28.279149] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 28.282452] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 28.283275] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 28.287630] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 28.288408] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 28.294070] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 28.296866] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 28.297812] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 28.299062] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 28.300812] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 28.301625] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 28.310465] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 28.523286] k3s[893]: I0922 10:55:57.731389 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 28.525516] k3s[893]: I0922 10:55:57.731448 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 28.526310] k3s[893]: I0922 10:55:57.731495 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 28.526969] k3s[893]: I0922 10:55:57.731525 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 28.527774] k3s[893]: I0922 10:55:57.731570 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmcharts.helm.cattle.io" machine # [ 28.528490] k3s[893]: I0922 10:55:57.731619 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 28.528953] k3s[893]: I0922 10:55:57.731680 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 28.529587] k3s[893]: I0922 10:55:57.731726 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 28.530080] k3s[893]: I0922 10:55:57.731755 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 28.530561] k3s[893]: I0922 10:55:57.731785 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 28.531067] k3s[893]: I0922 10:55:57.731811 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 28.531514] k3s[893]: I0922 10:55:57.731839 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 28.532069] k3s[893]: I0922 10:55:57.731903 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 28.532536] k3s[893]: I0922 10:55:57.731949 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 28.533054] k3s[893]: I0922 10:55:57.731985 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 28.533637] k3s[893]: I0922 10:55:57.732014 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 28.534186] k3s[893]: I0922 10:55:57.732048 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 28.534629] k3s[893]: I0922 10:55:57.732073 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="helmchartconfigs.helm.cattle.io" machine # [ 28.535150] k3s[893]: I0922 10:55:57.732100 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 28.535627] k3s[893]: I0922 10:55:57.732132 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 28.536152] k3s[893]: I0922 10:55:57.732163 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 28.536606] k3s[893]: I0922 10:55:57.732190 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 28.537119] k3s[893]: I0922 10:55:57.732215 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 28.537576] k3s[893]: I0922 10:55:57.732267 893 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 28.604520] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 5.094213649s" machine # [ 28.606049] k3s[893]: time="2026-09-22T10:55:57Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 28.667562] k3s[893]: I0922 10:55:57.875976 893 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine # [ 28.821719] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 28.835679] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 29.171923] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 29.182744] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 29.243448] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: waiting for success: kubectl get ns farm, in 2.68 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key machine # [ 29.428047] k3s[893]: I0922 10:55:58.636471 893 serving.go:392] Generated self-signed cert in-memory machine # [ 29.453754] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 29.462322] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 29.463810] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 29.464619] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 29.468047] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 29.470492] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 29.471512] k3s[893]: time="2026-09-22T10:55:58Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key, in 0.24 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key machine # [ 29.663965] k3s[893]: I0922 10:55:58.871942 893 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 29.758641] k3s[893]: I0922 10:55:58.966800 893 serving.go:392] Generated self-signed cert in-memory machine # [ 29.817246] k3s[893]: I0922 10:55:59.025777 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 29.818029] k3s[893]: I0922 10:55:59.025811 893 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 29.824252] k3s[893]: I0922 10:55:59.032836 893 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key, in 0.21 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine # [ 29.933086] k3s[893]: I0922 10:55:59.141569 893 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 29.938176] k3s[893]: I0922 10:55:59.146724 893 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 29.938983] k3s[893]: I0922 10:55:59.146803 893 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 29.939649] k3s[893]: I0922 10:55:59.146863 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.940153] k3s[893]: I0922 10:55:59.146929 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 29.940606] k3s[893]: I0922 10:55:59.146953 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.941540] k3s[893]: I0922 10:55:59.146985 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 29.942301] k3s[893]: I0922 10:55:59.147007 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 29.948642] k3s[893]: I0922 10:55:59.157190 893 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 29.955478] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 29.976985] k3s[893]: I0922 10:55:59.185521 893 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 29.982707] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.21 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 30.138847] k3s[893]: I0922 10:55:59.347321 893 shared_informer.go:377] "Caches are synced" machine # [ 30.139725] k3s[893]: I0922 10:55:59.348313 893 shared_informer.go:377] "Caches are synced" machine # [ 30.140598] k3s[893]: I0922 10:55:59.348505 893 shared_informer.go:377] "Caches are synced" machine # [ 30.167197] k3s[893]: I0922 10:55:59.375413 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 30.167688] k3s[893]: I0922 10:55:59.375456 893 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 30.198965] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 30.205415] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 30.211135] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 30.217353] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 30.217865] k3s[893]: I0922 10:55:59.425817 893 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 30.218503] k3s[893]: I0922 10:55:59.425920 893 node_lifecycle_controller.go:112] Sending events to api server machine # [ 30.219147] k3s[893]: I0922 10:55:59.426236 893 controllermanager.go:329] Started "service-lb-controller" machine # [ 30.219575] k3s[893]: W0922 10:55:59.426251 893 controllermanager.go:306] "node-route-controller" is disabled machine # [ 30.220119] k3s[893]: I0922 10:55:59.426476 893 controllermanager.go:329] Started "cloud-node-controller" machine # [ 30.220607] k3s[893]: I0922 10:55:59.426986 893 node_controller.go:176] Sending events to api server. machine # [ 30.221339] k3s[893]: I0922 10:55:59.427046 893 controller.go:235] Starting service controller machine # [ 30.221865] k3s[893]: I0922 10:55:59.427066 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.222912] k3s[893]: I0922 10:55:59.427161 893 node_controller.go:185] Waiting for informer caches to sync machine # [ 30.243288] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.321190] k3s[893]: I0922 10:55:59.529693 893 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.419717] k3s[893]: I0922 10:55:59.628160 893 shared_informer.go:377] "Caches are synced" machine # [ 30.467213] k3s[893]: I0922 10:55:59.675742 893 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # [ 30.617141] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 30.627309] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 30.770828] k3s[893]: I0922 10:55:59.978967 893 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 30.774389] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 30.789782] k3s[893]: time="2026-09-22T10:55:59Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 30.817791] k3s[893]: I0922 10:56:00.026319 893 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 30.818405] k3s[893]: I0922 10:56:00.026357 893 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 30.969509] k3s[893]: I0922 10:56:00.178022 893 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 30.970751] k3s[893]: I0922 10:56:00.178063 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.971857] k3s[893]: I0922 10:56:00.178801 893 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 30.972779] k3s[893]: I0922 10:56:00.178862 893 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 30.973931] k3s[893]: I0922 10:56:00.178877 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.974773] k3s[893]: I0922 10:56:00.178898 893 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 30.975820] k3s[893]: I0922 10:56:00.178915 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.976732] k3s[893]: I0922 10:56:00.178952 893 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 30.977832] k3s[893]: I0922 10:56:00.178965 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.978434] k3s[893]: I0922 10:56:00.179009 893 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 30.978925] k3s[893]: I0922 10:56:00.179022 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.979542] k3s[893]: I0922 10:56:00.179106 893 controller.go:423] "Starting resource claim controller" machine # [ 30.980073] k3s[893]: I0922 10:56:00.179129 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.980442] k3s[893]: I0922 10:56:00.179162 893 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 30.980850] k3s[893]: I0922 10:56:00.179175 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.981270] k3s[893]: I0922 10:56:00.179258 893 job_controller.go:254] "Starting job controller" machine # [ 30.982206] k3s[893]: I0922 10:56:00.179272 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.982934] k3s[893]: I0922 10:56:00.179315 893 horizontal.go:204] "Starting HPA controller" machine # [ 30.984091] k3s[893]: I0922 10:56:00.179328 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.985081] k3s[893]: I0922 10:56:00.179405 893 stateful_set.go:180] "Starting stateful set controller" machine # [ 30.985585] k3s[893]: I0922 10:56:00.179419 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.986635] k3s[893]: I0922 10:56:00.179453 893 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 30.987135] k3s[893]: I0922 10:56:00.179467 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.987574] k3s[893]: I0922 10:56:00.179499 893 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 30.987749] k3s[893]: I0922 10:56:00.179515 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.988357] k3s[893]: I0922 10:56:00.179606 893 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 30.988844] k3s[893]: I0922 10:56:00.179619 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.989455] k3s[893]: I0922 10:56:00.179676 893 gc_controller.go:98] "Starting GC controller" machine # [ 30.989948] k3s[893]: I0922 10:56:00.179699 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.990563] k3s[893]: I0922 10:56:00.179964 893 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 30.991066] k3s[893]: I0922 10:56:00.179981 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.991508] k3s[893]: I0922 10:56:00.180022 893 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 30.992027] k3s[893]: I0922 10:56:00.180038 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.992467] k3s[893]: I0922 10:56:00.180056 893 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 30.992960] k3s[893]: I0922 10:56:00.180074 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.993566] k3s[893]: I0922 10:56:00.180083 893 controller.go:174] "Starting ephemeral volume controller" machine # [ 30.993734] k3s[893]: I0922 10:56:00.180097 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.994347] k3s[893]: I0922 10:56:00.180138 893 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 30.994835] k3s[893]: I0922 10:56:00.180144 893 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 30.995439] k3s[893]: I0922 10:56:00.180208 893 taint_eviction.go:288] "Sending events to API server" machine # [ 30.995934] k3s[893]: I0922 10:56:00.180219 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.996552] k3s[893]: I0922 10:56:00.180263 893 namespace_controller.go:202] "Starting namespace controller" machine # [ 30.997058] k3s[893]: I0922 10:56:00.180276 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.997496] k3s[893]: I0922 10:56:00.180353 893 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 30.997977] k3s[893]: I0922 10:56:00.180371 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.998589] k3s[893]: I0922 10:56:00.180399 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 30.999092] k3s[893]: I0922 10:56:00.180419 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.999609] k3s[893]: I0922 10:56:00.180455 893 disruption.go:458] "Sending events to api server." machine # [ 31.000044] k3s[893]: I0922 10:56:00.180483 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.000490] k3s[893]: I0922 10:56:00.180490 893 disruption.go:465] "Starting disruption controller" machine # [ 31.000967] k3s[893]: I0922 10:56:00.180502 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.001581] k3s[893]: I0922 10:56:00.180533 893 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 31.002075] k3s[893]: I0922 10:56:00.180572 893 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 31.002529] k3s[893]: I0922 10:56:00.180584 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.003040] k3s[893]: I0922 10:56:00.180617 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.003469] k3s[893]: I0922 10:56:00.180721 893 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 31.003962] k3s[893]: I0922 10:56:00.180734 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.004577] k3s[893]: I0922 10:56:00.180838 893 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 31.005068] k3s[893]: I0922 10:56:00.180852 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.005518] k3s[893]: I0922 10:56:00.180925 893 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 31.006026] k3s[893]: I0922 10:56:00.180939 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.006462] k3s[893]: I0922 10:56:00.181011 893 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 31.006955] k3s[893]: I0922 10:56:00.181024 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.007565] k3s[893]: I0922 10:56:00.181098 893 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 31.008061] k3s[893]: I0922 10:56:00.181111 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.008503] k3s[893]: I0922 10:56:00.181161 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 31.008987] k3s[893]: I0922 10:56:00.181173 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.009603] k3s[893]: I0922 10:56:00.181205 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 31.010105] k3s[893]: I0922 10:56:00.181218 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.011060] k3s[893]: I0922 10:56:00.181257 893 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 31.012599] k3s[893]: I0922 10:56:00.181270 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.013703] k3s[893]: I0922 10:56:00.181311 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 31.015737] k3s[893]: I0922 10:56:00.181475 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 31.018510] k3s[893]: I0922 10:56:00.181570 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 31.020852] k3s[893]: I0922 10:56:00.181613 893 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 31.022056] k3s[893]: I0922 10:56:00.181630 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.023206] k3s[893]: I0922 10:56:00.181640 893 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 31.025676] k3s[893]: I0922 10:56:00.181757 893 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 31.026904] k3s[893]: I0922 10:56:00.181771 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.027893] k3s[893]: I0922 10:56:00.181846 893 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 31.029198] k3s[893]: I0922 10:56:00.181859 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.030479] k3s[893]: I0922 10:56:00.181904 893 ttl_controller.go:127] "Starting TTL controller" machine # [ 31.031626] k3s[893]: I0922 10:56:00.181917 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.032617] k3s[893]: I0922 10:56:00.181955 893 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 31.033985] k3s[893]: I0922 10:56:00.181968 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.035136] k3s[893]: I0922 10:56:00.182166 893 expand_controller.go:328] "Starting expand controller" machine # [ 31.036405] k3s[893]: I0922 10:56:00.182185 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.037573] k3s[893]: I0922 10:56:00.182279 893 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 31.038649] k3s[893]: I0922 10:56:00.182293 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.039891] k3s[893]: I0922 10:56:00.182330 893 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 31.041351] k3s[893]: I0922 10:56:00.182361 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.042493] k3s[893]: I0922 10:56:00.182463 893 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 31.062131] k3s[893]: time="2026-09-22T10:56:00Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 31.116868] k3s[893]: I0922 10:56:00.325403 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.129577] k3s[893]: I0922 10:56:00.337117 893 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 31.131311] k3s[893]: I0922 10:56:00.338814 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.170529] k3s[893]: I0922 10:56:00.379083 893 shared_informer.go:377] "Caches are synced" machine # [ 31.172195] k3s[893]: I0922 10:56:00.380459 893 shared_informer.go:377] "Caches are synced" machine # [ 31.243828] k3s[893]: time="2026-09-22T10:56:00Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.271585] k3s[893]: I0922 10:56:00.480118 893 shared_informer.go:377] "Caches are synced" machine # [ 31.272397] k3s[893]: I0922 10:56:00.480182 893 shared_informer.go:377] "Caches are synced" machine # [ 31.272904] k3s[893]: I0922 10:56:00.480276 893 shared_informer.go:377] "Caches are synced" machine # [ 31.273531] k3s[893]: I0922 10:56:00.481959 893 shared_informer.go:377] "Caches are synced" machine # [ 31.275519] k3s[893]: I0922 10:56:00.482278 893 shared_informer.go:377] "Caches are synced" machine # [ 31.276400] k3s[893]: I0922 10:56:00.482684 893 shared_informer.go:377] "Caches are synced" machine # [ 31.277078] k3s[893]: I0922 10:56:00.482742 893 shared_informer.go:377] "Caches are synced" machine # [ 31.277536] k3s[893]: I0922 10:56:00.482857 893 shared_informer.go:377] "Caches are synced" machine # [ 31.280123] k3s[893]: I0922 10:56:00.482910 893 range_allocator.go:177] "Sending events to api server" machine # [ 31.281080] k3s[893]: I0922 10:56:00.482949 893 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 31.281524] k3s[893]: I0922 10:56:00.482963 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.282077] k3s[893]: I0922 10:56:00.482978 893 shared_informer.go:377] "Caches are synced" machine # [ 31.282547] k3s[893]: I0922 10:56:00.483083 893 shared_informer.go:377] "Caches are synced" machine # [ 31.282732] k3s[893]: I0922 10:56:00.483161 893 shared_informer.go:377] "Caches are synced" machine # [ 31.285096] k3s[893]: I0922 10:56:00.483206 893 shared_informer.go:377] "Caches are synced" machine # [ 31.286123] k3s[893]: I0922 10:56:00.484320 893 shared_informer.go:377] "Caches are synced" machine # [ 31.286905] k3s[893]: I0922 10:56:00.484423 893 shared_informer.go:377] "Caches are synced" machine # [ 31.288133] k3s[893]: I0922 10:56:00.484487 893 shared_informer.go:377] "Caches are synced" machine # [ 31.288584] k3s[893]: I0922 10:56:00.484532 893 shared_informer.go:377] "Caches are synced" machine # [ 31.292098] k3s[893]: I0922 10:56:00.487833 893 shared_informer.go:377] "Caches are synced" machine # [ 31.293048] k3s[893]: I0922 10:56:00.487888 893 shared_informer.go:377] "Caches are synced" machine # [ 31.302538] k3s[893]: time="2026-09-22T10:56:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 31.316719] k3s[893]: time="2026-09-22T10:56:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 31.317531] k3s[893]: I0922 10:56:00.526138 893 shared_informer.go:377] "Caches are synced" machine # [ 31.369951] k3s[893]: I0922 10:56:00.578518 893 shared_informer.go:377] "Caches are synced" machine # [ 31.371127] k3s[893]: I0922 10:56:00.579735 893 shared_informer.go:377] "Caches are synced" machine # [ 31.372438] k3s[893]: I0922 10:56:00.581037 893 shared_informer.go:377] "Caches are synced" machine # [ 31.375066] k3s[893]: I0922 10:56:00.582055 893 shared_informer.go:377] "Caches are synced" machine # [ 31.375755] k3s[893]: I0922 10:56:00.582107 893 shared_informer.go:377] "Caches are synced" machine # [ 31.376705] k3s[893]: I0922 10:56:00.582213 893 shared_informer.go:377] "Caches are synced" machine # [ 31.377288] k3s[893]: I0922 10:56:00.581299 893 shared_informer.go:377] "Caches are synced" machine # [ 31.378209] k3s[893]: I0922 10:56:00.581483 893 shared_informer.go:377] "Caches are synced" machine # [ 31.378738] k3s[893]: I0922 10:56:00.582843 893 shared_informer.go:377] "Caches are synced" machine # [ 31.379860] k3s[893]: I0922 10:56:00.581554 893 shared_informer.go:377] "Caches are synced" machine # [ 31.380518] k3s[893]: I0922 10:56:00.581596 893 shared_informer.go:377] "Caches are synced" machine # [ 31.381031] k3s[893]: I0922 10:56:00.581631 893 shared_informer.go:377] "Caches are synced" machine # [ 31.381612] k3s[893]: I0922 10:56:00.581698 893 shared_informer.go:377] "Caches are synced" machine # [ 31.382837] k3s[893]: I0922 10:56:00.581806 893 shared_informer.go:377] "Caches are synced" machine # [ 31.383397] k3s[893]: I0922 10:56:00.581853 893 shared_informer.go:377] "Caches are synced" machine # [ 31.384097] k3s[893]: I0922 10:56:00.581892 893 shared_informer.go:377] "Caches are synced" machine # [ 31.385307] k3s[893]: I0922 10:56:00.581966 893 shared_informer.go:377] "Caches are synced" machine # [ 31.386314] k3s[893]: I0922 10:56:00.582014 893 shared_informer.go:377] "Caches are synced" machine # [ 31.386822] k3s[893]: I0922 10:56:00.582034 893 shared_informer.go:377] "Caches are synced" machine # [ 31.388092] k3s[893]: I0922 10:56:00.582002 893 shared_informer.go:377] "Caches are synced" machine # [ 31.388888] k3s[893]: I0922 10:56:00.581922 893 shared_informer.go:377] "Caches are synced" machine # [ 31.389714] k3s[893]: I0922 10:56:00.581249 893 shared_informer.go:377] "Caches are synced" machine # [ 31.517341] k3s[893]: time="2026-09-22T10:56:00Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 31.531109] k3s[893]: time="2026-09-22T10:56:00Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # [ 31.561093] k3s[893]: time="2026-09-22T10:56:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 31.672228] k3s[893]: time="2026-09-22T10:56:00Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 31.871167] k3s[893]: I0922 10:56:01.079319 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 31.874949] k3s[893]: I0922 10:56:01.083487 893 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 31.969858] k3s[893]: I0922 10:56:01.178330 893 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 32.243290] k3s[893]: time="2026-09-22T10:56:01Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.274921] k3s[893]: I0922 10:56:01.483475 893 shared_informer.go:377] "Caches are synced" machine # [ 32.276305] k3s[893]: I0922 10:56:01.483514 893 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 32.277968] k3s[893]: I0922 10:56:01.483524 893 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 32.331332] k3s[893]: I0922 10:56:01.539880 893 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.243657] k3s[893]: time="2026-09-22T10:56:02Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 33.749799] postgres[1211]: [1211] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 33.752097] postgres[1211]: [1211] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 33.789510] niks3-server[1203]: 2026/09/22 10:56:02 OK 20241026095416_initial_model.sql (10.89ms) machine # [ 33.796348] niks3-server[1203]: 2026/09/22 10:56:03 OK 20251210153512_drop_unused_gin_index.sql (4.38ms) machine # [ 33.800544] niks3-server[1203]: 2026/09/22 10:56:03 OK 20251218171726_add_pins.sql (4.15ms) machine # [ 33.806618] niks3-server[1203]: 2026/09/22 10:56:03 OK 20260628120000_add_object_size_and_stats.sql (5.98ms) machine # [ 33.809990] niks3-server[1203]: 2026/09/22 10:56:03 OK 20260905000000_add_claims.sql (3.33ms) machine # [ 33.813763] niks3-server[1203]: 2026/09/22 10:56:03 OK 20260920000000_drop_claims.sql (3.63ms) machine # [ 33.814932] niks3-server[1203]: 2026/09/22 10:56:03 goose: successfully migrated database to version: 20260920000000 machine # [ 33.820311] niks3-server[1203]: 2026/09/22 10:56:03 OK 1_commit_pending_closure.sql (6.49ms) machine # [ 33.822837] niks3-server[1203]: 2026/09/22 10:56:03 OK 2_object_stats_trigger.sql (2.39ms) machine # [ 33.823894] niks3-server[1203]: 2026/09/22 10:56:03 goose: up to current file version: 2 machine # [ 33.843124] niks3-server[1203]: 2026/09/22 10:56:03 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 33.843821] niks3-server[1203]: 2026/09/22 10:56:03 INFO OIDC authentication enabled config=/nix/store/2xcn0lgmca14rg9xzcfqj65j9hs85hn6-niks3-oidc.json machine # [ 33.845687] niks3-server[1203]: 2026/09/22 10:56:03 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key machine # [ 33.935345] niks3-server[1203]: 2026/09/22 10:56:03 INFO Read proxy enabled — serving cache objects from S3 machine # [ 33.936629] niks3-server[1203]: 2026/09/22 10:56:03 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 33.938512] niks3-server[1203]: 2026/09/22 10:56:03 INFO systemd watchdog enabled interval=15s machine # [ 33.939447] systemd[1]: Started niks3 server. machine # [ 33.940335] systemd[1]: Reached target Multi-User System. machine # [ 33.941577] niks3-server[1203]: 2026/09/22 10:56:03 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 33.943244] systemd[1]: Startup finished in 965ms (kernel) + 3.943s (initrd) + 29.031s (userspace) = 33.941s. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.242657] k3s[893]: time="2026-09-22T10:56:03Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.517924] k3s[893]: time="2026-09-22T10:56:03Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 34.518989] k3s[893]: time="2026-09-22T10:56:03Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 34.519665] k3s[893]: time="2026-09-22T10:56:03Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 34.520421] k3s[893]: time="2026-09-22T10:56:03Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 34.520773] k3s[893]: time="2026-09-22T10:56:03Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 34.526996] k3s[893]: time="2026-09-22T10:56:03Z" level=info msg="Handling backend connection request [machine]" machine # [ 34.527354] k3s[893]: time="2026-09-22T10:56:03Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 34.528147] k3s[893]: time="2026-09-22T10:56:03Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 35.243699] k3s[893]: time="2026-09-22T10:56:04Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 36.244734] k3s[893]: time="2026-09-22T10:56:05Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.242569] k3s[893]: time="2026-09-22T10:56:06Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.243626] k3s[893]: time="2026-09-22T10:56:07Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.242845] k3s[893]: time="2026-09-22T10:56:08Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 40.245431] k3s[893]: time="2026-09-22T10:56:09Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 41.243531] k3s[893]: time="2026-09-22T10:56:10Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 42.243595] k3s[893]: time="2026-09-22T10:56:11Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 42.940599] k3s[893]: time="2026-09-22T10:56:12Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.1" machine # [ 42.943022] k3s[893]: time="2026-09-22T10:56:12Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:13f4e00c63295253b80c26e05ce96f6b6694c831f21cdbac932c8fff8a5526c6" machine # [ 43.245591] k3s[893]: time="2026-09-22T10:56:12Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 43.331251] k3s[893]: time="2026-09-22T10:56:12Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 14.726028586s" machine # [ 43.337056] k3s[893]: time="2026-09-22T10:56:12Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 44.243799] k3s[893]: time="2026-09-22T10:56:13Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 45.243641] k3s[893]: time="2026-09-22T10:56:14Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 46.243783] k3s[893]: time="2026-09-22T10:56:15Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.245744] k3s[893]: time="2026-09-22T10:56:16Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 47.591857] k3s[893]: time="2026-09-22T10:56:16Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.1" machine # [ 47.595833] k3s[893]: time="2026-09-22T10:56:16Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:a3fb275e15335967c368c203214cabcce2886a8867fcd31c07e4effd2ad9a5ec" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 47.644445] k3s[893]: time="2026-09-22T10:56:16Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 4.308184699s" machine # [ 47.646177] k3s[893]: time="2026-09-22T10:56:16Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 48.105782] k3s[893]: time="2026-09-22T10:56:17Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::f8e:eb88:6d88:d67f --node-labels= --read-only-port=0" machine # [ 48.106612] k3s[893]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 48.121482] k3s[893]: I0922 10:56:17.330054 893 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 48.121803] k3s[893]: I0922 10:56:17.330081 893 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 48.122833] k3s[893]: I0922 10:56:17.330111 893 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 48.123601] k3s[893]: I0922 10:56:17.330133 893 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 48.124617] k3s[893]: I0922 10:56:17.331485 893 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 48.127123] k3s[893]: I0922 10:56:17.335445 893 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 48.131723] k3s[893]: I0922 10:56:17.340297 893 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 48.132647] k3s[893]: I0922 10:56:17.340332 893 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 48.133573] k3s[893]: I0922 10:56:17.340553 893 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 48.134248] k3s[893]: I0922 10:56:17.340575 893 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 48.135382] k3s[893]: I0922 10:56:17.340787 893 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 48.135553] k3s[893]: I0922 10:56:17.340804 893 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 48.135841] k3s[893]: I0922 10:56:17.340874 893 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 48.136709] k3s[893]: I0922 10:56:17.344413 893 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 48.137189] k3s[893]: I0922 10:56:17.344721 893 kubelet.go:482] "Attempting to sync node with API server" machine # [ 48.137658] k3s[893]: I0922 10:56:17.344741 893 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 48.138174] k3s[893]: I0922 10:56:17.344771 893 kubelet.go:394] "Adding apiserver pod source" machine # [ 48.138634] k3s[893]: I0922 10:56:17.344788 893 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 48.139219] k3s[893]: I0922 10:56:17.347261 893 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 48.140451] k3s[893]: I0922 10:56:17.349046 893 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 48.141202] k3s[893]: I0922 10:56:17.349076 893 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 48.142841] k3s[893]: I0922 10:56:17.351438 893 server.go:1252] "Started kubelet" machine # [ 48.143565] k3s[893]: I0922 10:56:17.351837 893 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 48.144081] k3s[893]: I0922 10:56:17.351999 893 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 48.144516] k3s[893]: I0922 10:56:17.352069 893 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 48.145705] k3s[893]: I0922 10:56:17.352221 893 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 48.147328] k3s[893]: I0922 10:56:17.352622 893 server.go:317] "Adding debug handlers to kubelet server" machine # [ 48.147613] k3s[893]: I0922 10:56:17.354703 893 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 48.151071] k3s[893]: E0922 10:56:17.358630 893 kubelet.go:1661] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem" machine # [ 48.151782] k3s[893]: I0922 10:56:17.358809 893 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 48.152738] k3s[893]: I0922 10:56:17.358840 893 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 48.153371] k3s[893]: I0922 10:56:17.359032 893 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 48.153866] k3s[893]: I0922 10:56:17.359102 893 reconciler.go:29] "Reconciler: start to sync state" machine # [ 48.155350] k3s[893]: I0922 10:56:17.361558 893 factory.go:223] Registration of the systemd container factory successfully machine # [ 48.156888] k3s[893]: I0922 10:56:17.361730 893 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 48.158684] k3s[893]: E0922 10:56:17.363374 893 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 48.159073] k3s[893]: I0922 10:56:17.366924 893 factory.go:223] Registration of the containerd container factory successfully machine # [ 48.164201] k3s[893]: E0922 10:56:17.371068 893 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 48.174743] k3s[893]: I0922 10:56:17.383325 893 cpu_manager.go:225] "Starting" policy="none" machine # [ 48.175395] k3s[893]: I0922 10:56:17.383352 893 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 48.176419] k3s[893]: I0922 10:56:17.383376 893 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 48.180066] k3s[893]: I0922 10:56:17.387506 893 policy_none.go:50] "Start" machine # [ 48.181125] k3s[893]: I0922 10:56:17.387546 893 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 48.181409] k3s[893]: I0922 10:56:17.387570 893 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 48.182787] k3s[893]: I0922 10:56:17.391340 893 policy_none.go:44] "Start" machine # [ 48.189548] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 48.237305] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 48.243065] k3s[893]: time="2026-09-22T10:56:17Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 48.248482] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 48.251900] k3s[893]: E0922 10:56:17.460063 893 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 48.252535] k3s[893]: I0922 10:56:17.460229 893 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 48.253155] k3s[893]: I0922 10:56:17.460279 893 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 48.253596] k3s[893]: I0922 10:56:17.460574 893 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 48.254285] k3s[893]: E0922 10:56:17.461523 893 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 48.255066] k3s[893]: E0922 10:56:17.461559 893 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 48.349088] k3s[893]: I0922 10:56:17.557563 893 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 48.355547] k3s[893]: I0922 10:56:17.563997 893 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 48.361434] k3s[893]: I0922 10:56:17.569546 893 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 48.363627] k3s[893]: I0922 10:56:17.569588 893 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 48.365697] k3s[893]: I0922 10:56:17.569632 893 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 48.367302] k3s[893]: E0922 10:56:17.569714 893 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 48.370150] k3s[893]: I0922 10:56:17.575016 893 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 48.374633] k3s[893]: time="2026-09-22T10:56:17Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 48.376903] k3s[893]: I0922 10:56:17.579600 893 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 48.378949] k3s[893]: I0922 10:56:17.580147 893 node_controller.go:429] Initializing node machine with cloud provider machine # [ 48.380842] k3s[893]: I0922 10:56:17.580228 893 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 48.383917] k3s[893]: E0922 10:56:17.580251 893 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 48.387608] k3s[893]: I0922 10:56:17.586752 893 node_controller.go:429] Initializing node machine with cloud provider machine # [ 48.389613] k3s[893]: I0922 10:56:17.587720 893 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 48.392689] k3s[893]: E0922 10:56:17.587748 893 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 48.396539] k3s[893]: time="2026-09-22T10:56:17Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 48.398843] k3s[893]: I0922 10:56:17.590331 893 node_controller.go:429] Initializing node machine with cloud provider machine # [ 48.400916] k3s[893]: time="2026-09-22T10:56:17Z" level=info msg="Starting flannel with backend vxlan" machine # [ 48.405748] k3s[893]: time="2026-09-22T10:56:17Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 48.410434] k3s[893]: I0922 10:56:17.619020 893 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 48.425864] k3s[893]: time="2026-09-22T10:56:17Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 48.428188] k3s[893]: time="2026-09-22T10:56:17Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 48.428950] k3s[893]: I0922 10:56:17.635765 893 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 48.429588] k3s[893]: I0922 10:56:17.635859 893 kube.go:537] Starting kube subnet manager machine # [ 48.472501] k3s[893]: I0922 10:56:17.681059 893 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 48.473273] k3s[893]: I0922 10:56:17.681399 893 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 48.484113] k3s[893]: I0922 10:56:17.692694 893 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 48.484659] k3s[893]: I0922 10:56:17.692721 893 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 48.487492] k3s[893]: I0922 10:56:17.696029 893 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 48.488299] k3s[893]: I0922 10:56:17.696055 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 48.488841] k3s[893]: I0922 10:56:17.696083 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 48.489830] k3s[893]: I0922 10:56:17.696076 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 48.493087] k3s[893]: I0922 10:56:17.696331 893 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 48.493697] k3s[893]: I0922 10:56:17.696026 893 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 48.494566] k3s[893]: I0922 10:56:17.696438 893 shared_informer.go:370] "Waiting for caches to sync" machine # [ 48.495241] k3s[893]: I0922 10:56:17.696697 893 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 48.505382] k3s[893]: I0922 10:56:17.713932 893 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 48.517443] k3s[893]: I0922 10:56:17.726012 893 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 48.518761] k3s[893]: I0922 10:56:17.727339 893 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 48.520654] k3s[893]: I0922 10:56:17.729235 893 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 48.529144] k3s[893]: I0922 10:56:17.737424 893 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 48.672658] k3s[893]: I0922 10:56:17.880944 893 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::f8e:eb88:6d88:d67f"] machine # [ 48.673069] k3s[893]: E0922 10:56:17.881098 893 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 48.710824] k3s[893]: I0922 10:56:17.919340 893 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 48.711652] k3s[893]: I0922 10:56:17.919836 893 server_linux.go:136] "Using iptables Proxier" machine # [ 48.749750] k3s[893]: I0922 10:56:17.958265 893 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 48.772231] k3s[893]: I0922 10:56:17.980735 893 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 48.772940] k3s[893]: I0922 10:56:17.980823 893 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 48.774438] k3s[893]: I0922 10:56:17.983026 893 config.go:200] "Starting service config controller" machine # [ 48.775401] k3s[893]: I0922 10:56:17.983056 893 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 48.775768] k3s[893]: I0922 10:56:17.983094 893 config.go:106] "Starting endpoint slice config controller" machine # [ 48.776439] k3s[893]: I0922 10:56:17.983107 893 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 48.777580] k3s[893]: I0922 10:56:17.983147 893 config.go:403] "Starting serviceCIDR config controller" machine # [ 48.779066] k3s[893]: I0922 10:56:17.983180 893 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 48.780952] k3s[893]: I0922 10:56:17.984076 893 config.go:309] "Starting node config controller" machine # [ 48.782648] k3s[893]: I0922 10:56:17.984096 893 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 48.784410] k3s[893]: I0922 10:56:17.984109 893 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 48.795075] k3s[893]: I0922 10:56:18.003299 893 shared_informer.go:377] "Caches are synced" machine # [ 48.875852] k3s[893]: I0922 10:56:18.084238 893 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 48.876617] k3s[893]: I0922 10:56:18.084332 893 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 48.877218] k3s[893]: I0922 10:56:18.084353 893 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 48.887658] k3s[893]: I0922 10:56:18.096222 893 shared_informer.go:377] "Caches are synced" machine # [ 48.888639] k3s[893]: I0922 10:56:18.096331 893 shared_informer.go:377] "Caches are synced" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.137318] k3s[893]: I0922 10:56:18.345776 893 apiserver.go:52] "Watching apiserver" machine # [ 49.246072] k3s[893]: time="2026-09-22T10:56:18Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 49.258845] k3s[893]: I0922 10:56:18.465620 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-values\") pod \"helm-install-nix-grpc-farm-whlp9\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " pod="kube-system/helm-install-nix-grpc-farm-whlp9" machine # [ 49.264621] k3s[893]: I0922 10:56:18.465707 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/5da01995-df4c-4519-9991-5bfcd7cd5584-content\") pod \"helm-install-nix-grpc-farm-whlp9\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " pod="kube-system/helm-install-nix-grpc-farm-whlp9" machine # [ 49.270469] k3s[893]: I0922 10:56:18.465746 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njpbj\" (UniqueName: \"kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-kube-api-access-njpbj\") pod \"helm-install-nix-grpc-farm-whlp9\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " pod="kube-system/helm-install-nix-grpc-farm-whlp9" machine # [ 49.277047] k3s[893]: I0922 10:56:18.465775 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-helm\") pod \"helm-install-nix-grpc-farm-whlp9\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " pod="kube-system/helm-install-nix-grpc-farm-whlp9" machine # [ 49.282591] k3s[893]: I0922 10:56:18.465805 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-cache\") pod \"helm-install-nix-grpc-farm-whlp9\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " pod="kube-system/helm-install-nix-grpc-farm-whlp9" machine # [ 49.288365] k3s[893]: I0922 10:56:18.465832 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-config\") pod \"helm-install-nix-grpc-farm-whlp9\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " pod="kube-system/helm-install-nix-grpc-farm-whlp9" machine # [ 49.294053] k3s[893]: I0922 10:56:18.465857 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-tmp\") pod \"helm-install-nix-grpc-farm-whlp9\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " pod="kube-system/helm-install-nix-grpc-farm-whlp9" machine # [ 49.299663] systemd[1]: Created slice libcontainer container kubepods-burstable-pod5da01995_df4c_4519_9991_5bfcd7cd5584.slice. machine # [ 49.301792] systemd[1]: Created slice libcontainer container kubepods-burstable-poda4cfc77c_4952_42e3_a621_dd02c0b55a65.slice. machine # [ 49.350854] k3s[893]: I0922 10:56:18.559411 893 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 49.357984] k3s[893]: I0922 10:56:18.566572 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4cfc77c-4952-42e3-a621-dd02c0b55a65-custom-config-volume\") pod \"coredns-c5fdd76cf-jwml8\" (UID: \"a4cfc77c-4952-42e3-a621-dd02c0b55a65\") " pod="kube-system/coredns-c5fdd76cf-jwml8" machine # [ 49.358827] k3s[893]: I0922 10:56:18.566940 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6d6h\" (UniqueName: \"kubernetes.io/projected/a4cfc77c-4952-42e3-a621-dd02c0b55a65-kube-api-access-b6d6h\") pod \"coredns-c5fdd76cf-jwml8\" (UID: \"a4cfc77c-4952-42e3-a621-dd02c0b55a65\") " pod="kube-system/coredns-c5fdd76cf-jwml8" machine # [ 49.359576] k3s[893]: I0922 10:56:18.567064 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a4cfc77c-4952-42e3-a621-dd02c0b55a65-config-volume\") pod \"coredns-c5fdd76cf-jwml8\" (UID: \"a4cfc77c-4952-42e3-a621-dd02c0b55a65\") " pod="kube-system/coredns-c5fdd76cf-jwml8" machine # [ 49.389280] k3s[893]: time="2026-09-22T10:56:18Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 49.429945] k3s[893]: I0922 10:56:18.638506 893 kube.go:163] Node controller sync successful machine # [ 49.430575] k3s[893]: I0922 10:56:18.638596 893 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 49.434563] k3s[893]: I0922 10:56:18.643147 893 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::f8e:eb88:6d88:d67f", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::f8e:eb88:6d88:d67f", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 49.472269] (udev-worker)[1464]: Network interface NamePolicy= disabled on kernel command line. machine # [ 49.478416] k3s[893]: I0922 10:56:18.686263 893 iptables.go:50] Starting flannel in iptables mode... machine # [ 49.480166] k3s[893]: time="2026-09-22T10:56:18Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 49.482357] k3s[893]: time="2026-09-22T10:56:18Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 49.485194] k3s[893]: time="2026-09-22T10:56:18Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 49.485950] k3s[893]: time="2026-09-22T10:56:18Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 49.487115] k3s[893]: I0922 10:56:18.686371 893 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 49.488092] k3s[893]: I0922 10:56:18.687297 893 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 49.518339] dhcpcd[663]: flannel.1: IAID 89:a4:7f:de machine # [ 49.519070] dhcpcd[663]: flannel.1: adding address fe80::50bd:89ff:fea4:7fde machine # [ 49.569126] k3s[893]: I0922 10:56:18.777630 893 iptables.go:111] Setting up masking rules machine # [ 49.588775] k3s[893]: I0922 10:56:18.797352 893 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 49.603096] k3s[893]: time="2026-09-22T10:56:18Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 49.603428] k3s[893]: time="2026-09-22T10:56:18Z" level=info msg="Running flannel backend" machine # [ 49.603948] k3s[893]: I0922 10:56:18.811711 893 vxlan_network.go:68] watching for new subnet leases machine # [ 49.604678] k3s[893]: I0922 10:56:18.811734 893 vxlan_network.go:115] starting vxlan device watcher machine # [ 49.677298] k3s[893]: I0922 10:56:18.885866 893 iptables.go:358] bootstrap done machine # [ 49.869927] cni0: port 1(veth41d3b6c2) entered blocking state machine # [ 49.716264] ([ 49.871165] cni0: port 1(veth41d3b6c2) entered disabled state machine # udev-worker)[1463]: Network interface NamePolicy= disabled on ke[ 49.872727] veth41d3b6c2: entered allmulticast mode machine # rnel command line. machine # [ 49.874459] veth41d3b6c2: entered promiscuous mode machine # [ 49.876287] cni0: port 2(vetha1e269dd) entered blocking state machine # [ 49.877382] cni0: port 2(vetha1e269dd) entered disabled state machine # [ 49.878739] vetha1e269dd: entered allmulticast mode machine # [ 49.879784] vetha1e269dd: entered promiscuous mode machine # [ 49.896393] cni0: port 1(veth41d3b6c2) entered blocking state machine # [ 49.897151] cni0: port 1(veth41d3b6c2) entered forwarding state machine # [ 49.899108] cni0: port 2(vetha1e269dd) entered blocking state machine # [ 49.899897] cni0: port 2(vetha1e269dd) entered forwarding state machine # [ 49.751898] k3s[893]: I0922 10:56:18.960469 893 iptables.go:358] bootstrap done machine # [ 49.796148] dhcpcd[663]: vetha1e269dd: waiting for carrier machine # [ 49.815634] dhcpcd[663]: veth41d3b6c2: IAID a1:e9:c8:04 machine # [ 49.816873] dhcpcd[663]: veth41d3b6c2: adding address fe80::9083:a1ff:fee9:c804 machine # [ 49.818437] dhcpcd[663]: vetha1e269dd: carrier acquired machine # [ 49.828067] dhcpcd[663]: vetha1e269dd: IAID 95:5f:52:ee machine # [ 49.828705] dhcpcd[663]: vetha1e269dd: adding address fe80::509f:95ff:fe5f:52ee machine # [ 49.946469] systemd[1]: Started libcontainer container 4a2514fbfa95a0c17db220d2073c1d515a3eecc18b126fbc65b81893c9ed0d37. machine # [ 49.948855] systemd[1]: Started libcontainer container 6d4b73a31ebbda08d6a75239760a2a4d164d39e5e3d2ff889ee8b528123c377c. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 50.587991] k3s[893]: time="2026-09-22T10:56:19Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 50.588601] k3s[893]: I0922 10:56:19.796883 893 network_policy_controller.go:164] Starting network policy controller machine # [ 50.851876] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2872616040.mount: Deactivated successfully. machine # [ 50.853354] dhcpcd[663]: veth41d3b6c2: soliciting a DHCP lease machine # [ 50.893493] systemd[1]: Started libcontainer container c01a0b7a032e398fcd001d93a594be4752be0796852fb9149724836e380a126d. machine # [ 50.987954] k3s[893]: I0922 10:56:20.196433 893 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 51.118553] systemd[1]: Started libcontainer container 30b1c4b40837a1f2fc900c699bb46f67460f6c39d17a37e501a32a399b5ac213. machine # [ 51.320033] dhcpcd[663]: flannel.1: soliciting a DHCP lease machine # [ 51.375444] k3s[893]: I0922 10:56:20.583893 893 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 51.376281] k3s[893]: I0922 10:56:20.584015 893 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 51.376726] k3s[893]: I0922 10:56:20.584095 893 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 51.418248] k3s[893]: I0922 10:56:20.625970 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-jwml8" podStartSLOduration=19.625943096 podStartE2EDuration="19.625943096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:56:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:56:20.612689736 +0000 UTC m=+31.362448298" watchObservedRunningTime="2026-09-22 10:56:20.625943096 +0000 UTC m=+31.375701658" machine # [ 51.429153] k3s[893]: I0922 10:56:20.637700 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-whlp9" podStartSLOduration=20.63762419 podStartE2EDuration="20.63762419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:56:20.626437572 +0000 UTC m=+31.376196414" watchObservedRunningTime="2026-09-22 10:56:20.63762419 +0000 UTC m=+31.387383031" machine # [ 51.616688] dhcpcd[663]: flannel.1: soliciting an IPv6 router machine # [ 51.796053] dhcpcd[663]: vetha1e269dd: soliciting a DHCP lease machine # [ 52.054904] dhcpcd[663]: vetha1e269dd: soliciting an IPv6 router machine # [ 52.554148] dhcpcd[663]: veth41d3b6c2: soliciting an IPv6 router machine # [ 52.585588] k3s[893]: I0922 10:56:21.793835 893 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.203.137"} machine # [ 52.650889] systemd[1]: cri-containerd-30b1c4b40837a1f2fc900c699bb46f67460f6c39d17a37e501a32a399b5ac213.scope: Deactivated successfully. machine # [ 52.652078] systemd[1]: cri-containerd-30b1c4b40837a1f2fc900c699bb46f67460f6c39d17a37e501a32a399b5ac213.scope: Consumed 555ms CPU time over 1.531s wall clock time, 31.2M memory peak, 2.4M incoming IP traffic, 142K outgoing IP traffic. machine # [ 52.744177] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode1114d6b_be4c_4e82_b87a_dd544787c9db.slice. machine # [ 52.756774] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-30b1c4b40837a1f2fc900c699bb46f67460f6c39d17a37e501a32a399b5ac213-rootfs.mount: Deactivated successfully. machine # [ 52.764589] systemd[1]: Created slice libcontainer container kubepods-besteffort-pode04a28b7_03e5_4020_a91a_09cf1491fcb2.slice. machine # [ 52.778090] systemd[1]: Created slice libcontainer container kubepods-besteffort-podf1982df1_70cb_494e_9327_7121373628ec.slice. machine # [ 52.781556] k3s[893]: I0922 10:56:21.989852 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/a5681291-3832-4277-b724-b3cafefd0193-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg\" (UID: \"a5681291-3832-4277-b724-b3cafefd0193\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" machine # [ 52.794162] k3s[893]: I0922 10:56:21.989892 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/a5681291-3832-4277-b724-b3cafefd0193-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg\" (UID: \"a5681291-3832-4277-b724-b3cafefd0193\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" machine # [ 52.800593] k3s[893]: I0922 10:56:21.989926 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/e04a28b7-03e5-4020-a91a-09cf1491fcb2-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb\" (UID: \"e04a28b7-03e5-4020-a91a-09cf1491fcb2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" machine # [ 52.808056] k3s[893]: I0922 10:56:21.989955 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/e04a28b7-03e5-4020-a91a-09cf1491fcb2-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb\" (UID: \"e04a28b7-03e5-4020-a91a-09cf1491fcb2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" machine # [ 52.808714] k3s[893]: I0922 10:56:21.989978 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/e04a28b7-03e5-4020-a91a-09cf1491fcb2-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb\" (UID: \"e04a28b7-03e5-4020-a91a-09cf1491fcb2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" machine # [ 52.809873] k3s[893]: I0922 10:56:21.990006 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/f1982df1-70cb-494e-9327-7121373628ec-tls\") pod \"nix-grpc-farm-scheduler-5844ddf54b-x5s55\" (UID: \"f1982df1-70cb-494e-9327-7121373628ec\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-x5s55" machine # [ 52.810898] k3s[893]: I0922 10:56:21.990032 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/a5681291-3832-4277-b724-b3cafefd0193-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg\" (UID: \"a5681291-3832-4277-b724-b3cafefd0193\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" machine # [ 52.812119] k3s[893]: I0922 10:56:21.990058 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1114d6b-be4c-4e82-b87a-dd544787c9db-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-27g6f\" (UID: \"e1114d6b-be4c-4e82-b87a-dd544787c9db\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-27g6f" machine # [ 52.813107] k3s[893]: I0922 10:56:21.990084 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-27g6f\" (UID: \"e1114d6b-be4c-4e82-b87a-dd544787c9db\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-27g6f" machine # [ 52.813944] k3s[893]: I0922 10:56:21.990112 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e04a28b7-03e5-4020-a91a-09cf1491fcb2-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb\" (UID: \"e04a28b7-03e5-4020-a91a-09cf1491fcb2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" machine # [ 52.815334] k3s[893]: I0922 10:56:21.990150 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kw7f\" (UniqueName: \"kubernetes.io/projected/e04a28b7-03e5-4020-a91a-09cf1491fcb2-kube-api-access-9kw7f\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb\" (UID: \"e04a28b7-03e5-4020-a91a-09cf1491fcb2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" machine # [ 52.816386] k3s[893]: I0922 10:56:21.990178 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f1982df1-70cb-494e-9327-7121373628ec-ca\") pod \"nix-grpc-farm-scheduler-5844ddf54b-x5s55\" (UID: \"f1982df1-70cb-494e-9327-7121373628ec\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-x5s55" machine # [ 52.817783] k3s[893]: I0922 10:56:21.990206 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvr76\" (UniqueName: \"kubernetes.io/projected/f1982df1-70cb-494e-9327-7121373628ec-kube-api-access-wvr76\") pod \"nix-grpc-farm-scheduler-5844ddf54b-x5s55\" (UID: \"f1982df1-70cb-494e-9327-7121373628ec\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-x5s55" machine # [ 52.819095] k3s[893]: I0922 10:56:21.990229 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/f1982df1-70cb-494e-9327-7121373628ec-oidc\") pod \"nix-grpc-farm-scheduler-5844ddf54b-x5s55\" (UID: \"f1982df1-70cb-494e-9327-7121373628ec\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-x5s55" machine # [ 52.820370] k3s[893]: I0922 10:56:21.990252 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/a5681291-3832-4277-b724-b3cafefd0193-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg\" (UID: \"a5681291-3832-4277-b724-b3cafefd0193\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" machine # [ 52.822115] k3s[893]: I0922 10:56:21.990277 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmmzj\" (UniqueName: \"kubernetes.io/projected/a5681291-3832-4277-b724-b3cafefd0193-kube-api-access-vmmzj\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg\" (UID: \"a5681291-3832-4277-b724-b3cafefd0193\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" machine # [ 52.886119] k3s[893]: I0922 10:56:21.990300 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/f1982df1-70cb-494e-9327-7121373628ec-niks3-token\") pod \"nix-grpc-farm-scheduler-5844ddf54b-x5s55\" (UID: \"f1982df1-70cb-494e-9327-7121373628ec\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-x5s55" machine # [ 52.886943] k3s[893]: I0922 10:56:21.990335 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a5681291-3832-4277-b724-b3cafefd0193-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg\" (UID: \"a5681291-3832-4277-b724-b3cafefd0193\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" machine # [ 52.888774] k3s[893]: I0922 10:56:21.990359 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/a5681291-3832-4277-b724-b3cafefd0193-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg\" (UID: \"a5681291-3832-4277-b724-b3cafefd0193\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" machine # [ 52.890267] k3s[893]: I0922 10:56:21.990386 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/e04a28b7-03e5-4020-a91a-09cf1491fcb2-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb\" (UID: \"e04a28b7-03e5-4020-a91a-09cf1491fcb2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" machine # [ 52.891879] k3s[893]: I0922 10:56:21.990410 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/e04a28b7-03e5-4020-a91a-09cf1491fcb2-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb\" (UID: \"e04a28b7-03e5-4020-a91a-09cf1491fcb2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" machine # [ 52.892792] k3s[893]: I0922 10:56:21.990434 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/a5681291-3832-4277-b724-b3cafefd0193-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg\" (UID: \"a5681291-3832-4277-b724-b3cafefd0193\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" machine # [ 52.894198] k3s[893]: I0922 10:56:21.990463 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-27g6f\" (UID: \"e1114d6b-be4c-4e82-b87a-dd544787c9db\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-27g6f" machine # [ 52.896295] k3s[893]: I0922 10:56:21.990486 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1114d6b-be4c-4e82-b87a-dd544787c9db-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-27g6f\" (UID: \"e1114d6b-be4c-4e82-b87a-dd544787c9db\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-27g6f" machine # [ 52.898266] k3s[893]: I0922 10:56:21.990508 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/e04a28b7-03e5-4020-a91a-09cf1491fcb2-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb\" (UID: \"e04a28b7-03e5-4020-a91a-09cf1491fcb2\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" machine # [ 52.898663] systemd[1]: Created slice libcontainer container kubepods-besteffort-poda5681291_3832_4277_b724_b3cafefd0193.slice. machine # [ 53.534727] cni0: port 3(vethcc4eb62d) entered blocking state machine # [ 53.535642] cni0: port 3(vethcc4eb62d) entered disabled state machine # [ 53.536813] vethcc4eb62d: entered allmulticast mode machine # [ 53.537716] vethcc4eb62d: entered promiscuous mode machine # [ 53.385331] (udev-worker)[2062]: Network interface NamePolicy= disabled on kernel command line. machine # [ 53.549194] cni0: port 3(vethcc4eb62d) entered blocking state machine # [ 53.549993] cni0: port 3(vethcc4eb62d) entered forwarding state machine # [ 53.427649] dhcpcd[663]: vethcc4eb62d: IAID ce:7b:ee:eb machine # [ 53.429069] dhcpcd[663]: vethcc4eb62d: adding address fe80::5c74:ceff:fe7b:eeeb machine # [ 53.438196] (udev-worker)[2271]: Network interface NamePolicy= disabled on kernel command line. machine # [ 53.600465] cni0: port 4(vethdf556ce4) entered blocking state machine # [ 53.601258] cni0: port 4(vethdf556ce4) entered disabled state machine # [ 53.602496] vethdf556ce4: entered allmulticast mode machine # [ 53.603167] vethdf556ce4: entered promiscuous mode machine # [ 53.452282] (udev-worker)[2278]: Network interface NamePolicy= disabled on kernel command line. machine # [ 53.608785] cni0: port 5(vethba40bc6d) entered blocking state machine # [ 53.610049] cni0: port 5(vethba40bc6d) entered disabled state machine # [ 53.611296] vethba40bc6d: entered allmulticast mode machine # [ 53.612464] vethba40bc6d: entered promiscuous mode machine # [ 53.636089] cni0: port 4(vethdf556ce4) entered blocking state machine # [ 53.636744] cni0: port 4(vethdf556ce4) entered forwarding state machine # [ 53.645487] cni0: port 6(vethfacccc98) entered blocking state machine # [ 53.646644] cni0: port 6(vethfacccc98) entered disabled state machine # [ 53.647975] vethfacccc98: entered allmulticast mode machine # [ 53.648927] vethfacccc98: entered promiscuous mode machine # [ 53.649971] cni0: port 5(vethba40bc6d) entered blocking state machine # [ 53.651113] cni0: port 5(vethba40bc6d) entered forwarding state machine # [ 53.667310] cni0: port 6(vethfacccc98) entered blocking state machine # [ 53.668359] cni0: port 6(vethfacccc98) entered forwarding state machine # [ 53.524063] dhcpcd[663]: vethdf556ce4: waiting for carrier machine # [ 53.546627] dhcpcd[663]: vethba40bc6d: IAID 81:bd:31:18 machine # [ 53.548146] dhcpcd[663]: vethba40bc6d: adding address fe80::a05a:81ff:febd:3118 machine # [ 53.568617] dhcpcd[663]: vethfacccc98: IAID 97:30:b8:03 machine # [ 53.573143] dhcpcd[663]: vethfacccc98: adding address fe80::bcc6:97ff:fe30:b803 machine # [ 53.573867] dhcpcd[663]: vethdf556ce4: carrier acquired machine # [ 53.580820] dhcpcd[663]: vethdf556ce4: IAID fe:9e:94:12 machine # [ 53.581584] dhcpcd[663]: vethdf556ce4: adding address fe80::b0af:feff:fe9e:9412 machine # [ 53.581790] dhcpcd[663]: vethfacccc98: old hardware address: be:c6:97:30:b8:03 machine # [ 53.582823] dhcpcd[663]: vethfacccc98: new hardware address: f2:46:60:c5:a4:21 machine # [ 53.583798] dhcpcd[663]: vethfacccc98: carrier lost machine # [ 53.587517] systemd[1]: Started libcontainer container 0dc17c6ce5ba6ab66df248f11a615b5a8ef7ffc1ef6e8dcea8add5b9020c99b3. machine # [ 53.630295] dhcpcd[663]: vethfacccc98: deleting address fe80::bcc6:97ff:fe30:b803 machine # [ 53.632849] dhcpcd[663]: vethfacccc98: old hardware address: f2:46:60:c5:a4:21 machine # [ 53.634678] dhcpcd[663]: vethfacccc98: new hardware address: be:c6:97:30:b8:03 machine # [ 53.636941] dhcpcd[663]: vethfacccc98: carrier acquired machine # [ 53.645126] dhcpcd[663]: vethfacccc98: IAID 97:30:b8:03 machine # [ 53.645978] dhcpcd[663]: vethfacccc98: adding address fe80::bcc6:97ff:fe30:b803 machine # [ 53.696711] systemd[1]: Started libcontainer container 2228039d9fd3ddd4f16a7e79bc37b6a50d9674dfa0163a96c1f75646a6460452. machine # [ 53.719323] systemd[1]: Started libcontainer container f2456ad87c599aab2dcc1a9201ba968e5b002f5de8528aa3e9567f72f279a402. machine # [ 53.723493] systemd[1]: Started libcontainer container f476e063bf619f48eaae9995981814dd167059dfe5f7774170a45307a5c44ef5. machine # [ 53.821952] k3s[893]: E0922 10:56:23.029310 893 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 53.822758] k3s[893]: E0922 10:56:23.029398 893 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 53.823462] k3s[893]: E0922 10:56:23.029542 893 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-5844ddf54b-x5s55_farm(f1982df1-70cb-494e-9327-7121373628ec): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 53.824173] k3s[893]: E0922 10:56:23.029605 893 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-x5s55" podUID="f1982df1-70cb-494e-9327-7121373628ec" machine # [ 53.836351] k3s[893]: E0922 10:56:23.044906 893 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 53.837112] k3s[893]: E0922 10:56:23.044962 893 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 53.837746] k3s[893]: E0922 10:56:23.045068 893 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg_farm(a5681291-3832-4277-b724-b3cafefd0193): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 53.838440] k3s[893]: E0922 10:56:23.045130 893 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" podUID="a5681291-3832-4277-b724-b3cafefd0193" machine # [ 53.864996] k3s[893]: E0922 10:56:23.062221 893 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 53.865968] k3s[893]: E0922 10:56:23.062267 893 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 53.866535] k3s[893]: E0922 10:56:23.062451 893 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb_farm(e04a28b7-03e5-4020-a91a-09cf1491fcb2): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 53.867368] k3s[893]: E0922 10:56:23.062502 893 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" podUID="e04a28b7-03e5-4020-a91a-09cf1491fcb2" machine # [ 54.167342] dhcpcd[663]: vethcc4eb62d: soliciting a DHCP lease machine # [ 54.191362] systemd[1]: Started libcontainer container 2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003. machine # [ 54.413104] k3s[893]: E0922 10:56:23.621448 893 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" podUID="e04a28b7-03e5-4020-a91a-09cf1491fcb2" machine # [ 54.422197] k3s[893]: E0922 10:56:23.622145 893 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" podUID="a5681291-3832-4277-b724-b3cafefd0193" machine # [ 54.431943] k3s[893]: E0922 10:56:23.626136 893 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-x5s55" podUID="f1982df1-70cb-494e-9327-7121373628ec" machine # [ 54.448222] systemd[1]: cri-containerd-6d4b73a31ebbda08d6a75239760a2a4d164d39e5e3d2ff889ee8b528123c377c.scope: Deactivated successfully. machine # [ 54.472987] k3s[893]: I0922 10:56:23.681547 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-27g6f" podStartSLOduration=2.68152949 podStartE2EDuration="2.68152949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:56:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:56:23.680480754 +0000 UTC m=+34.430239316" watchObservedRunningTime="2026-09-22 10:56:23.68152949 +0000 UTC m=+34.431288052" machine # [ 54.502428] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-6d4b73a31ebbda08d6a75239760a2a4d164d39e5e3d2ff889ee8b528123c377c-rootfs.mount: Deactivated successfully. machine # [ 54.574208] dhcpcd[663]: vethba40bc6d: soliciting a DHCP lease machine # [ 54.838651] cni0: port 2(vetha1e269dd) entered disabled state machine # [ 54.684519] dhcpcd[663]: vetha1e269dd: carrier lost machine # [ 54.840857] vetha1e269dd (unregistering): left allmulticast mode machine # [ 54.842027] vetha1e269dd (unregistering): left promiscuous mode machine # [ 54.842830] cni0: port 2(vetha1e269dd) entered disabled state machine # [ 54.738755] dhcpcd[663]: vetha1e269dd: deleting address fe80::509f:95ff:fe5f:52ee machine # [ 54.757932] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-6d4b73a31ebbda08d6a75239760a2a4d164d39e5e3d2ff889ee8b528123c377c-shm.mount: Deactivated successfully. machine # [ 54.761814] systemd[1]: run-netns-cni\x2dc71ce602\x2d7252\x2d3883\x2db872\x2d2ac6665f28ea.mount: Deactivated successfully. machine # [ 54.794251] dhcpcd[663]: vethdf556ce4: soliciting a DHCP lease machine # [ 54.797708] k3s[893]: I0922 10:56:24.006279 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-cache\") pod \"5da01995-df4c-4519-9991-5bfcd7cd5584\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " machine # [ 54.798857] k3s[893]: I0922 10:56:24.006335 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-config\") pod \"5da01995-df4c-4519-9991-5bfcd7cd5584\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " machine # [ 54.806590] systemd[1]: var-lib-kubelet-pods-5da01995\x2ddf4c\x2d4519\x2d9991\x2d5bfcd7cd5584-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 54.807266] systemd[1]: var-lib-kubelet-pods-5da01995\x2ddf4c\x2d4519\x2d9991\x2d5bfcd7cd5584-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 54.808626] systemd[1]: var-lib-kubelet-pods-5da01995\x2ddf4c\x2d4519\x2d9991\x2d5bfcd7cd5584-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 54.818620] k3s[893]: I0922 10:56:24.026999 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-values\" (UniqueName: \"kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-values\") pod \"5da01995-df4c-4519-9991-5bfcd7cd5584\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " machine # [ 54.823382] k3s[893]: I0922 10:56:24.027115 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5da01995-df4c-4519-9991-5bfcd7cd5584-content\" (UniqueName: \"kubernetes.io/configmap/5da01995-df4c-4519-9991-5bfcd7cd5584-content\") pod \"5da01995-df4c-4519-9991-5bfcd7cd5584\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " machine # [ 54.823863] k3s[893]: I0922 10:56:24.027158 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-kube-api-access-njpbj\" (UniqueName: \"kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-kube-api-access-njpbj\") pod \"5da01995-df4c-4519-9991-5bfcd7cd5584\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " machine # [ 54.824599] k3s[893]: I0922 10:56:24.027187 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-helm\") pod \"5da01995-df4c-4519-9991-5bfcd7cd5584\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " machine # [ 54.825596] k3s[893]: I0922 10:56:24.027221 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-tmp\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-tmp\") pod \"5da01995-df4c-4519-9991-5bfcd7cd5584\" (UID: \"5da01995-df4c-4519-9991-5bfcd7cd5584\") " machine # [ 54.825892] k3s[893]: I0922 10:56:24.032334 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da01995-df4c-4519-9991-5bfcd7cd5584-content" pod "5da01995-df4c-4519-9991-5bfcd7cd5584" (UID: "5da01995-df4c-4519-9991-5bfcd7cd5584"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 54.826790] k3s[893]: I0922 10:56:24.034489 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-values" pod "5da01995-df4c-4519-9991-5bfcd7cd5584" (UID: "5da01995-df4c-4519-9991-5bfcd7cd5584"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 54.843847] k3s[893]: I0922 10:56:24.034590 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-config" pod "5da01995-df4c-4519-9991-5bfcd7cd5584" (UID: "5da01995-df4c-4519-9991-5bfcd7cd5584"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.845088] k3s[893]: I0922 10:56:24.034594 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-cache" pod "5da01995-df4c-4519-9991-5bfcd7cd5584" (UID: "5da01995-df4c-4519-9991-5bfcd7cd5584"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.846680] systemd[1]: var-lib-kubelet-pods-5da01995\x2ddf4c\x2d4519\x2d9991\x2d5bfcd7cd5584-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 54.866204] systemd[1]: var-lib-kubelet-pods-5da01995\x2ddf4c\x2d4519\x2d9991\x2d5bfcd7cd5584-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dnjpbj.mount: Deactivated successfully. machine # [ 54.867338] dhcpcd[663]: vetha1e269dd: removing interface machine # [ 54.869237] k3s[893]: I0922 10:56:24.077792 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-helm" pod "5da01995-df4c-4519-9991-5bfcd7cd5584" (UID: "5da01995-df4c-4519-9991-5bfcd7cd5584"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.877400] k3s[893]: I0922 10:56:24.085919 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-kube-api-access-njpbj" pod "5da01995-df4c-4519-9991-5bfcd7cd5584" (UID: "5da01995-df4c-4519-9991-5bfcd7cd5584"). InnerVolumeSpecName "kube-api-access-njpbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 54.889410] k3s[893]: I0922 10:56:24.097966 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-tmp" pod "5da01995-df4c-4519-9991-5bfcd7cd5584" (UID: "5da01995-df4c-4519-9991-5bfcd7cd5584"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 54.919110] k3s[893]: I0922 10:56:24.127602 893 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 54.919769] k3s[893]: I0922 10:56:24.127635 893 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 54.920902] k3s[893]: I0922 10:56:24.127675 893 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 54.921933] k3s[893]: I0922 10:56:24.127688 893 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-values\") on node \"machine\" DevicePath \"\"" machine # [ 54.922861] k3s[893]: I0922 10:56:24.127701 893 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/5da01995-df4c-4519-9991-5bfcd7cd5584-content\") on node \"machine\" DevicePath \"\"" machine # [ 54.923802] k3s[893]: I0922 10:56:24.127723 893 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njpbj\" (UniqueName: \"kubernetes.io/projected/5da01995-df4c-4519-9991-5bfcd7cd5584-kube-api-access-njpbj\") on node \"machine\" DevicePath \"\"" machine # [ 54.924523] k3s[893]: I0922 10:56:24.127736 893 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/5da01995-df4c-4519-9991-5bfcd7cd5584-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 55.280403] dhcpcd[663]: vethfacccc98: soliciting an IPv6 router machine # [ 55.331657] dhcpcd[663]: vethfacccc98: soliciting a DHCP lease machine # [ 55.334201] dhcpcd[663]: vethcc4eb62d: soliciting an IPv6 router machine # [ 55.424886] k3s[893]: I0922 10:56:24.633410 893 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d4b73a31ebbda08d6a75239760a2a4d164d39e5e3d2ff889ee8b528123c377c" machine # [ 55.432468] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod5da01995_df4c_4519_9991_5bfcd7cd5584.slice. machine # [ 55.433578] systemd[1]: kubepods-burstable-pod5da01995_df4c_4519_9991_5bfcd7cd5584.slice: Consumed 593ms CPU time over 6.169s wall clock time, 31.6M memory peak, 2.4M incoming IP traffic, 142K outgoing IP traffic. machine # [ 55.538702] dhcpcd[663]: vethdf556ce4: soliciting an IPv6 router machine # [ 55.545732] dhcpcd[663]: vethba40bc6d: soliciting an IPv6 router machine # [ 55.758287] systemd[1]: var-lib-kubelet-pods-5da01995\x2ddf4c\x2d4519\x2d9991\x2d5bfcd7cd5584-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 55.854567] dhcpcd[663]: veth41d3b6c2: probing for an IPv4LL address machine # [ 56.320958] dhcpcd[663]: flannel.1: probing for an IPv4LL address machine # [ 56.840055] k3s[893]: time="2026-09-22T10:56:26Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.1" machine # [ 56.841519] k3s[893]: time="2026-09-22T10:56:26Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:1b9fd88c2d436b7a437f2ffe60269e3fd993ac886a8d27556482a68f4910f489" machine # [ 57.055906] k3s[893]: time="2026-09-22T10:56:26Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 9.410468089s" machine # [ 59.168296] dhcpcd[663]: vethcc4eb62d: probing for an IPv4LL address machine # [ 59.574684] dhcpcd[663]: vethba40bc6d: probing for an IPv4LL address machine # [ 59.795389] dhcpcd[663]: vethdf556ce4: probing for an IPv4LL address machine # [ 60.333349] dhcpcd[663]: vethfacccc98: probing for an IPv4LL address machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 30.42 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 60.631101] dhcpcd[663]: flannel.1: using IPv4LL address 169.254.111.82 machine # [ 60.632870] dhcpcd[663]: flannel.1: adding route to 169.254.0.0/16 machine # [ 60.839356] dhcpcd[663]: veth41d3b6c2: using IPv4LL address 169.254.123.190 machine # [ 60.841108] dhcpcd[663]: veth41d3b6c2: adding route to 169.254.0.0/16 machine # [ 63.619357] dhcpcd[663]: flannel.1: no IPv6 Routers available machine # [ 63.996267] dhcpcd[663]: vethba40bc6d: using IPv4LL address 169.254.190.208 machine # [ 63.998091] dhcpcd[663]: vethba40bc6d: adding route to 169.254.0.0/16 machine # [ 64.557621] dhcpcd[663]: veth41d3b6c2: no IPv6 Routers available machine # [ 64.579851] dhcpcd[663]: vethcc4eb62d: using IPv4LL address 169.254.58.5 machine # [ 64.582503] dhcpcd[663]: vethcc4eb62d: adding route to 169.254.0.0/16 machine # [ 65.198320] dhcpcd[663]: vethdf556ce4: using IPv4LL address 169.254.231.59 machine # [ 65.200108] dhcpcd[663]: vethdf556ce4: adding route to 169.254.0.0/16 machine # [ 65.547099] dhcpcd[663]: vethfacccc98: using IPv4LL address 169.254.112.62 machine # [ 65.549108] dhcpcd[663]: vethfacccc98: adding route to 169.254.0.0/16 machine # [ 66.982722] dhcpcd[663]: segfault at 608e9ae48 ip 0000608e7b87ccb3 sp 00007ffffb50f598 error 4 in dhcpcd[38cb3,608e7b84d000+40000] likely on CPU 3 (core 3, socket 0) machine # [ 66.984599] Code: 45 ae 01 e9 0f fe ff ff 0f 1f 80 00 00 00 00 c6 45 af 01 e9 ff fd ff ff e8 fa 05 fd ff 66 2e 0f 1f 84 00 00 00 00 00 48 8b 07 <48> 8b 80 50 03 00 00 48 85 c0 74 31 90 48 8b 00 48 85 c0 74 1e 48 machine # [ 66.845454] systemd-coredump[2890]: Process 663 (dhcpcd) of user 999 terminated abnormally with signal 11/SEGV, processing... machine # [ 66.853543] systemd[1]: Created slice Slice /system/systemd-coredump. machine # [ 66.858423] systemd[1]: Started Process Core Dump (PID 2890/UID 0). machine # [ 67.160887] systemd-coredump[2891]: Process 663 (dhcpcd) of user 999 dumped core. machine # machine # Module udev.so without build-id. machine # Module dhcpcd without build-id. machine # Stack trace of thread 663: machine # #0 0x0000608e7b87ccb3 ipv6nd_expire (dhcpcd + 0x38cb3) machine # #1 0x0000608e7b85606a eloop_start (dhcpcd + 0x1206a) machine # #2 0x0000608e7b84e300 main (dhcpcd + 0xa300) machine # #3 0x0000796222dc3285 __libc_start_call_main (libc.so.6 + 0x2b285) machine # #4 0x0000796222dc3338 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x2b338) machine # #5 0x0000608e7b84f365 _start (dhcpcd + 0xb365) machine # ELF object binary architecture: AMD x86-64 machine # machine # [ 67.179300] systemd[1]: systemd-coredump@0-1-2890_2891-0.service: Deactivated successfully. machine # [ 67.261800] systemd[1]: dhcpcd.service: Main process exited, code=dumped, status=11/SEGV machine # [ 67.262788] systemd[1]: dhcpcd.service: Failed with result 'core-dump'. machine # [ 67.263770] systemd[1]: dhcpcd.service: Consumed 544ms CPU time over 58.604s wall clock time, 6M memory peak, 8K written to disk, 96B incoming IP traffic, 1.2K outgoing IP traffic. machine # [ 67.423686] systemd[1]: dhcpcd.service: Scheduled restart job, restart counter is at 1. machine # [ 67.429593] systemd[1]: Starting DHCP Client... machine # [ 67.629258] dhcpcd[2903]: dhcpcd-10.3.2 starting machine # [ 67.632992] dhcpcd[2907]: dev: loaded udev machine # [ 67.634887] dhcpcd[2907]: DUID 00:01:00:01:32:45:1b:2a:52:54:00:12:34:56 machine # [ 67.807705] dhcpcd[2907]: eth0: IAID 00:12:34:56 machine # [ 67.809583] dhcpcd[2907]: flannel.1: IAID 89:a4:7f:de machine # [ 67.811264] dhcpcd[2907]: veth41d3b6c2: IAID a1:e9:c8:04 machine # [ 67.813338] dhcpcd[2907]: vethcc4eb62d: IAID ce:7b:ee:eb machine # [ 67.815441] dhcpcd[2907]: vethdf556ce4: IAID fe:9e:94:12 machine # [ 67.817512] dhcpcd[2907]: vethba40bc6d: IAID 81:bd:31:18 machine # [ 67.819231] dhcpcd[2907]: vethfacccc98: IAID 97:30:b8:03 machine # [ 67.927966] dhcpcd[2907]: vethdf556ce4: soliciting a DHCP lease machine # [ 68.226970] dhcpcd[2907]: veth41d3b6c2: soliciting a DHCP lease machine # [ 68.352733] dhcpcd[2907]: vethdf556ce4: soliciting an IPv6 router machine # [ 68.569349] dhcpcd[2907]: vethcc4eb62d: soliciting an IPv6 router machine # [ 68.590340] dhcpcd[2907]: vethfacccc98: soliciting an IPv6 router machine # [ 68.621548] dhcpcd[2907]: eth0: soliciting an IPv6 router machine # [ 68.622860] dhcpcd[2907]: eth0: Router Advertisement from fe80::2 machine # [ 68.624177] dhcpcd[2907]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 68.689561] dhcpcd[2907]: flannel.1: soliciting an IPv6 router machine # [ 68.690924] dhcpcd[2907]: vethba40bc6d: soliciting an IPv6 router machine # [ 68.692636] dhcpcd[2907]: veth41d3b6c2: soliciting an IPv6 router machine # [ 68.782468] dhcpcd[2907]: flannel.1: soliciting a DHCP lease machine # [ 69.260228] dhcpcd[2907]: vethba40bc6d: soliciting a DHCP lease machine # [ 69.505553] dhcpcd[2907]: eth0: rebinding lease of 10.0.2.15 machine # [ 69.511541] dhcpcd[2907]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 69.562942] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3844010472.mount: Deactivated successfully. machine # [ 69.581077] systemd[1]: Started DHCP Client. machine # [ 69.583328] dhcpcd[2907]: vethfacccc98: soliciting a DHCP lease machine # [ 69.800253] dhcpcd[2907]: vethcc4eb62d: soliciting a DHCP lease machine # error: timed out waiting for the condition machine # [ 72.658938] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped936920260.mount: Deactivated successfully. machine # [ 72.670994] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped720798824.mount: Deactivated successfully. machine # [ 72.854508] systemd[1]: Started libcontainer container f4b2223420d0b470fc2b55725d0afabcf1cf48ba1af55fa09050fbd6ee601b07. machine # [ 73.657065] systemd[1]: tmp-ovl\x2didmapped3918107307.mount: Deactivated successfully. machine # [ 73.972717] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4238905885.mount: Deactivated successfully. machine # [ 74.023686] systemd[1]: Started libcontainer container 06c65aaed6d5763771ea32db11054d89ddbd6c3c174893a4cd4c5790dab1b44c. machine # [ 74.088198] systemd[1]: Started libcontainer container 24e9c9ff6e21f1e5f658cccd01e50abd7c1476e08b42660195ea03d3cb8861b8. machine # [ 74.197969] niks3-server[1203]: 2026/09/22 10:56:43 INFO lead: acquired remote=10.42.0.6:36582 machine # [ 74.532110] k3s[893]: I0922 10:56:43.739509 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-x5s55" podStartSLOduration=7.180010721 podStartE2EDuration="22.739482943s" totalImagesPullingTime="15.559472222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:56:43.724349176 +0000 UTC m=+54.474108017" watchObservedRunningTime="2026-09-22 10:56:43.739482943 +0000 UTC m=+54.489241784" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 14.06 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 74.586126] systemd[1]: cri-containerd-f4b2223420d0b470fc2b55725d0afabcf1cf48ba1af55fa09050fbd6ee601b07.scope: Deactivated successfully. machine # [ 74.587902] systemd[1]: cri-containerd-f4b2223420d0b470fc2b55725d0afabcf1cf48ba1af55fa09050fbd6ee601b07.scope: Consumed 771ms CPU time over 1.731s wall clock time, 441.1M memory peak, 203.2M read from disk, 229.2M written to disk. machine # [ 74.666797] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1936671329.mount: Deactivated successfully. machine # [ 74.667673] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped100282195.mount: Deactivated successfully. machine # [ 74.681354] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-f4b2223420d0b470fc2b55725d0afabcf1cf48ba1af55fa09050fbd6ee601b07-rootfs.mount: Deactivated successfully. machine # [ 74.819661] systemd[1]: cri-containerd-24e9c9ff6e21f1e5f658cccd01e50abd7c1476e08b42660195ea03d3cb8861b8.scope: Deactivated successfully. machine # [ 74.821890] systemd[1]: cri-containerd-24e9c9ff6e21f1e5f658cccd01e50abd7c1476e08b42660195ea03d3cb8861b8.scope: Consumed 528ms CPU time over 731ms wall clock time, 343.6M memory peak, 33.1M read from disk, 256.9M written to disk. machine # [ 74.882982] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-24e9c9ff6e21f1e5f658cccd01e50abd7c1476e08b42660195ea03d3cb8861b8-rootfs.mount: Deactivated successfully. machine # [ 75.747272] systemd[1]: tmp-ovl\x2didmapped3632247954.mount: Deactivated successfully. machine # [ 75.749325] systemd[1]: tmp-ovl\x2didmapped2807388104.mount: Deactivated successfully. machine # [ 75.771431] systemd[1]: Started libcontainer container f902854882ab0e13af09ed392489e2c1c54425eb48600959dc185abc2f6a1a3f. machine # [ 75.774034] systemd[1]: Started libcontainer container b50990c1cec045c3587882b592f33eb92a7483f855edf1bf3f842bcd13034d88. machine # [ 75.942221] systemd[1]: Started libcontainer container 5c1ab75071d2b2e31c9f8e8ab4ee8fd54586e58ba4c2b11f714588912df6e9b8. machine # [ 75.949197] systemd[1]: Started libcontainer container 5de37aa77b7fb1fccbfe1136693ca69a7ea80cff8bd3edd92de244bbec32a863. machine # [ 76.174382] systemd[1]: Started libcontainer container 8c25b6e5af1ee1246fee53a4f376da703475be7c6b1fbfb8501aade81412fae4. machine # [ 76.226960] systemd[1]: Started libcontainer container 3bcfd5dbfcfc70c371b809fa93d334539b8e5f81b3df9fd37d15193e00a06a2f. machine # [ 76.576907] k3s[893]: I0922 10:56:45.784586 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg" podStartSLOduration=8.545184228 podStartE2EDuration="24.784540904s" totalImagesPullingTime="14.543049185s" totalInitContainerRuntime="1.696307491s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:56:45.761261688 +0000 UTC m=+56.511025558" watchObservedRunningTime="2026-09-22 10:56:45.784540904 +0000 UTC m=+56.534303936" machine # [ 77.733964] dhcpcd[2907]: veth41d3b6c2: using IPv4LL address 169.254.123.190 machine # [ 77.735610] dhcpcd[2907]: flannel.1: adding route to 169.254.0.0/16 machine # [ 77.736781] dhcpcd[2907]: veth41d3b6c2: adding route to 169.254.0.0/16 machine # [ 77.737950] dhcpcd[2907]: vethcc4eb62d: adding route to 169.254.0.0/16 machine # [ 77.739173] dhcpcd[2907]: vethdf556ce4: adding route to 169.254.0.0/16 machine # [ 77.740421] dhcpcd[2907]: vethba40bc6d: adding route to 169.254.0.0/16 machine # [ 77.741625] dhcpcd[2907]: vethfacccc98: adding route to 169.254.0.0/16 machine # [ 77.850381] dhcpcd[2907]: vethdf556ce4: using IPv4LL address 169.254.231.59 machine # [ 78.407427] k3s[893]: I0922 10:56:47.615397 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb" podStartSLOduration=10.377286072 podStartE2EDuration="26.615368285s" totalImagesPullingTime="15.546671433s" totalInitContainerRuntime="691.41078ms" isStatefulPod=false podCreationTimestamp="2026-09-22 10:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:56:45.787125311 +0000 UTC m=+56.536884711" watchObservedRunningTime="2026-09-22 10:56:47.615368285 +0000 UTC m=+58.365127127" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 4.04 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.08 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine # [ 78.954611] dhcpcd[2907]: flannel.1: using IPv4LL address 169.254.111.82 machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.40 seconds) machine: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine # [ 79.795850] dhcpcd[2907]: vethfacccc98: using IPv4LL address 169.254.112.62 machine # [ 79.841670] dhcpcd[2907]: vethcc4eb62d: using IPv4LL address 169.254.58.5 machine # [ 79.883419] dhcpcd[2907]: vethba40bc6d: using IPv4LL address 169.254.190.208 machine # [ 80.356658] dhcpcd[2907]: vethdf556ce4: no IPv6 Routers available machine # [ 80.575030] dhcpcd[2907]: vethcc4eb62d: no IPv6 Routers available machine # [ 80.593212] dhcpcd[2907]: vethfacccc98: no IPv6 Routers available machine # [ 80.689537] dhcpcd[2907]: flannel.1: no IPv6 Routers available machine # [ 80.690567] dhcpcd[2907]: vethba40bc6d: no IPv6 Routers available machine # [ 80.691254] dhcpcd[2907]: veth41d3b6c2: no IPv6 Routers available machine: (finished: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 8.66 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.06 seconds) (finished: subtest: chart deploys and workers become Ready, in 57.95 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.21 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.20 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1 machine # [ 118.355312] niks3-server[1203]: 2026/09/22 10:57:27 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 118.399924] niks3-server[1203]: 2026/09/22 10:57:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 118.405627] niks3-server[1203]: 2026/09/22 10:57:27 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 118.410435] niks3-server[1203]: 2026/09/22 10:57:27 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 118.414987] niks3-server[1203]: 2026/09/22 10:57:27 INFO Signed narinfos id=1 count=1 machine # [ 118.424396] niks3-server[1203]: 2026/09/22 10:57:27 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 118.430631] niks3-server[1203]: 2026/09/22 10:57:27 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 118.433094] niks3-server[1203]: 2026/09/22 10:57:27 INFO Completed upload id=1 machine # [ 126.916640] niks3-server[1203]: 2026/09/22 10:57:36 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 126.929284] niks3-server[1203]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 126.931246] niks3-server[1203]: 2026/09/22 10:57:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 126.932963] niks3-server[1203]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 126.933697] niks3-server[1203]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 126.936299] niks3-server[1203]: 2026/09/22 10:57:36 INFO Signed narinfos id=2 count=1 machine # [ 126.942289] niks3-server[1203]: 2026/09/22 10:57:36 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 126.945057] niks3-server[1203]: 2026/09/22 10:57:36 INFO Completed upload id=2 machine # [ 126.946340] niks3-server[1203]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 127.025269] niks3-server[1203]: 2026/09/22 10:57:36 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 127.038437] niks3-server[1203]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 127.039169] niks3-server[1203]: 2026/09/22 10:57:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 127.040225] niks3-server[1203]: 2026/09/22 10:57:36 INFO Signed narinfos id=3 count=1 machine # [ 127.041823] niks3-server[1203]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 127.048311] niks3-server[1203]: 2026/09/22 10:57:36 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 127.051048] niks3-server[1203]: 2026/09/22 10:57:36 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 127.052075] niks3-server[1203]: 2026/09/22 10:57:36 INFO Completed upload id=3 machine # [ 135.918048] niks3-server[1203]: 2026/09/22 10:57:45 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 135.930648] niks3-server[1203]: 2026/09/22 10:57:45 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 135.931914] niks3-server[1203]: 2026/09/22 10:57:45 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 135.936829] niks3-server[1203]: 2026/09/22 10:57:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 135.938046] niks3-server[1203]: 2026/09/22 10:57:45 INFO Signed narinfos id=4 count=1 machine # [ 135.941659] niks3-server[1203]: 2026/09/22 10:57:45 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 135.948797] niks3-server[1203]: 2026/09/22 10:57:45 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 135.950207] niks3-server[1203]: 2026/09/22 10:57:45 INFO Completed upload id=4 machine # [ 135.952242] niks3-server[1203]: 2026/09/22 10:57:45 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 136.040315] niks3-server[1203]: 2026/09/22 10:57:45 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 136.049726] niks3-server[1203]: 2026/09/22 10:57:45 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 136.051255] niks3-server[1203]: 2026/09/22 10:57:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 136.052109] niks3-server[1203]: 2026/09/22 10:57:45 INFO Signed narinfos id=5 count=1 machine # [ 136.052752] niks3-server[1203]: 2026/09/22 10:57:45 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 136.054762] niks3-server[1203]: 2026/09/22 10:57:45 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 136.056161] niks3-server[1203]: 2026/09/22 10:57:45 INFO Completed upload id=5 machine # [ 136.057446] niks3-server[1203]: 2026/09/22 10:57:45 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 144.931365] niks3-server[1203]: 2026/09/22 10:57:54 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 144.947156] niks3-server[1203]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 144.948293] niks3-server[1203]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 144.950210] niks3-server[1203]: 2026/09/22 10:57:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 144.951066] niks3-server[1203]: 2026/09/22 10:57:54 INFO Signed narinfos id=6 count=1 machine # [ 144.956664] niks3-server[1203]: 2026/09/22 10:57:54 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 144.957581] niks3-server[1203]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 144.960577] niks3-server[1203]: 2026/09/22 10:57:54 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine # [ 144.963451] niks3-server[1203]: 2026/09/22 10:57:54 INFO Completed upload id=6 machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1, in 57.60 seconds) machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath, in 0.27 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.30 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1 machine # [ 147.054591] niks3-server[1203]: 2026/09/22 10:57:56 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 147.077057] niks3-server[1203]: 2026/09/22 10:57:56 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 147.082089] niks3-server[1203]: 2026/09/22 10:57:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 147.083383] niks3-server[1203]: 2026/09/22 10:57:56 INFO Signed narinfos id=7 count=1 machine # [ 147.088749] niks3-server[1203]: 2026/09/22 10:57:56 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 147.097345] niks3-server[1203]: 2026/09/22 10:57:56 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 147.100099] niks3-server[1203]: 2026/09/22 10:57:56 INFO Completed upload id=7 machine # [ 147.101740] niks3-server[1203]: 2026/09/22 10:57:56 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 155.573334] niks3-server[1203]: 2026/09/22 10:58:04 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 155.596709] niks3-server[1203]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 155.601964] niks3-server[1203]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 155.606200] niks3-server[1203]: 2026/09/22 10:58:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 155.609903] niks3-server[1203]: 2026/09/22 10:58:04 INFO Signed narinfos id=8 count=1 machine # [ 155.614171] niks3-server[1203]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 155.618596] niks3-server[1203]: 2026/09/22 10:58:04 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 155.621695] niks3-server[1203]: 2026/09/22 10:58:04 INFO Completed upload id=8 machine # [ 155.623644] niks3-server[1203]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 155.706037] niks3-server[1203]: 2026/09/22 10:58:04 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 155.720714] niks3-server[1203]: 2026/09/22 10:58:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 155.721886] niks3-server[1203]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 155.723641] niks3-server[1203]: 2026/09/22 10:58:04 INFO Signed narinfos id=9 count=1 machine # [ 155.725441] niks3-server[1203]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 155.735733] niks3-server[1203]: 2026/09/22 10:58:04 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 155.738829] niks3-server[1203]: 2026/09/22 10:58:04 INFO Completed upload id=9 machine # [ 155.741184] niks3-server[1203]: 2026/09/22 10:58:04 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 164.615158] niks3-server[1203]: 2026/09/22 10:58:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 164.634838] niks3-server[1203]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 164.636333] niks3-server[1203]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 164.646146] niks3-server[1203]: 2026/09/22 10:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 164.650358] niks3-server[1203]: 2026/09/22 10:58:13 INFO Signed narinfos id=10 count=1 machine # [ 164.652707] niks3-server[1203]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 164.659135] niks3-server[1203]: 2026/09/22 10:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 164.660724] niks3-server[1203]: 2026/09/22 10:58:13 INFO Completed upload id=10 machine # [ 164.757467] niks3-server[1203]: 2026/09/22 10:58:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 164.768587] niks3-server[1203]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 164.771114] niks3-server[1203]: 2026/09/22 10:58:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 164.772129] niks3-server[1203]: 2026/09/22 10:58:13 INFO Signed narinfos id=11 count=1 machine # [ 164.774834] niks3-server[1203]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 164.777522] niks3-server[1203]: 2026/09/22 10:58:13 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 164.785836] niks3-server[1203]: 2026/09/22 10:58:13 INFO Completed upload id=11 machine # [ 164.786983] niks3-server[1203]: 2026/09/22 10:58:13 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 173.860783] niks3-server[1203]: 2026/09/22 10:58:23 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 173.878172] niks3-server[1203]: 2026/09/22 10:58:23 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 173.880259] niks3-server[1203]: 2026/09/22 10:58:23 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 173.888205] niks3-server[1203]: 2026/09/22 10:58:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 173.888744] niks3-server[1203]: 2026/09/22 10:58:23 INFO Signed narinfos id=12 count=1 machine # [ 173.893198] niks3-server[1203]: 2026/09/22 10:58:23 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 173.897842] niks3-server[1203]: 2026/09/22 10:58:23 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 173.904118] niks3-server[1203]: 2026/09/22 10:58:23 INFO Completed upload id=12 machine # [ 173.905028] niks3-server[1203]: 2026/09/22 10:58:23 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1, in 27.32 seconds) (finished: subtest: build through the balancer lands in the cache, in 85.50 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.20 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix, in 0.19 seconds) machine: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json, in 0.26 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 175.058849] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod59e86837_a461_424b_9048_89c18b5af74d.slice. machine # [ 175.136369] k3s[893]: I0922 10:58:24.344182 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/59e86837-a461-424b-9048-89c18b5af74d-job\") pod \"ci-hr6hs\" (UID: \"59e86837-a461-424b-9048-89c18b5af74d\") " pod="ci/ci-hr6hs" machine # [ 175.137881] k3s[893]: I0922 10:58:24.344248 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-nix-grpc-farm\") pod \"ci-hr6hs\" (UID: \"59e86837-a461-424b-9048-89c18b5af74d\") " pod="ci/ci-hr6hs" machine # [ 175.138672] k3s[893]: I0922 10:58:24.344278 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzrhw\" (UniqueName: \"kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-kube-api-access-nzrhw\") pod \"ci-hr6hs\" (UID: \"59e86837-a461-424b-9048-89c18b5af74d\") " pod="ci/ci-hr6hs" machine # [ 175.551259] cni0: port 2(veth818e8324) entered blocking state machine # [ 175.554685] cni0: port 2(veth818e8324) entered disabled state machine # [ 175.557673] veth818e8324: entered allmulticast mode machine # [ 175.560319] veth818e8324: entered promiscuous mode machine # [ 175.572951] cni0: port 2(veth818e8324) entered blocking state machine # [ 175.575148] cni0: port 2(veth818e8324) entered forwarding state machine # [ 175.469412] (udev-worker)[4654]: Network interface NamePolicy= disabled on kernel command line. machine # [ 175.509073] dhcpcd[2907]: veth818e8324: IAID ce:a6:2d:0c machine # [ 175.509460] dhcpcd[2907]: veth818e8324: adding address fe80::383e:ceff:fea6:2d0c machine # [ 175.526489] systemd[1]: Started libcontainer container 0d14a74d2246ec98a46885e81a9106c448df699faebe3ccaca844b43e119b293. machine # [ 176.511163] dhcpcd[2907]: veth818e8324: soliciting a DHCP lease machine # [ 176.785713] dhcpcd[2907]: veth818e8324: soliciting an IPv6 router machine # [ 177.253255] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount365101511.mount: Deactivated successfully. machine # [ 177.255884] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3202330593.mount: Deactivated successfully. machine # [ 177.334645] systemd[1]: Started libcontainer container 463e554f34de85ada15d64f9ad5a298374b5c6b7b5e3997ccb143786fb02d43a. machine # [ 177.903580] k3s[893]: I0922 10:58:27.111396 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ci/ci-hr6hs" podStartSLOduration=3.111271245 podStartE2EDuration="3.111271245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:58:27.109242775 +0000 UTC m=+157.859006086" watchObservedRunningTime="2026-09-22 10:58:27.111271245 +0000 UTC m=+157.861079255" machine # [ 178.936619] niks3-server[1203]: 2026/09/22 10:58:28 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 178.954064] niks3-server[1203]: 2026/09/22 10:58:28 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 178.957416] niks3-server[1203]: 2026/09/22 10:58:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 178.959575] niks3-server[1203]: 2026/09/22 10:58:28 INFO Signed narinfos id=13 count=1 machine # [ 178.965334] niks3-server[1203]: 2026/09/22 10:58:28 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 178.968696] niks3-server[1203]: 2026/09/22 10:58:28 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 178.970945] niks3-server[1203]: 2026/09/22 10:58:28 INFO Completed upload id=13 machine # [ 178.974415] niks3-server[1203]: 2026/09/22 10:58:28 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 181.511401] dhcpcd[2907]: veth818e8324: probing for an IPv4LL address machine # [ 186.400777] dhcpcd[2907]: veth818e8324: using IPv4LL address 169.254.251.80 machine # [ 186.403626] dhcpcd[2907]: veth818e8324: adding route to 169.254.0.0/16 machine # [ 187.432885] niks3-server[1203]: 2026/09/22 10:58:36 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 187.446493] niks3-server[1203]: 2026/09/22 10:58:36 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 187.447780] niks3-server[1203]: 2026/09/22 10:58:36 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 187.449392] niks3-server[1203]: 2026/09/22 10:58:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 187.450098] niks3-server[1203]: 2026/09/22 10:58:36 INFO Signed narinfos id=14 count=1 machine # [ 187.452222] niks3-server[1203]: 2026/09/22 10:58:36 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 187.454461] niks3-server[1203]: 2026/09/22 10:58:36 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 187.456396] niks3-server[1203]: 2026/09/22 10:58:36 INFO Completed upload id=14 machine # [ 187.470068] niks3-server[1203]: 2026/09/22 10:58:36 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 187.546236] niks3-server[1203]: 2026/09/22 10:58:36 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 187.559164] niks3-server[1203]: 2026/09/22 10:58:36 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 187.562703] niks3-server[1203]: 2026/09/22 10:58:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 187.563453] niks3-server[1203]: 2026/09/22 10:58:36 INFO Signed narinfos id=15 count=1 machine # [ 187.565294] niks3-server[1203]: 2026/09/22 10:58:36 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 187.567361] niks3-server[1203]: 2026/09/22 10:58:36 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 187.569325] niks3-server[1203]: 2026/09/22 10:58:36 INFO Completed upload id=15 machine # [ 187.570311] niks3-server[1203]: 2026/09/22 10:58:36 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 188.793522] dhcpcd[2907]: veth818e8324: no IPv6 Routers available machine # [ 196.651892] niks3-server[1203]: 2026/09/22 10:58:45 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 196.671539] niks3-server[1203]: 2026/09/22 10:58:45 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 196.677585] niks3-server[1203]: 2026/09/22 10:58:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 196.679722] niks3-server[1203]: 2026/09/22 10:58:45 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 196.682619] niks3-server[1203]: 2026/09/22 10:58:45 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 196.688505] niks3-server[1203]: 2026/09/22 10:58:45 INFO Signed narinfos id=16 count=1 machine # [ 196.698386] niks3-server[1203]: 2026/09/22 10:58:45 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 196.702693] niks3-server[1203]: 2026/09/22 10:58:45 INFO Completed upload id=16 machine # [ 196.709242] niks3-server[1203]: 2026/09/22 10:58:45 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 196.801987] niks3-server[1203]: 2026/09/22 10:58:46 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 196.813254] niks3-server[1203]: 2026/09/22 10:58:46 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 196.820854] niks3-server[1203]: 2026/09/22 10:58:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 196.822348] niks3-server[1203]: 2026/09/22 10:58:46 INFO Signed narinfos id=17 count=1 machine # [ 196.826706] niks3-server[1203]: 2026/09/22 10:58:46 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 196.829583] niks3-server[1203]: 2026/09/22 10:58:46 INFO Completed upload id=17 machine # [ 196.831193] niks3-server[1203]: 2026/09/22 10:58:46 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 196.833122] niks3-server[1203]: 2026/09/22 10:58:46 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 205.312939] niks3-server[1203]: 2026/09/22 10:58:54 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 205.331679] niks3-server[1203]: 2026/09/22 10:58:54 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 205.335638] niks3-server[1203]: 2026/09/22 10:58:54 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 205.340528] niks3-server[1203]: 2026/09/22 10:58:54 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 205.343579] niks3-server[1203]: 2026/09/22 10:58:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 205.344689] niks3-server[1203]: 2026/09/22 10:58:54 INFO Signed narinfos id=18 count=1 machine # [ 205.353264] niks3-server[1203]: 2026/09/22 10:58:54 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 205.356655] niks3-server[1203]: 2026/09/22 10:58:54 INFO Completed upload id=18 machine # [ 205.358320] niks3-server[1203]: 2026/09/22 10:58:54 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo machine # [ 208.167805] niks3-server[1203]: 2026/09/22 10:58:57 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 208.187490] niks3-server[1203]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 208.192065] niks3-server[1203]: 2026/09/22 10:58:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 208.195963] niks3-server[1203]: 2026/09/22 10:58:57 INFO Signed narinfos id=19 count=1 machine # [ 208.198594] niks3-server[1203]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 208.203400] niks3-server[1203]: 2026/09/22 10:58:57 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 208.206809] niks3-server[1203]: 2026/09/22 10:58:57 INFO Completed upload id=19 machine # [ 208.208723] niks3-server[1203]: 2026/09/22 10:58:57 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 217.071212] niks3-server[1203]: 2026/09/22 10:59:06 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 217.088948] niks3-server[1203]: 2026/09/22 10:59:06 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 217.094188] niks3-server[1203]: 2026/09/22 10:59:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 217.096185] niks3-server[1203]: 2026/09/22 10:59:06 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 217.097975] niks3-server[1203]: 2026/09/22 10:59:06 INFO Signed narinfos id=20 count=1 machine # [ 217.099715] niks3-server[1203]: 2026/09/22 10:59:06 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 217.114410] niks3-server[1203]: 2026/09/22 10:59:06 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 217.118237] niks3-server[1203]: 2026/09/22 10:59:06 INFO Completed upload id=20 machine # [ 217.122289] niks3-server[1203]: 2026/09/22 10:59:06 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 218.290243] systemd[1]: cri-containerd-463e554f34de85ada15d64f9ad5a298374b5c6b7b5e3997ccb143786fb02d43a.scope: Deactivated successfully. machine # [ 218.291576] systemd[1]: cri-containerd-463e554f34de85ada15d64f9ad5a298374b5c6b7b5e3997ccb143786fb02d43a.scope: Consumed 1.121s CPU time over 40.955s wall clock time, 152.2M memory peak, 99.7M read from disk, 424K written to disk, 16.6K incoming IP traffic, 44.2K outgoing IP traffic. machine # [ 218.359539] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-463e554f34de85ada15d64f9ad5a298374b5c6b7b5e3997ccb143786fb02d43a-rootfs.mount: Deactivated successfully. machine # [ 220.073621] systemd[1]: cri-containerd-0d14a74d2246ec98a46885e81a9106c448df699faebe3ccaca844b43e119b293.scope: Deactivated successfully. machine # [ 220.118391] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-0d14a74d2246ec98a46885e81a9106c448df699faebe3ccaca844b43e119b293-rootfs.mount: Deactivated successfully. machine # [ 220.150242] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-0d14a74d2246ec98a46885e81a9106c448df699faebe3ccaca844b43e119b293-shm.mount: Deactivated successfully. machine # [ 220.361699] cni0: port 2(veth818e8324) entered disabled state machine # [ 220.209356] dhcpcd[2907]: veth818e8324: carrier lost machine # [ 220.365566] veth818e8324 (unregistering): left allmulticast mode machine # [ 220.367269] veth818e8324 (unregistering): left promiscuous mode machine # [ 220.368807] cni0: port 2(veth818e8324) entered disabled state machine # [ 220.237753] systemd[1]: run-netns-cni\x2d988350ff\x2d3069\x2d9707\x2daac3\x2dc623da6623d6.mount: Deactivated successfully. machine # [ 220.261834] dhcpcd[2907]: veth818e8324: deleting address fe80::383e:ceff:fea6:2d0c machine # [ 220.264220] dhcpcd[2907]: veth818e8324: deleting route to 169.254.0.0/16 machine # [ 220.365460] dhcpcd[2907]: veth818e8324: removing interface machine # [ 220.387296] k3s[893]: I0922 10:59:09.595582 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59e86837-a461-424b-9048-89c18b5af74d-job\" (UniqueName: \"kubernetes.io/configmap/59e86837-a461-424b-9048-89c18b5af74d-job\") pod \"59e86837-a461-424b-9048-89c18b5af74d\" (UID: \"59e86837-a461-424b-9048-89c18b5af74d\") " machine # [ 220.393593] k3s[893]: I0922 10:59:09.595640 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-kube-api-access-nzrhw\" (UniqueName: \"kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-kube-api-access-nzrhw\") pod \"59e86837-a461-424b-9048-89c18b5af74d\" (UID: \"59e86837-a461-424b-9048-89c18b5af74d\") " machine # [ 220.400713] k3s[893]: I0922 10:59:09.595707 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-nix-grpc-farm\") pod \"59e86837-a461-424b-9048-89c18b5af74d\" (UID: \"59e86837-a461-424b-9048-89c18b5af74d\") " machine # [ 220.406266] k3s[893]: I0922 10:59:09.596089 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59e86837-a461-424b-9048-89c18b5af74d-job" pod "59e86837-a461-424b-9048-89c18b5af74d" (UID: "59e86837-a461-424b-9048-89c18b5af74d"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 220.412107] k3s[893]: I0922 10:59:09.602808 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-kube-api-access-nzrhw" pod "59e86837-a461-424b-9048-89c18b5af74d" (UID: "59e86837-a461-424b-9048-89c18b5af74d"). InnerVolumeSpecName "kube-api-access-nzrhw". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 220.418347] k3s[893]: I0922 10:59:09.603002 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-nix-grpc-farm" pod "59e86837-a461-424b-9048-89c18b5af74d" (UID: "59e86837-a461-424b-9048-89c18b5af74d"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 220.424291] systemd[1]: var-lib-kubelet-pods-59e86837\x2da461\x2d424b\x2d9048\x2d89c18b5af74d-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dnzrhw.mount: Deactivated successfully. machine # [ 220.427491] systemd[1]: var-lib-kubelet-pods-59e86837\x2da461\x2d424b\x2d9048\x2d89c18b5af74d-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 220.488091] k3s[893]: I0922 10:59:09.696606 893 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 220.488504] k3s[893]: I0922 10:59:09.696667 893 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/59e86837-a461-424b-9048-89c18b5af74d-job\") on node \"machine\" DevicePath \"\"" machine # [ 220.489103] k3s[893]: I0922 10:59:09.696688 893 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzrhw\" (UniqueName: \"kubernetes.io/projected/59e86837-a461-424b-9048-89c18b5af74d-kube-api-access-nzrhw\") on node \"machine\" DevicePath \"\"" machine # [ 221.049807] k3s[893]: I0922 10:59:10.258289 893 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d14a74d2246ec98a46885e81a9106c448df699faebe3ccaca844b43e119b293" machine # [ 221.065827] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod59e86837_a461_424b_9048_89c18b5af74d.slice. machine # [ 221.067742] systemd[1]: kubepods-besteffort-pod59e86837_a461_424b_9048_89c18b5af74d.slice: Consumed 1.150s CPU time over 46.005s wall clock time, 152.4M memory peak, 99.7M read from disk, 628K written to disk, 16.6K incoming IP traffic, 44.2K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 46.84 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.20 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmp782ewe6c/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (11s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath, in 0.26 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.08 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 48.38 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.37 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.60 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-27g6f -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 223.597541] k3s[893]: E0922 10:59:12.805729 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:43362: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-27g6f -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.31 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.08 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1 machine # [ 224.055776] niks3-server[1203]: 2026/09/22 10:59:13 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 224.075955] niks3-server[1203]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 224.080976] niks3-server[1203]: 2026/09/22 10:59:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 224.082665] niks3-server[1203]: 2026/09/22 10:59:13 INFO Signed narinfos id=21 count=1 machine # [ 224.086615] niks3-server[1203]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 224.090724] niks3-server[1203]: 2026/09/22 10:59:13 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 224.094127] niks3-server[1203]: 2026/09/22 10:59:13 INFO Completed upload id=21 machine # [ 224.096443] niks3-server[1203]: 2026/09/22 10:59:13 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 232.778247] niks3-server[1203]: 2026/09/22 10:59:21 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 232.793598] niks3-server[1203]: 2026/09/22 10:59:22 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 232.795232] niks3-server[1203]: 2026/09/22 10:59:22 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 232.801445] niks3-server[1203]: 2026/09/22 10:59:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 232.803510] niks3-server[1203]: 2026/09/22 10:59:22 INFO Signed narinfos id=22 count=1 machine # [ 232.805199] niks3-server[1203]: 2026/09/22 10:59:22 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 232.811320] niks3-server[1203]: 2026/09/22 10:59:22 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 232.814667] niks3-server[1203]: 2026/09/22 10:59:22 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 232.819918] niks3-server[1203]: 2026/09/22 10:59:22 INFO Completed upload id=22 machine # [ 232.906434] niks3-server[1203]: 2026/09/22 10:59:22 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 232.921861] niks3-server[1203]: 2026/09/22 10:59:22 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 232.925879] niks3-server[1203]: 2026/09/22 10:59:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 232.927141] niks3-server[1203]: 2026/09/22 10:59:22 INFO Signed narinfos id=23 count=1 machine # [ 232.932283] niks3-server[1203]: 2026/09/22 10:59:22 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 232.934579] niks3-server[1203]: 2026/09/22 10:59:22 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 232.936810] niks3-server[1203]: 2026/09/22 10:59:22 INFO Completed upload id=23 machine # [ 232.938191] niks3-server[1203]: 2026/09/22 10:59:22 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 241.618771] niks3-server[1203]: 2026/09/22 10:59:30 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 241.637130] niks3-server[1203]: 2026/09/22 10:59:30 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 241.639796] niks3-server[1203]: 2026/09/22 10:59:30 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 241.642293] niks3-server[1203]: 2026/09/22 10:59:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 241.644360] niks3-server[1203]: 2026/09/22 10:59:30 INFO Signed narinfos id=24 count=1 machine # [ 241.648061] niks3-server[1203]: 2026/09/22 10:59:30 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 241.654503] niks3-server[1203]: 2026/09/22 10:59:30 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 241.658029] niks3-server[1203]: 2026/09/22 10:59:30 INFO Completed upload id=24 machine # [ 241.660562] niks3-server[1203]: 2026/09/22 10:59:30 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 241.750395] niks3-server[1203]: 2026/09/22 10:59:30 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 241.762539] niks3-server[1203]: 2026/09/22 10:59:30 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 241.766241] niks3-server[1203]: 2026/09/22 10:59:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 241.768289] niks3-server[1203]: 2026/09/22 10:59:30 INFO Signed narinfos id=25 count=1 machine # [ 241.769543] niks3-server[1203]: 2026/09/22 10:59:30 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 241.774833] niks3-server[1203]: 2026/09/22 10:59:30 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 241.776699] niks3-server[1203]: 2026/09/22 10:59:30 INFO Completed upload id=25 machine # [ 241.780094] niks3-server[1203]: 2026/09/22 10:59:30 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 250.655948] niks3-server[1203]: 2026/09/22 10:59:39 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 250.669113] niks3-server[1203]: 2026/09/22 10:59:39 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 250.671159] niks3-server[1203]: 2026/09/22 10:59:39 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 250.673986] niks3-server[1203]: 2026/09/22 10:59:39 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 250.680674] niks3-server[1203]: 2026/09/22 10:59:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 250.684381] niks3-server[1203]: 2026/09/22 10:59:39 INFO Signed narinfos id=26 count=1 machine # [ 250.689507] niks3-server[1203]: 2026/09/22 10:59:39 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 250.693561] niks3-server[1203]: 2026/09/22 10:59:39 INFO Completed upload id=26 machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1, in 27.04 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 28.39 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.18 seconds) machine: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb"' machine: (finished: must succeed: curl -sf http://10.42.0.5:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb"', in 0.05 seconds) (finished: subtest: metrics carry build_info, in 0.24 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 251.185597] k3s[893]: E0922 10:59:40.393862 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34146: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.23 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 251.503058] k3s[893]: E0922 10:59:40.711529 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34172: use of closed network connection machine # [ 251.504098] k3s[893]: time="2026-09-22T10:59:40Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:45080->127.0.0.1:10250: read: connection reset by peer" machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.32 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc -- sh -c 'fallocate -l 11472781312 /nix/fill' machine # [ 251.851855] k3s[893]: E0922 10:59:41.060282 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:34194: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc -- sh -c 'fallocate -l 11472781312 /nix/fill', in 0.35 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc --since=30s | grep -q 'store paths deleted', in 5.30 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc -- sh -c 'rm /nix/fill' machine # [ 257.418102] k3s[893]: E0922 10:59:46.626281 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46802: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc -- sh -c 'rm /nix/fill', in 0.27 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.19 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine # [ 257.869462] k3s[893]: E0922 10:59:47.078011 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:46840: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.27 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 6.92 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1 machine # [ 257.907563] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: 1deb16edaa7e40c4a9e9f2818787ada4 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1, in 0.04 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 258.084165] nix[6892]: don't know how to build these paths: machine # [ 258.084977] nix[6892]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 258.105123] nix[6892]: copying 1 paths to '127.0.0.1:30051'... machine # [ 258.107251] nix[6892]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 258.177525] niks3-server[1203]: 2026/09/22 10:59:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 258.190656] niks3-server[1203]: 2026/09/22 10:59:47 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 258.196069] niks3-server[1203]: 2026/09/22 10:59:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 258.199718] niks3-server[1203]: 2026/09/22 10:59:47 INFO Signed narinfos id=27 count=1 machine # [ 258.200350] niks3-server[1203]: 2026/09/22 10:59:47 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 258.208199] niks3-server[1203]: 2026/09/22 10:59:47 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 258.210155] niks3-server[1203]: 2026/09/22 10:59:47 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.narinfo machine # [ 258.216995] niks3-server[1203]: 2026/09/22 10:59:47 INFO Completed upload id=27 machine # [ 258.225393] nix[6892]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 258.228038] nix[6892]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.09 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.30 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 259.342894] nix[6892]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 259.344869] nix[6892]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 259.373590] systemd[1]: cri-containerd-2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003.scope: Deactivated successfully. machine # [ 259.377578] systemd[1]: cri-containerd-2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003.scope: Consumed 1.502s CPU time over 3min 25.181s wall clock time, 38.5M memory peak, 17.4M read from disk, 427.9K incoming IP traffic, 410.5K outgoing IP traffic. machine # [ 259.414045] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003-rootfs.mount: Deactivated successfully. machine # [ 259.447641] systemd[1]: cri-containerd-0dc17c6ce5ba6ab66df248f11a615b5a8ef7ffc1ef6e8dcea8add5b9020c99b3.scope: Deactivated successfully. machine # [ 259.489131] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-0dc17c6ce5ba6ab66df248f11a615b5a8ef7ffc1ef6e8dcea8add5b9020c99b3-rootfs.mount: Deactivated successfully. machine # [ 259.521252] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-0dc17c6ce5ba6ab66df248f11a615b5a8ef7ffc1ef6e8dcea8add5b9020c99b3-shm.mount: Deactivated successfully. machine # [ 259.731162] cni0: port 3(vethcc4eb62d) entered disabled state machine # [ 259.578382] dhcpcd[2907]: vethcc4eb62d: carrier lost machine # [ 259.733289] vethcc4eb62d (unregistering): left allmulticast mode machine # [ 259.735084] vethcc4eb62d (unregistering): left promiscuous mode machine # [ 259.737043] cni0: port 3(vethcc4eb62d) entered disabled state machine # [ 259.603878] systemd[1]: run-netns-cni\x2daf515282\x2d54d6\x2d74ef\x2dba56\x2dc426267e44cb.mount: Deactivated successfully. machine # [ 259.635131] k3s[893]: I0922 10:59:48.843425 893 endpointslice_controller.go:361] "Error syncing endpoint slices for service, retrying" key="farm/nix-grpc-farm" err="EndpointSlice informer cache is out of date" machine # [ 259.649415] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod755c1e33_d8d3_42aa_904c_1d6a0e4cadec.slice. machine # [ 259.654244] dhcpcd[2907]: vethcc4eb62d: deleting route to 169.254.0.0/16 machine # [ 259.759321] dhcpcd[2907]: vethcc4eb62d: removing interface machine # [ 259.778502] k3s[893]: I0922 10:59:48.987060 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e1114d6b-be4c-4e82-b87a-dd544787c9db-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1114d6b-be4c-4e82-b87a-dd544787c9db-tmp\") pod \"e1114d6b-be4c-4e82-b87a-dd544787c9db\" (UID: \"e1114d6b-be4c-4e82-b87a-dd544787c9db\") " machine # [ 259.779404] k3s[893]: I0922 10:59:48.987124 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-lb\" (UniqueName: \"kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-lb\") pod \"e1114d6b-be4c-4e82-b87a-dd544787c9db\" (UID: \"e1114d6b-be4c-4e82-b87a-dd544787c9db\") " machine # [ 259.779685] k3s[893]: I0922 10:59:48.987160 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-ca\" (UniqueName: \"kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-ca\") pod \"e1114d6b-be4c-4e82-b87a-dd544787c9db\" (UID: \"e1114d6b-be4c-4e82-b87a-dd544787c9db\") " machine # [ 259.780508] k3s[893]: I0922 10:59:48.987195 893 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e1114d6b-be4c-4e82-b87a-dd544787c9db-config\" (UniqueName: \"kubernetes.io/configmap/e1114d6b-be4c-4e82-b87a-dd544787c9db-config\") pod \"e1114d6b-be4c-4e82-b87a-dd544787c9db\" (UID: \"e1114d6b-be4c-4e82-b87a-dd544787c9db\") " machine # [ 259.781167] k3s[893]: I0922 10:59:48.987245 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/755c1e33-d8d3-42aa-904c-1d6a0e4cadec-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-8v7hf\" (UID: \"755c1e33-d8d3-42aa-904c-1d6a0e4cadec\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-8v7hf" machine # [ 259.781506] k3s[893]: I0922 10:59:48.987283 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/755c1e33-d8d3-42aa-904c-1d6a0e4cadec-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-8v7hf\" (UID: \"755c1e33-d8d3-42aa-904c-1d6a0e4cadec\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-8v7hf" machine # [ 259.782708] k3s[893]: I0922 10:59:48.987309 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/755c1e33-d8d3-42aa-904c-1d6a0e4cadec-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-8v7hf\" (UID: \"755c1e33-d8d3-42aa-904c-1d6a0e4cadec\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-8v7hf" machine # [ 259.783237] k3s[893]: I0922 10:59:48.987336 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/755c1e33-d8d3-42aa-904c-1d6a0e4cadec-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-8v7hf\" (UID: \"755c1e33-d8d3-42aa-904c-1d6a0e4cadec\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-8v7hf" machine # [ 259.795098] systemd[1]: var-lib-kubelet-pods-e1114d6b\x2dbe4c\x2d4e82\x2db87a\x2ddd544787c9db-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 259.795880] systemd[1]: var-lib-kubelet-pods-e1114d6b\x2dbe4c\x2d4e82\x2db87a\x2ddd544787c9db-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 259.823789] k3s[893]: I0922 10:59:49.032328 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1114d6b-be4c-4e82-b87a-dd544787c9db-tmp" pod "e1114d6b-be4c-4e82-b87a-dd544787c9db" (UID: "e1114d6b-be4c-4e82-b87a-dd544787c9db"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 259.825160] k3s[893]: I0922 10:59:49.032559 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-ca" pod "e1114d6b-be4c-4e82-b87a-dd544787c9db" (UID: "e1114d6b-be4c-4e82-b87a-dd544787c9db"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 259.835567] k3s[893]: I0922 10:59:49.044145 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-lb" pod "e1114d6b-be4c-4e82-b87a-dd544787c9db" (UID: "e1114d6b-be4c-4e82-b87a-dd544787c9db"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 259.853041] k3s[893]: I0922 10:59:49.061564 893 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1114d6b-be4c-4e82-b87a-dd544787c9db-config" pod "e1114d6b-be4c-4e82-b87a-dd544787c9db" (UID: "e1114d6b-be4c-4e82-b87a-dd544787c9db"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 259.879818] k3s[893]: I0922 10:59:49.088320 893 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1114d6b-be4c-4e82-b87a-dd544787c9db-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 259.880448] k3s[893]: I0922 10:59:49.088356 893 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 259.881088] k3s[893]: I0922 10:59:49.088370 893 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/e1114d6b-be4c-4e82-b87a-dd544787c9db-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 259.881911] k3s[893]: I0922 10:59:49.088383 893 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1114d6b-be4c-4e82-b87a-dd544787c9db-config\") on node \"machine\" DevicePath \"\"" machine # [ 260.136081] cni0: port 2(vethe07af875) entered blocking state machine # [ 260.137875] cni0: port 2(vethe07af875) entered disabled state machine # [ 260.139278] vethe07af875: entered allmulticast mode machine # [ 260.140765] vethe07af875: entered promiscuous mode machine # [ 259.990314] (udev-worker)[7076]: Network interface NamePolicy= disabled on kernel command line. machine # [ 260.152471] cni0: port 2(vethe07af875) entered blocking state machine # [ 260.153448] cni0: port 2(vethe07af875) entered forwarding state machine # [ 260.032520] dhcpcd[2907]: vethe07af875: IAID a1:f9:10:04 machine # [ 260.033437] dhcpcd[2907]: vethe07af875: adding address fe80::8cf3:a1ff:fef9:1004 machine # [ 260.092432] systemd[1]: Started libcontainer container 9346b593c8c11c51ed624d050d395f7e060c62094b57f886d53ab55dd135e147. machine # [ 260.188794] k3s[893]: I0922 10:59:49.397298 893 scope.go:122] "RemoveContainer" containerID="2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003" machine # [ 260.198711] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pode1114d6b_be4c_4e82_b87a_dd544787c9db.slice. machine # [ 260.199649] systemd[1]: kubepods-besteffort-pode1114d6b_be4c_4e82_b87a_dd544787c9db.slice: Consumed 1.532s CPU time over 3min 27.453s wall clock time, 38.8M memory peak, 17.4M read from disk, 427.9K incoming IP traffic, 410.5K outgoing IP traffic. machine # [ 260.202623] k3s[893]: I0922 10:59:49.410637 893 scope.go:122] "RemoveContainer" containerID="2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003" machine # [ 260.203571] k3s[893]: E0922 10:59:49.411567 893 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003\": not found" containerID="2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003" machine # [ 260.204582] k3s[893]: I0922 10:59:49.411599 893 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003"} err="failed to get container status \"2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003\": rpc error: code = NotFound desc = an error occurred when try to find container \"2a1cc433e40936f6d9f8bd95b1ebe448ec4599490983c3dd016e95409849f003\": not found" machine # [ 260.244290] systemd[1]: Started libcontainer container e9852b9aa1553010ed80cfde774cddd90caaae8fd4e60e89690c0cdca08d34e2. machine # [ 260.365448] k3s[893]: I0922 10:59:49.573981 893 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e1114d6b-be4c-4e82-b87a-dd544787c9db" path="/var/lib/kubelet/pods/e1114d6b-be4c-4e82-b87a-dd544787c9db/volumes" machine # [ 260.424177] systemd[1]: var-lib-kubelet-pods-e1114d6b\x2dbe4c\x2d4e82\x2db87a\x2ddd544787c9db-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 260.424888] systemd[1]: var-lib-kubelet-pods-e1114d6b\x2dbe4c\x2d4e82\x2db87a\x2ddd544787c9db-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 260.425514] systemd[1]: var-lib-kubelet-pods-e1114d6b\x2dbe4c\x2d4e82\x2db87a\x2ddd544787c9db-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 260.426216] systemd[1]: var-lib-kubelet-pods-e1114d6b\x2dbe4c\x2d4e82\x2db87a\x2ddd544787c9db-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 261.223735] k3s[893]: I0922 10:59:50.431517 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-8v7hf" podStartSLOduration=2.431479251 podStartE2EDuration="2.431479251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:59:50.43013327 +0000 UTC m=+241.179897139" watchObservedRunningTime="2026-09-22 10:59:50.431479251 +0000 UTC m=+241.181242562" machine # [ 261.525616] dhcpcd[2907]: vethe07af875: soliciting a DHCP lease machine # [ 261.848330] nix[6892]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 262.021799] dhcpcd[2907]: vethe07af875: soliciting an IPv6 router machine # [ 262.892144] nix[6892]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 262.894604] nix[6892]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-665fb: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 266.526135] dhcpcd[2907]: vethe07af875: probing for an IPv4LL address machine # [ 271.335797] dhcpcd[2907]: vethe07af875: using IPv4LL address 169.254.47.120 machine # [ 271.339343] dhcpcd[2907]: vethe07af875: adding route to 169.254.0.0/16 machine # [ 274.026891] dhcpcd[2907]: vethe07af875: no IPv6 Routers available machine # [ 291.579469] niks3-server[1203]: 2026/09/22 11:00:20 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 291.597926] niks3-server[1203]: 2026/09/22 11:00:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 291.599654] niks3-server[1203]: 2026/09/22 11:00:20 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 291.601818] niks3-server[1203]: 2026/09/22 11:00:20 INFO Signed narinfos id=28 count=1 machine # [ 291.604400] niks3-server[1203]: 2026/09/22 11:00:20 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 291.611924] niks3-server[1203]: 2026/09/22 11:00:20 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 291.615964] niks3-server[1203]: 2026/09/22 11:00:20 INFO Completed upload id=28 machine # [ 291.617299] niks3-server[1203]: 2026/09/22 11:00:20 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 292.689858] systemd[1]: vialb.service: Deactivated successfully. machine # [ 292.691249] systemd[1]: vialb.service: Consumed 172ms CPU time over 34.782s wall clock time, 40.6M memory peak, 4K written to disk, 7.8K incoming IP traffic, 17K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 33.68 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.05 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.31 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 35.47 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 machine # [ 293.382637] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 4ffd1d7bdc8048dfb5fe275d6c1bdb4b machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1, in 0.04 seconds) machine # [ 293.582282] nix[7750]: don't know how to build these paths: machine # [ 293.583106] nix[7750]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 293.602954] nix[7750]: copying 1 paths to '127.0.0.1:30051'... machine # [ 293.604288] nix[7750]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # command terminated with exit code 1 machine # [ 293.638450] k3s[893]: E0922 11:00:22.846411 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38548: use of closed network connection machine # [ 293.666754] niks3-server[1203]: 2026/09/22 11:00:22 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 293.678286] niks3-server[1203]: 2026/09/22 11:00:22 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 293.680741] niks3-server[1203]: 2026/09/22 11:00:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 293.683189] niks3-server[1203]: 2026/09/22 11:00:22 INFO Signed narinfos id=29 count=1 machine # [ 293.684112] niks3-server[1203]: 2026/09/22 11:00:22 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 293.689917] niks3-server[1203]: 2026/09/22 11:00:22 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 293.691301] niks3-server[1203]: 2026/09/22 11:00:22 INFO Completed upload id=29 machine # [ 293.699284] nix[7750]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 293.700743] nix[7750]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 293.916782] k3s[893]: E0922 11:00:23.125269 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38582: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 295.205665] k3s[893]: E0922 11:00:24.413146 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38604: use of closed network connection machine # [ 295.456832] k3s[893]: E0922 11:00:24.665276 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38620: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 297.025072] k3s[893]: E0922 11:00:26.233297 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38678: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 298.413822] k3s[893]: E0922 11:00:27.621710 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38712: use of closed network connection machine # [ 298.716742] k3s[893]: E0922 11:00:27.925308 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38752: use of closed network connection machine # command terminated with exit code 1 machine # [ 300.009655] k3s[893]: E0922 11:00:29.217907 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38774: use of closed network connection machine # command terminated with exit code 1 machine # [ 300.259681] k3s[893]: E0922 11:00:29.468100 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38806: use of closed network connection machine # command terminated with exit code 1 machine # [ 301.605274] k3s[893]: E0922 11:00:30.813504 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38836: use of closed network connection machine # command terminated with exit code 1 machine # [ 301.881225] k3s[893]: time="2026-09-22T11:00:31Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:57478->127.0.0.1:10250: write: broken pipe" machine # command terminated with exit code 1 machine # [ 301.885628] k3s[893]: E0922 11:00:31.089628 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38858: use of closed network connection machine # command terminated with exit code 1 machine # [ 303.241889] k3s[893]: E0922 11:00:32.450003 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38196: use of closed network connection machine # [ 303.495933] k3s[893]: E0922 11:00:32.704422 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38242: use of closed network connection machine # [ 303.759307] k3s[893]: E0922 11:00:32.967777 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38270: use of closed network connection machine # command terminated with exit code 1 machine # [ 303.990522] k3s[893]: E0922 11:00:33.198955 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38306: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-jnnsg --wait=false, in 0.20 seconds) machine: must succeed: sleep 5.0 machine # [ 304.222062] systemd[1]: cri-containerd-3bcfd5dbfcfc70c371b809fa93d334539b8e5f81b3df9fd37d15193e00a06a2f.scope: Deactivated successfully. machine # [ 304.225378] systemd[1]: cri-containerd-3bcfd5dbfcfc70c371b809fa93d334539b8e5f81b3df9fd37d15193e00a06a2f.scope: Consumed 243ms CPU time over 3min 47.998s wall clock time, 12.4M memory peak, 5.1M read from disk. machine # [ 304.269760] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-3bcfd5dbfcfc70c371b809fa93d334539b8e5f81b3df9fd37d15193e00a06a2f-rootfs.mount: Deactivated successfully. machine # [ 304.284587] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod90d6b855_e445_4721_8567_f67f518d019d.slice. machine # [ 304.413697] k3s[893]: I0922 11:00:33.621915 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/90d6b855-e445-4721-8567-f67f518d019d-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw\" (UID: \"90d6b855-e445-4721-8567-f67f518d019d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw" machine # [ 304.418536] k3s[893]: I0922 11:00:33.622005 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/90d6b855-e445-4721-8567-f67f518d019d-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw\" (UID: \"90d6b855-e445-4721-8567-f67f518d019d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw" machine # [ 304.423215] k3s[893]: I0922 11:00:33.622064 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/90d6b855-e445-4721-8567-f67f518d019d-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw\" (UID: \"90d6b855-e445-4721-8567-f67f518d019d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw" machine # [ 304.427417] k3s[893]: I0922 11:00:33.622112 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/90d6b855-e445-4721-8567-f67f518d019d-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw\" (UID: \"90d6b855-e445-4721-8567-f67f518d019d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw" machine # [ 304.431565] k3s[893]: I0922 11:00:33.622171 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vs7q\" (UniqueName: \"kubernetes.io/projected/90d6b855-e445-4721-8567-f67f518d019d-kube-api-access-7vs7q\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw\" (UID: \"90d6b855-e445-4721-8567-f67f518d019d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw" machine # [ 304.436087] k3s[893]: I0922 11:00:33.622228 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/90d6b855-e445-4721-8567-f67f518d019d-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw\" (UID: \"90d6b855-e445-4721-8567-f67f518d019d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw" machine # [ 304.440580] k3s[893]: I0922 11:00:33.622280 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/90d6b855-e445-4721-8567-f67f518d019d-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw\" (UID: \"90d6b855-e445-4721-8567-f67f518d019d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw" machine # [ 304.445942] k3s[893]: I0922 11:00:33.622338 893 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/90d6b855-e445-4721-8567-f67f518d019d-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw\" (UID: \"90d6b855-e445-4721-8567-f67f518d019d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw" machine # [ 304.778977] cni0: port 3(veth93383aa3) entered blocking state machine # [ 304.780542] cni0: port 3(veth93383aa3) entered disabled state machine # [ 304.781950] veth93383aa3: entered allmulticast mode machine # [ 304.783148] veth93383aa3: entered promiscuous mode machine # [ 304.794301] cni0: port 3(veth93383aa3) entered blocking state machine # [ 304.795917] cni0: port 3(veth93383aa3) entered forwarding state machine # [ 304.703208] (udev-worker)[8574]: Network interface NamePolicy= disabled on kernel command line. machine # [ 304.752315] dhcpcd[2907]: veth93383aa3: IAID 14:1d:df:e6 machine # [ 304.753497] dhcpcd[2907]: veth93383aa3: adding address fe80::387c:14ff:fe1d:dfe6 machine # [ 304.755259] systemd[1]: Started libcontainer container 4baddee12ecf29faffd89d17411eed2095a49c4032a012463ba7d05c7a10bc28. machine # [ 304.993345] systemd[1]: Started libcontainer container 287ca65bdd9de9c8bf7c12fc908c3bc8e003ef6e4a5de1895a3f8a3bd41c93ac. machine # [ 306.330894] dhcpcd[2907]: veth93383aa3: soliciting a DHCP lease machine # [ 306.717129] systemd[1]: cri-containerd-287ca65bdd9de9c8bf7c12fc908c3bc8e003ef6e4a5de1895a3f8a3bd41c93ac.scope: Deactivated successfully. machine # [ 306.718430] systemd[1]: cri-containerd-287ca65bdd9de9c8bf7c12fc908c3bc8e003ef6e4a5de1895a3f8a3bd41c93ac.scope: Consumed 786ms CPU time over 1.722s wall clock time, 490.7M memory peak, 200.1M read from disk, 146.4M written to disk. machine # [ 306.791288] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-287ca65bdd9de9c8bf7c12fc908c3bc8e003ef6e4a5de1895a3f8a3bd41c93ac-rootfs.mount: Deactivated successfully. machine # [ 306.992379] dhcpcd[2907]: veth93383aa3: soliciting an IPv6 router machine # [ 307.483597] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount135312521.mount: Deactivated successfully. machine # [ 307.490725] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped498278730.mount: Deactivated successfully. machine # [ 307.559303] systemd[1]: Started libcontainer container f453ba2b9f9f878db648d6d534c4de65d5c152cbb17f155f01dd0a6f0a3854f6. machine # [ 307.790790] systemd[1]: Started libcontainer container bc7b9ea39dd38920763e02a70429953f3d4588b4553d4ed6b93409413c46e09f. machine # [ 307.907335] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2802943864.mount: Deactivated successfully. machine # [ 308.038580] systemd[1]: Started libcontainer container 00cf41697191257c2837d70c91551090ac9b41db20f285a9f36f9f95251a17b1. machine # [ 308.794917] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3421039318.mount: Deactivated successfully. machine # [ 308.799292] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3774023393.mount: Deactivated successfully. machine: (finished: must succeed: sleep 5.0, in 5.04 seconds) machine # command terminated with exit code 1 machine # [ 309.607966] k3s[893]: I0922 11:00:38.816203 893 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-r2fvw" podStartSLOduration=4.126873213 podStartE2EDuration="5.816181211s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.689307998s" isStatefulPod=false podCreationTimestamp="2026-09-22 11:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 11:00:37.623549466 +0000 UTC m=+288.373312778" watchObservedRunningTime="2026-09-22 11:00:38.816181211 +0000 UTC m=+289.565939773" machine # [ 309.801394] k3s[893]: E0922 11:00:39.009876 893 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:37262->127.0.0.1:10010: write tcp 127.0.0.1:37262->127.0.0.1:10010: write: broken pipe machine # [ 309.806295] k3s[893]: time="2026-09-22T11:00:39Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:53372->127.0.0.1:10250: read: connection reset by peer" machine # [ 309.808713] k3s[893]: E0922 11:00:39.010364 893 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38378: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 311.332499] dhcpcd[2907]: veth93383aa3: probing for an IPv4LL address machine # [ 312.080233] postgres[773]: [773] LOG: checkpoint starting: time machine # [ 315.981807] dhcpcd[2907]: veth93383aa3: using IPv4LL address 169.254.29.250 machine # [ 315.983379] dhcpcd[2907]: veth93383aa3: adding route to 169.254.0.0/16 machine # [ 318.996332] dhcpcd[2907]: veth93383aa3: no IPv6 Routers available machine # [ 322.378188] niks3-server[1203]: 2026/09/22 11:00:51 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 322.389229] niks3-server[1203]: 2026/09/22 11:00:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 322.390857] niks3-server[1203]: 2026/09/22 11:00:51 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 322.392113] niks3-server[1203]: 2026/09/22 11:00:51 INFO Signed narinfos id=30 count=1 machine # [ 322.395605] niks3-server[1203]: 2026/09/22 11:00:51 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 322.398808] niks3-server[1203]: 2026/09/22 11:00:51 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 322.400810] niks3-server[1203]: 2026/09/22 11:00:51 INFO Completed upload id=30 machine # [ 322.405078] niks3-server[1203]: 2026/09/22 11:00:51 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 323.470672] systemd[1]: slow.service: Deactivated successfully. machine # [ 323.473078] systemd[1]: slow.service: Consumed 138ms CPU time over 30.087s wall clock time, 38.2M memory peak, 4K written to disk, 4.6K incoming IP traffic, 11.4K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 13.72 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.05 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.04 seconds) machine: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath, in 0.29 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.08 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 30.64 seconds) (finished: run the VM test script, in 325.13 seconds) test script finished in 325.19s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.05 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh