tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 1200.0 seconds run the VM test script machine: waiting for unit k3s.service machine: waiting for the VM to finish booting machine: starting vm machine: QEMU running (pid 45) machine # Disk image does not exist, creating the virtualisation disk image... machine # Formatting '/build/vm-state-machine/tmp.wXxSNdsmtP', fmt=raw size=17179869184 machine # mke2fs 1.47.4 (6-Mar-2025) machine # Discarding device blocks: 0/4194304 done machine # Creating filesystem with 4194304 4k blocks and 1048576 inodes machine # Filesystem UUID: 99b0fcc0-bff8-4fd4-9bf0-af85ec662256 machine # Superblock backups stored on blocks: machine # 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, machine # 4096000 machine # machine # Allocating group tables: 0/128 done machine # Writing inode tables: 0/128 done machine # Creating journal (32768 blocks): done machine # Writing superblocks and filesystem accounting information: 0/128 done machine # machine # Virtualisation disk image created. machine # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) machine # machine # machine # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+7EFCC730+7EF2C730 CA00 machine # Press Ctrl-B to configure iPXE (PCI 00:02.0)... machine # machine # machine # machine # machine # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 7EFCC730 7EF2C730 CB00 machine # Press Ctrl-B to configure iPXE (PCI 00:08.0)... machine # machine # machine # Booting from ROM... machine # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026 machine # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/339f4gxz5zllas84pw22l61dagczgvc0-nixos-system-machine-test/init regInfo=/nix/store/8kawr855j0m27qkzy0nm6hh44630vfxz-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.000000] BIOS-provided physical RAM map: machine # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffd7fff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000007ffd8000-0x000000007fffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved machine # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable machine # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved machine # [ 0.000000] NX (Execute Disable) protection: active machine # [ 0.000000] APIC: Static calls initialized machine # [ 0.000000] SMBIOS 2.8 present. machine # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 machine # [ 0.000000] DMI: Memory slots populated: 1/1 machine # [ 0.000000] Hypervisor detected: KVM machine # [ 0.000000] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 machine # [ 0.000000] kvm-clock: using sched offset of 474330130 cycles machine # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns machine # [ 0.000004] tsc: Detected 2400.012 MHz processor machine # [ 0.000814] last_pfn = 0x180000 max_arch_pfn = 0x10000000000 machine # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs machine # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT machine # [ 0.000882] last_pfn = 0x7ffd8 max_arch_pfn = 0x10000000000 machine # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f] machine # [ 0.002749] Using GB pages for direct mapping machine # [ 0.002865] RAMDISK: [mem 0x7e367000-0x7ffcffff] machine # [ 0.002873] ACPI: Early table checksum verification disabled machine # [ 0.002876] ACPI: RSDP 0x00000000000F5250 000014 (v00 BOCHS ) machine # [ 0.002880] ACPI: RSDT 0x000000007FFE2539 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002884] ACPI: FACP 0x000000007FFE2319 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002890] ACPI: DSDT 0x000000007FFE0040 0022D9 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002892] ACPI: FACS 0x000000007FFE0000 000040 machine # [ 0.002894] ACPI: APIC 0x000000007FFE240D 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002895] ACPI: HPET 0x000000007FFE249D 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002897] ACPI: MCFG 0x000000007FFE24D5 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002898] ACPI: WAET 0x000000007FFE2511 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) machine # [ 0.002900] ACPI: Reserving FACP table memory at [mem 0x7ffe2319-0x7ffe240c] machine # [ 0.002901] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe2318] machine # [ 0.002901] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f] machine # [ 0.002902] ACPI: Reserving APIC table memory at [mem 0x7ffe240d-0x7ffe249c] machine # [ 0.002902] ACPI: Reserving HPET table memory at [mem 0x7ffe249d-0x7ffe24d4] machine # [ 0.002903] ACPI: Reserving MCFG table memory at [mem 0x7ffe24d5-0x7ffe2510] machine # [ 0.002903] ACPI: Reserving WAET table memory at [mem 0x7ffe2511-0x7ffe2538] machine # [ 0.003132] No NUMA configuration found machine # [ 0.003133] Faking a node at [mem 0x0000000000000000-0x000000017fffffff] machine # [ 0.003135] NODE_DATA(0) allocated [mem 0x17fffa780-0x17ffffcff] machine # [ 0.005437] Zone ranges: machine # [ 0.005438] DMA [mem 0x0000000000001000-0x0000000000ffffff] machine # [ 0.005439] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] machine # [ 0.005441] Normal [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005442] Device empty machine # [ 0.005442] Movable zone start for each node machine # [ 0.005443] Early memory node ranges machine # [ 0.005443] node 0: [mem 0x0000000000001000-0x000000000009efff] machine # [ 0.005444] node 0: [mem 0x0000000000100000-0x000000007ffd7fff] machine # [ 0.005445] node 0: [mem 0x0000000100000000-0x000000017fffffff] machine # [ 0.005446] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff] machine # [ 0.005466] On node 0, zone DMA: 1 pages in unavailable ranges machine # [ 0.005743] On node 0, zone DMA: 97 pages in unavailable ranges machine # [ 0.078414] On node 0, zone Normal: 40 pages in unavailable ranges machine # [ 0.078887] ACPI: PM-Timer IO Port: 0x608 machine # [ 0.078901] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) machine # [ 0.078933] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 machine # [ 0.078935] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) machine # [ 0.078937] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) machine # [ 0.078938] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) machine # [ 0.078939] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) machine # [ 0.078940] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) machine # [ 0.078942] ACPI: Using ACPI (MADT) for SMP configuration information machine # [ 0.078943] ACPI: HPET id: 0x8086a201 base: 0xfed00000 machine # [ 0.078949] TSC deadline timer available machine # [ 0.078953] CPU topo: Max. logical packages: 1 machine # [ 0.078954] CPU topo: Max. logical dies: 1 machine # [ 0.078955] CPU topo: Max. dies per package: 1 machine # [ 0.078958] CPU topo: Max. threads per core: 1 machine # [ 0.078959] CPU topo: Num. cores per package: 4 machine # [ 0.078959] CPU topo: Num. threads per package: 4 machine # [ 0.078959] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs machine # [ 0.078982] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() machine # [ 0.078999] kvm-guest: KVM setup pv remote TLB flush machine # [ 0.079001] kvm-guest: setup PV sched yield machine # [ 0.079011] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] machine # [ 0.079012] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] machine # [ 0.079013] PM: hibernation: Registered nosave memory: [mem 0x7ffd8000-0xffffffff] machine # [ 0.079015] [mem 0xc0000000-0xfed1bfff] available for PCI devices machine # [ 0.079016] Booting paravirtualized kernel on KVM machine # [ 0.079019] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns machine # [ 0.083480] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 machine # [ 0.085694] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 machine # [ 0.085749] kvm-guest: PV spinlocks enabled machine # [ 0.085751] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) machine # [ 0.085754] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/339f4gxz5zllas84pw22l61dagczgvc0-nixos-system-machine-test/init regInfo=/nix/store/8kawr855j0m27qkzy0nm6hh44630vfxz-closure-info/registration console=ttyS0,115200n8 console=tty0 machine # [ 0.085850] Unknown kernel command line parameters "regInfo=/nix/store/8kawr855j0m27qkzy0nm6hh44630vfxz-closure-info/registration", will be passed to user space. machine # [ 0.085863] random: crng init done machine # [ 0.085864] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes machine # [ 0.090443] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) machine # [ 0.092606] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) machine # [ 0.092679] software IO TLB: area num 4. machine # [ 0.172627] Fallback order for Node 0: 0 machine # [ 0.172640] Built 1 zonelists, mobility grouping on. Total pages: 1048438 machine # [ 0.172643] Policy zone: Normal machine # [ 0.175353] mem auto-init: stack:all(zero), heap alloc:on, heap free:off machine # [ 0.185319] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 machine # [ 0.195054] allocated 8388608 bytes of page_ext machine # [ 0.209822] ftrace: allocating 48731 entries in 192 pages machine # [ 0.209825] ftrace: allocated 192 pages with 2 groups machine # [ 0.210831] Dynamic Preempt: lazy machine # [ 0.211044] rcu: Preemptible hierarchical RCU implementation. machine # [ 0.211045] rcu: RCU event tracing is enabled. machine # [ 0.211046] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. machine # [ 0.211047] Trampoline variant of Tasks RCU enabled. machine # [ 0.211048] Rude variant of Tasks RCU enabled. machine # [ 0.211048] Tracing variant of Tasks RCU enabled. machine # [ 0.211049] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. machine # [ 0.211050] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 machine # [ 0.211074] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.211077] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.211078] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. machine # [ 0.215733] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 machine # [ 0.216039] rcu: srcu_init: Setting srcu_struct sizes based on contention. machine # [ 0.216047] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns machine # [ 0.216178] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) machine # [ 0.219774] Console: colour VGA+ 80x25 machine # [ 0.219778] printk: legacy console [tty0] enabled machine # [ 0.251297] printk: legacy console [ttyS0] enabled machine # [ 0.358942] ACPI: Core revision 20250807 machine # [ 0.359860] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns machine # [ 0.361414] APIC: Switch to symmetric I/O mode setup machine # [ 0.362380] x2apic enabled machine # [ 0.363185] APIC: Switched APIC routing to: physical x2apic machine # [ 0.364111] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() machine # [ 0.365350] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() machine # [ 0.366894] kvm-guest: setup PV IPIs machine # [ 0.368509] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 machine # [ 0.369548] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.373926] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012) machine # [ 0.375954] x86/cpu: User Mode Instruction Prevention (UMIP) activated machine # [ 0.377126] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 machine # [ 0.377931] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 machine # [ 0.378927] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto machine # [ 0.379922] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl machine # [ 0.381922] Transient Scheduler Attacks: Vulnerable: No microcode machine # [ 0.382922] Spectre V2 : Mitigation: Enhanced / Automatic IBRS machine # [ 0.383922] Speculative Return Stack Overflow: Mitigation: Safe RET machine # [ 0.384922] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization machine # [ 0.386932] Spectre V2 : Enabling IBPB for BPF machine # [ 0.387682] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier machine # [ 0.388923] active return thunk: srso_alias_return_thunk machine # [ 0.389953] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' machine # [ 0.390921] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' machine # [ 0.391921] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' machine # [ 0.392921] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' machine # [ 0.393921] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' machine # [ 0.394921] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' machine # [ 0.396745] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' machine # [ 0.397922] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 machine # [ 0.398922] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 machine # [ 0.399921] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 machine # [ 0.400921] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 machine # [ 0.401922] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 machine # [ 0.402929] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. machine # [ 0.439141] Freeing SMP alternatives memory: 44K machine # [ 0.439920] pid_max: default: 32768 minimum: 301 machine # [ 0.440616] LSM: initializing lsm=capability,landlock,yama,bpf,ima machine # [ 0.442074] landlock: Up and running. machine # [ 0.442710] Yama: becoming mindful. machine # [ 0.443621] LSM support for eBPF active machine # [ 0.444113] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.445004] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear) machine # [ 0.448520] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) machine # [ 0.449531] Performance Events: Fam17h+ core perfctr, AMD PMU driver. machine # [ 0.449926] ... version: 2 machine # [ 0.450648] ... bit width: 48 machine # [ 0.450924] ... generic counters: 6 machine # [ 0.451648] ... generic bitmap: 000000000000003f machine # [ 0.451936] ... fixed-purpose counters: 0 machine # [ 0.452659] ... fixed-purpose bitmap: 0000000000000000 machine # [ 0.452924] ... value mask: 0000ffffffffffff machine # [ 0.453924] ... max period: 00007fffffffffff machine # [ 0.454849] ... global_ctrl mask: 000000000000003f machine # [ 0.455805] signal: max sigframe size: 3376 machine # [ 0.456562] rcu: Hierarchical SRCU implementation. machine # [ 0.456928] rcu: Max phase no-delay instances is 400. machine # [ 0.458047] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level machine # [ 0.463826] smp: Bringing up secondary CPUs ... machine # [ 0.464928] smpboot: x86: Booting SMP configuration: machine # [ 0.465747] .... node #0, CPUs: #1 #2 #3 machine # [ 0.469025] smp: Brought up 1 node, 4 CPUs machine # [ 0.470655] smpboot: Total of 4 processors activated (19200.09 BogoMIPS) machine # [ 0.471264] Memory: 3957584K/4193752K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 220888K reserved, 0K cma-reserved) machine # [ 0.473925] devtmpfs: initialized machine # [ 0.475216] x86/mm: Memory block size: 128MB machine # [ 0.478134] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.479961] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). machine # [ 0.481039] pinctrl core: initialized pinctrl subsystem machine # [ 0.482180] PM: RTC time: 10:44:20, date: 2026-09-22 machine # [ 0.485997] NET: Registered PF_NETLINK/PF_ROUTE protocol family machine # [ 0.487781] DMA: preallocated 512 KiB GFP_KERNEL pool for atomic allocations machine # [ 0.488894] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations machine # [ 0.490813] DMA: preallocated 512 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations machine # [ 0.491938] audit: initializing netlink subsys (disabled) machine # [ 0.492988] audit: type=2000 audit(1790073861.737:1): state=initialized audit_enabled=0 res=1 machine # [ 0.493270] thermal_sys: Registered thermal governor 'fair_share' machine # [ 0.494926] thermal_sys: Registered thermal governor 'bang_bang' machine # [ 0.495924] thermal_sys: Registered thermal governor 'step_wise' machine # [ 0.496909] thermal_sys: Registered thermal governor 'user_space' machine # [ 0.497692] thermal_sys: Registered thermal governor 'power_allocator' machine # [ 0.497942] cpuidle: using governor menu machine # [ 0.500162] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 machine # [ 0.501185] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] machine # [ 0.501929] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry machine # [ 0.502940] PCI: Using configuration type 1 for base access machine # [ 0.504017] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. machine # [ 0.505988] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages machine # [ 0.506926] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page machine # [ 0.507925] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages machine # [ 0.508924] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page machine # [ 0.514647] ACPI: Added _OSI(Module Device) machine # [ 0.515931] ACPI: Added _OSI(Processor Device) machine # [ 0.517930] ACPI: Added _OSI(Processor Aggregator Device) machine # [ 0.526672] ACPI: 1 ACPI AML tables successfully acquired and loaded machine # [ 0.534280] ACPI: Interpreter enabled machine # [ 0.534969] ACPI: PM: (supports S0 S3 S4 S5) machine # [ 0.535729] ACPI: Using IOAPIC for interrupt routing machine # [ 0.536662] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug machine # [ 0.537936] PCI: Using E820 reservations for host bridge windows machine # [ 0.540893] ACPI: Enabled 2 GPEs in block 00 to 3F machine # [ 0.554206] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) machine # [ 0.556983] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] machine # [ 0.561226] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] machine # [ 0.564243] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] machine # [ 0.567985] PCI host bridge to bus 0000:00 machine # [ 0.569939] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] machine # [ 0.571931] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] machine # [ 0.574928] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] machine # [ 0.576929] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window] machine # [ 0.579928] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] machine # [ 0.581938] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.584929] pci_bus 0000:00: root bus resource [bus 00-ff] machine # [ 0.587397] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint machine # [ 0.590898] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint machine # [ 0.607012] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] machine # [ 0.609007] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] machine # [ 0.609954] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] machine # [ 0.611412] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] machine # [ 0.614130] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.618963] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f] machine # [ 0.619849] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] machine # [ 0.620727] pci 0000:00:02.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] machine # [ 0.621932] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] machine # [ 0.623981] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.628960] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] machine # [ 0.629933] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] machine # [ 0.630948] pci 0000:00:03.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] machine # [ 0.632547] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.637961] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf] machine # [ 0.638931] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] machine # [ 0.639948] pci 0000:00:04.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] machine # [ 0.642518] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.645962] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f] machine # [ 0.646888] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] machine # [ 0.648730] pci 0000:00:05.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] machine # [ 0.650512] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint machine # [ 0.653740] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf] machine # [ 0.654707] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] machine # [ 0.655725] pci 0000:00:06.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] machine # [ 0.659054] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint machine # [ 0.662965] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] machine # [ 0.663870] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] machine # [ 0.664787] pci 0000:00:07.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] machine # [ 0.666784] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint machine # [ 0.685935] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df] machine # [ 0.686892] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] machine # [ 0.687752] pci 0000:00:08.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] machine # [ 0.688930] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref] machine # [ 0.690547] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint machine # [ 0.694580] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] machine # [ 0.695948] pci 0000:00:09.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] machine # [ 0.697537] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint machine # [ 0.701973] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff] machine # [ 0.702932] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] machine # [ 0.703948] pci 0000:00:0a.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] machine # [ 0.706510] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint machine # [ 0.709847] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff] machine # [ 0.710718] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] machine # [ 0.711765] pci 0000:00:0b.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] machine # [ 0.713536] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.716422] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f] machine # [ 0.718158] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.720710] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f] machine # [ 0.721890] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint machine # [ 0.723629] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f] machine # [ 0.725149] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint machine # [ 0.727362] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff] machine # [ 0.729174] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint machine # [ 0.731222] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO machine # [ 0.732198] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint machine # [ 0.734979] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f] machine # [ 0.735925] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff] machine # [ 0.738363] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint machine # [ 0.740791] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] machine # [ 0.745069] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 machine # [ 0.746055] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 machine # [ 0.747037] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 machine # [ 0.749031] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 machine # [ 0.750030] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 machine # [ 0.751061] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 machine # [ 0.752035] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 machine # [ 0.753031] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 machine # [ 0.754964] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 machine # [ 0.755946] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 machine # [ 0.756946] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 machine # [ 0.757940] ACPI: PCI: Interrupt link GSID configured for IRQ 19 machine # [ 0.758949] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 machine # [ 0.759944] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 machine # [ 0.760941] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 machine # [ 0.761941] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 machine # [ 0.766069] iommu: Default domain type: Translated machine # [ 0.766929] iommu: DMA domain TLB invalidation policy: lazy mode machine # [ 0.768253] ACPI: bus type USB registered machine # [ 0.769008] usbcore: registered new interface driver usbfs machine # [ 0.769954] usbcore: registered new interface driver hub machine # [ 0.771013] usbcore: registered new device driver usb machine # [ 0.773646] NetLabel: Initializing machine # [ 0.774927] NetLabel: domain hash size = 128 machine # [ 0.775666] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO machine # [ 0.775989] NetLabel: unlabeled traffic allowed by default machine # [ 0.776942] PCI: Using ACPI for IRQ routing machine # [ 0.820987] pci 0000:00:01.0: vgaarb: setting as boot VGA device machine # [ 0.821920] pci 0000:00:01.0: vgaarb: bridge control possible machine # [ 0.821920] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none machine # [ 0.821944] vgaarb: loaded machine # [ 0.823517] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 machine # [ 0.824942] hpet0: 3 comparators, 64-bit 100.000000 MHz counter machine # [ 0.830326] clocksource: Switched to clocksource kvm-clock machine # [ 0.832083] VFS: Disk quotas dquot_6.6.0 machine # [ 0.832807] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) machine # [ 0.834556] pnp: PnP ACPI init machine # [ 0.835543] ACPI: IRQ 4 override to edge(!), high(!) machine # [ 0.836576] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved machine # [ 0.838265] pnp: PnP ACPI: found 6 devices machine # [ 0.846720] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns machine # [ 0.848308] clocksource: Switched to clocksource acpi_pm machine # [ 0.849402] NET: Registered PF_INET protocol family machine # [ 0.851014] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear) machine # [ 0.868195] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear) machine # [ 0.869769] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) machine # [ 0.871253] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear) machine # [ 0.873830] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear) machine # [ 0.875220] TCP: Hash tables configured (established 32768 bind 32768) machine # [ 0.876429] MPTCP token hash table entries: 4096 (order: 5, 98304 bytes, linear) machine # [ 0.877803] UDP hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.879035] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes, linear) machine # [ 0.880467] NET: Registered PF_UNIX/PF_LOCAL protocol family machine # [ 0.881490] NET: Registered PF_XDP protocol family machine # [ 0.882393] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] machine # [ 0.883482] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] machine # [ 0.884567] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] machine # [ 0.885738] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window] machine # [ 0.886949] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] machine # [ 0.888110] pci_bus 0000:00: resource 9 [mem 0xe0000000000-0xe07ffffffff window] machine # [ 0.890106] ACPI: \_SB_.GSIA: Enabled at IRQ 16 machine # [ 0.892494] ACPI: \_SB_.GSIB: Enabled at IRQ 17 machine # [ 0.894606] ACPI: \_SB_.GSIC: Enabled at IRQ 18 machine # [ 0.896661] ACPI: \_SB_.GSID: Enabled at IRQ 19 machine # [ 0.898494] PCI: CLS 0 bytes, default 64 machine # [ 0.899343] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) machine # [ 0.899556] Trying to unpack rootfs image as initramfs... machine # [ 0.899578] software IO TLB: mapped [mem 0x000000007a367000-0x000000007e367000] (64MB) machine # [ 0.903022] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns machine # [ 0.924225] Initialise system trusted keyrings machine # [ 0.925515] workingset: timestamp_bits=40 max_order=20 bucket_order=0 machine # [ 0.936978] Key type asymmetric registered machine # [ 0.937735] Asymmetric key parser 'x509' registered machine # [ 0.938721] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) machine # [ 0.940327] io scheduler mq-deadline registered machine # [ 0.941157] io scheduler kyber registered machine # [ 0.945256] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled machine # [ 0.946600] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A machine # [ 0.949031] Linux agpgart interface v0.103 machine # [ 0.949840] ACPI: bus type drm_connector registered machine # [ 0.952243] usbcore: registered new interface driver usbserial_generic machine # [ 0.953372] usbserial: USB Serial support registered for generic machine # [ 0.954401] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. machine # [ 0.954401] Please enable it if your BIOS has the CPPC option. machine # [ 0.956753] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled machine # [ 0.958194] drop_monitor: Initializing network drop monitor service machine # [ 0.959423] NET: Registered PF_INET6 protocol family machine # [ 0.961266] Segment Routing with IPv6 machine # [ 0.961967] In-situ OAM (IOAM) with IPv6 machine # [ 0.964159] IPI shorthand broadcast: enabled machine # [ 0.968498] sched_clock: Marking stable (819014659, 148874271)->(989143504, -21254574) machine # [ 0.970293] registered taskstats version 1 machine # [ 0.971325] Loading compiled-in X.509 certificates machine # [ 0.981551] Demotion targets for Node 0: null machine # [ 0.982693] Key type .fscrypt registered machine # [ 0.983427] Key type fscrypt-provisioning registered machine # [ 0.984443] ima: No TPM chip found, activating TPM-bypass! machine # [ 0.985421] ima: Allocated hash algorithm: sha1 machine # [ 0.986276] ima: No architecture policies found machine # [ 0.987352] PM: Magic number: 10:416:730 machine # [ 0.989004] RAS: Correctable Errors collector initialized. machine # [ 0.993516] clk: Disabling unused clocks machine # [ 0.994265] PM: genpd: Disabling unused power domains machine # [ 1.159761] Freeing initrd memory: 29092K machine # [ 1.167054] Freeing unused decrypted memory: 2028K machine # [ 1.173305] Freeing unused kernel image (initmem) memory: 3644K machine # [ 1.176064] Write protecting the kernel read-only data: 32768k machine # [ 1.180964] Freeing unused kernel image (text/rodata gap) memory: 1208K machine # [ 1.184768] Freeing unused kernel image (rodata/data gap) memory: 752K machine # [ 1.252642] x86/mm: Checked W+X mappings: passed, no W+X pages found. machine # [ 1.253811] Run /init as init process machine # [ 1.268012] systemd[1]: Inserted module 'autofs4' machine # [ 1.290346] fuse: init (API version 7.45) machine # [ 1.297830] ACPI: \_SB_.GSIG: Enabled at IRQ 22 machine # [ 1.300915] ACPI: \_SB_.GSIH: Enabled at IRQ 23 machine # [ 1.304164] ACPI: \_SB_.GSIE: Enabled at IRQ 20 machine # [ 1.306660] ACPI: \_SB_.GSIF: Enabled at IRQ 21 machine # [ 1.349774] systemd[1]: Successfully made /usr/ read-only. machine # [ 1.685567] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 1.693468] systemd[1]: Detected virtualization kvm. machine # [ 1.695692] systemd[1]: Detected architecture x86-64. machine # [ 1.697930] systemd[1]: Running in initrd. machine # [ 1.700400] systemd[1]: Initializing machine ID from random generator. machine # [ 1.703480] systemd[1]: Hostname set to . machine # [ 1.827030] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 1.865394] systemd[1]: Queued start job for default target Initrd Default Target. machine # [ 1.876468] systemd[1]: Created slice Slice /system/modprobe. machine # [ 1.877675] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 1.879093] systemd[1]: Expecting device /dev/disk/by-label/nixos... machine # [ 1.880218] systemd[1]: Reached target Path Units. machine # [ 1.881069] systemd[1]: Reached target Slice Units. machine # [ 1.881924] systemd[1]: Reached target Swaps. machine # [ 1.882722] systemd[1]: Reached target Timer Units. machine # [ 1.883699] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 1.884922] systemd[1]: Listening on Journal Socket (/dev/log). machine # [ 1.886050] systemd[1]: Listening on Journal Sockets. machine # [ 1.887047] systemd[1]: Listening on udev Control Socket. machine # [ 1.888033] systemd[1]: Listening on udev Kernel Socket. machine # [ 1.888986] systemd[1]: Reached target Socket Units. machine # [ 1.891055] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 1.893056] systemd[1]: Starting Load Kernel Module 9pnet_virtio... machine # [ 1.894857] systemd[1]: Starting Load Kernel Module configfs... machine # [ 1.897552] systemd[1]: Starting Journal Service... machine # [ 1.900962] systemd[1]: Starting Load Kernel Modules... machine # [ 1.903335] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 1.907725] systemd[1]: Starting Coldplug All udev Devices... machine # [ 1.909840] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 1.911586] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 1.913197] systemd[1]: Finished Load Kernel Module configfs. machine # [ 1.914590] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config machine # [ 1.918962] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 1.927975] systemd-journald[90]: Collecting audit messages is disabled. machine # [ 1.940199] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 1.947150] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 1.953701] netfs: FS-Cache loaded machine # [ 1.959926] 9pnet: Installing 9P2000 support machine # [ 1.969155] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. machine # [ 1.969274] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. machine # [ 1.969745] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev machine # [ 1.970341] systemd[1]: Finished Load Kernel Module 9pnet_virtio. machine # [ 1.826317] systemd-modules-load[93]: Using 4 probe threads machine # [ 1.827806] systemd-modules-load[93]: Inserted module 'virtio[ 1.976629] systemd[1]: Started Journal Service. machine # _balloon' machine # [ 1.829521] systemd-modules-load[93]: Inserted module 'virtio_gpu' machine # [ 1.830709] systemd-modules-load[93]: Inserted module 'dm_mod' machine # [ 1.831672] systemd[1]: Finished Load Kernel Modules. machine # [ 1.832599] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 1.834773] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 1.835754] systemd[1]: Reached target Local File Systems. machine # [ 1.836493] systemd[1]: Starting Apply Kernel Variables... machine # [ 1.837230] systemd[1]: Starting Create System Files and Directories... machine # [ 1.839364] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 1.856438] systemd[1]: Finished Apply Kernel Variables. machine # [ 1.858129] systemd[1]: Finished Create System Files and Directories. machine # [ 1.867406] systemd-udevd[111]: Using default interface naming scheme 'v261'. machine # [ 1.877903] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 1.911331] systemd[1]: Finished Coldplug All udev Devices. machine # [ 1.912201] systemd[1]: Reached target System Initialization. machine # [ 1.913028] systemd[1]: Reached target Basic System. machine # [ 2.141858] virtio_blk virtio5: 4/0/0 default/read/poll queues machine # [ 2.145680] uhci_hcd 0000:00:1d.0: UHCI Host Controller machine # [ 2.147017] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 machine # [ 2.149456] uhci_hcd 0000:00:1d.0: detected 2 ports machine # [ 2.150292] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c200 machine # [ 2.151508] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.152702] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.153766] usb usb1: Product: UHCI Host Controller machine # [ 2.154550] usb usb1: Manufacturer: Linux 6.18.50 uhci_hcd machine # [ 2.155380] usb usb1: SerialNumber: 0000:00:1d.0 machine # [ 2.157935] SCSI subsystem initialized machine # [ 2.159839] hub 1-0:1.0: USB hub found machine # [ 2.161251] hub 1-0:1.0: 2 ports detected machine # [ 2.174121] virtio_blk virtio5: [vda] 33554432 512-byte logical blocks (17.2 GB/16.0 GiB) machine # [ 2.184481] ehci-pci 0000:00:1d.7: EHCI Host Controller machine # [ 2.185805] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2 machine # [ 2.187355] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdb000 machine # [ 2.193920] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 machine # [ 2.196070] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 machine # [ 2.197282] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.198404] usb usb2: Product: EHCI Host Controller machine # [ 2.199119] usb usb2: Manufacturer: Linux 6.18.50 ehci_hcd machine # [ 2.199945] usb usb2: SerialNumber: 0000:00:1d.7 machine # [ 2.223513] hub 2-0:1.0: USB hub found machine # [ 2.224275] hub 2-0:1.0: 6 ports detected machine # [ 2.076706] systemd[1]: Starting Virtual Console Setup... machine # [ 2.246017] hub 1-0:1.0: USB hub found machine # [ 2.246641] hub 1-0:1.0: 2 ports detected machine # [ 2.247606] uhci_hcd 0000:00:1d.1: UHCI Host Controller machine # [ 2.250172] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 machine # [ 2.102416] systemd-vconsole-setup[142]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 2.251581] uhci_hcd 0000:00:1d.1: detected 2 ports machine # [ 2.105746] (udev-worker)[119]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 2.256633] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c220 machine # [ 2.108258] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line. machine # [ 2.110755] systemd[1]: Finished Virtual Console Setup.[ 2.259523] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # machine # [ 2.261492] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.262860] usb usb3: Product: UHCI Host Controller machine # [ 2.114550] (udev-worker)[135]: Network interface NamePolicy=[ 2.263609] usb usb3: Manufacturer: Linux 6.18.50 uhci_hcd machine # disabled on kernel command line. machine # [ 2.265017] usb usb3: SerialNumber: 0000:00:1d.1 machine # [ 2.268639] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 machine # [ 2.270474] hub 3-0:1.0: USB hub found machine # [ 2.271754] hub 3-0:1.0: 2 ports detected machine # [ 2.275185] serio: i8042 KBD port at 0x60,0x64 irq 1 machine # [ 2.277482] serio: i8042 AUX port at 0x60,0x64 irq 12 machine # [ 2.280339] uhci_hcd 0000:00:1d.2: UHCI Host Controller machine # [ 2.281137] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 machine # [ 2.132949] systemd[1]: Found device /dev/disk/by-label/nixos. machine # [ 2.283334] uhci_hcd 0000:00:1d.2: detected 2 ports machine # [ 2.284235] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c240 machine # [ 2.136292] systemd[1]: Reached target Initrd Root Device. machine # [ 2.285210] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 machine # [ 2.286989] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 machine # [ 2.288109] usb usb4: Product: UHCI Host Controller machine # [ 2.139999] systemd[1]: Start[ 2.288817] usb usb4: Manufacturer: Linux 6.18.50 uhci_hcd machine # ing File System Check on /dev/disk/by-label/nixos... machine # [ 2.289901] usb usb4: SerialNumber: 0000:00:1d.2 machine # [ 2.293607] hub 4-0:1.0: USB hub found machine # [ 2.294484] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode machine # [ 2.294680] hub 4-0:1.0: 2 ports detected machine # [ 2.294839] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) machine # [ 2.295382] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 machine # [ 2.295421] ahci 0000:00:1f.2: flags: 64bit ncq only machine # [ 2.306983] scsi host0: ahci machine # [ 2.308020] scsi host1: ahci machine # [ 2.309003] scsi host2: ahci machine # [ 2.309937] scsi host3: ahci machine # [ 2.311785] scsi host4: ahci machine # [ 2.312698] scsi host5: ahci machine # [ 2.313364] ata1: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc100 irq 47 lpm-pol 1 machine # [ 2.314662] ata2: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc180 irq 47 lpm-pol 1 machine # [ 2.316086] ata3: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc200 irq 47 lpm-pol 1 machine # [ 2.167752] systemd-fsck[161]: nixos: clean, 12/1048576 files, 109865/4194304 blocks machine # [ 2.317454] ata4: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc280 irq 47 lpm-pol 1 machine # [ 2.319713] ata5: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc300 irq 47 lpm-pol 1 machine # [ 2.321011] ata6: SATA max UDMA/133 abar m4096@0xfebdc000 port 0xfebdc380 irq 47 lpm-pol 1 machine # [ 2.175225] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. machine # [ 2.461102] usb 2-1: new high-speed USB device number 2 using ehci-pci machine # [ 2.592089] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 machine # [ 2.595237] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 machine # [ 2.597976] usb 2-1: Product: QEMU USB Tablet machine # [ 2.599623] usb 2-1: Manufacturer: QEMU machine # [ 2.601147] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1 machine # [ 2.618001] hid: raw HID events driver (C) Jiri Kosina machine # [ 2.635145] ata6: SATA link down (SStatus 0 SControl 300) machine # [ 2.636821] ata4: SATA link down (SStatus 0 SControl 300) machine # [ 2.639252] ata2: SATA link down (SStatus 0 SControl 300) machine # [ 2.641647] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) machine # [ 2.644224] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 machine # [ 2.646661] ata3.00: applying bridge limits machine # [ 2.648932] ata1: SATA link down (SStatus 0 SControl 300) machine # [ 2.651589] ata5: SATA link down (SStatus 0 SControl 300) machine # [ 2.653729] ata3.00: configured for UDMA/100 machine # [ 2.662218] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 machine # [ 2.702998] usbcore: registered new interface driver usbhid machine # [ 2.705090] usbhid: USB HID core driver machine # [ 2.714727] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input2 machine # [ 2.719263] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 machine # [ 2.741460] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray machine # [ 2.780330] cdrom: Uniform CD-ROM driver Revision: 3.20 machine # [ 2.763543] systemd[1]: Mounting /sysroot... machine # [ 3.061717] EXT4-fs (vda): mounted filesystem 99b0fcc0-bff8-4fd4-9bf0-af85ec662256 r/w with ordered data mode. Quota mode: none. machine # [ 2.919544] systemd[1]: Mounted /sysroot. machine # [ 2.920325] systemd[1]: Reached target Initrd Root File System. machine # [ 2.922476] systemd[1]: Mounting /sysroot/nix/.ro-store... machine # [ 2.923382] systemd[1]: Mounting /sysroot/nix/.rw-store... machine # [ 2.926145] systemd[1]: Mounting /sysroot/run... machine # [ 2.928417] systemd[1]: Mounting /sysroot/tmp/shared... machine # [ 2.932341] systemd[1]: Mounting /sysroot/tmp/xchg... machine # [ 2.938152] systemd[1]: Starting Mountpoints Configured in the Real Root... machine # [ 2.940468] systemd[1]: Mounted /sysroot/nix/.rw-store. machine # [ 2.941964] systemd[1]: Mounted /sysroot/run. machine # [ 3.092368] 9p: Installing v9fs 9p2000 file system support machine # [ 2.946161] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 2.947558] systemd-sysroot-fstab-check[195]: /sysroot should be mounted in the initrd, will request daemon-reload. machine # [ 2.951042] systemd[1]: Reload requested from client PID 195 ('systemd-sysroot') (unit initrd-parse-etc.service)... machine # [ 2.952791] systemd[1]: Reloading... machine # [ 3.010438] systemd[1]: Reloading finished in 57 ms. machine # [ 3.036723] systemd-sysroot-fstab-check[195]: Requesting initrd-fs.target/start/replace... machine # [ 3.038131] systemd[1]: Mounted /sysroot/nix/.ro-store. machine # [ 3.038950] systemd[1]: Mounted /sysroot/tmp/shared. machine # [ 3.039778] systemd[1]: Mounted /sysroot/tmp/xchg. machine # [ 3.040560] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.041814] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.042802] systemd-sysroot-fstab-check[195]: Requesting swap.target/start/replace... machine # [ 3.044080] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.045377] systemd[1]: initrd-parse-etc.service: Deactivated successfully. machine # [ 3.046661] systemd[1]: Finished Mountpoints Configured in the Real Root. machine # [ 3.047897] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. machine # [ 3.059938] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.061051] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.762996] systemd[1]: Mounting /sysroot/nix/store... machine # [ 3.818549] systemd[1]: Mounted /sysroot/nix/store. machine # [ 3.820300] systemd[1]: Reached target Initrd File Systems. machine # [ 3.822630] systemd[1]: Starting Find NixOS closure... machine # [ 3.824495] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... machine # [ 3.839852] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. machine # [ 3.842499] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. machine # [ 3.857898] systemd[1]: Finished Find NixOS closure. machine # [ 3.859499] systemd[1]: Reached target Initrd Default Target. machine # [ 3.861544] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... machine # [ 3.905497] systemd[1]: Stopped target Initrd Default Target. machine # [ 3.907395] systemd[1]: Stopped target Basic System. machine # [ 3.908957] systemd[1]: Stopped target Initrd Root Device. machine # [ 3.910664] systemd[1]: Stopped target Path Units. machine # [ 3.912176] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. machine # [ 3.914294] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. machine # [ 3.916938] systemd[1]: Stopped target Slice Units. machine # [ 3.918608] systemd[1]: Stopped target Socket Units. machine # [ 3.921159] systemd[1]: Stopped target System Initialization. machine # [ 3.924488] systemd[1]: Stopped target Swaps. machine # [ 3.926922] systemd[1]: Stopped target Timer Units. machine # [ 3.929564] systemd[1]: dbus.socket: Deactivated successfully. machine # [ 3.931604] systemd[1]: Closed D-Bus System Message Bus Socket. machine # [ 3.933397] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. machine # [ 3.935567] systemd[1]: Stopped Find NixOS closure. machine # [ 3.937132] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 3.940220] systemd[1]: Starting rw-sysroot-nix-store.service... machine # [ 3.942106] systemd[1]: systemd-sysctl.service: Deactivated successfully. machine # [ 3.944107] systemd[1]: Stopped Apply Kernel Variables. machine # [ 3.945831] systemd[1]: systemd-modules-load.service: Deactivated successfully. machine # [ 3.947932] systemd[1]: Stopped Load Kernel Modules. machine # [ 3.949262] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. machine # [ 3.950753] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. machine # [ 3.952257] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. machine # [ 3.953708] systemd[1]: Stopped Create System Files and Directories. machine # [ 3.954885] systemd[1]: Stopped target Local File Systems. machine # [ 3.955949] systemd[1]: Stopped target Preparation for Local File Systems. machine # [ 3.957219] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. machine # [ 3.958515] systemd[1]: Stopped Coldplug All udev Devices. machine # [ 3.959551] systemd[1]: Stopping Rule-based Manager for Device Events and Files... machine # [ 3.960878] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 3.962169] systemd[1]: Stopped Virtual Console Setup. machine # [ 3.963239] systemd[1]: initrd-cleanup.service: Deactivated successfully. machine # [ 3.964468] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. machine # [ 3.965664] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. machine # [ 3.966917] systemd[1]: Finished rw-sysroot-nix-store.service. machine # [ 3.967979] systemd[1]: systemd-udevd.service: Deactivated successfully. machine # [ 3.969234] systemd[1]: Stopped Rule-based Manager for Device Events and Files. machine # [ 3.970477] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. machine # [ 3.971655] systemd[1]: Closed udev Control Socket. machine # [ 3.972415] systemd[1]: Starting Cleanup udev Database... machine # [ 3.973215] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. machine # [ 3.974283] systemd[1]: Stopped Create Static Device Nodes in /dev. machine # [ 3.975164] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. machine # [ 3.976312] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. machine # [ 3.977295] systemd[1]: kmod-static-nodes.service: Deactivated successfully. machine # [ 3.978300] systemd[1]: Stopped Create List of Static Device Nodes. machine # [ 3.988483] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. machine # [ 3.989603] systemd[1]: Finished Cleanup udev Database. machine # [ 3.990856] systemd[1]: Reached target Switch Root. machine # [ 3.992807] systemd[1]: Starting NixOS Activation... machine # [ 4.199530] initrd-nixos-activation-start[247]: booting system configuration /nix/store/339f4gxz5zllas84pw22l61dagczgvc0-nixos-system-machine-test machine # [ 4.278271] initrd-nixos-activation-start[247]: running activation script... machine # [ 4.738658] initrd-nixos-activation-start[270]: setting up /etc... machine # [ 5.013178] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. machine # [ 5.014470] systemd[1]: Finished NixOS Activation. machine # [ 5.015236] systemd[1]: Starting Switch Root... machine # [ 5.030785] systemd[1]: Switching root. machine # [ 5.240201] systemd-journald[90]: Received SIGTERM from PID 1 (systemd). machine # [ 5.437609] NET: Registered PF_VSOCK protocol family machine # [ 5.843371] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) machine # [ 5.853776] systemd[1]: Detected virtualization kvm. machine # [ 5.855615] systemd[1]: Detected architecture x86-64. machine # [ 5.857582] systemd[1]: Detected first boot. machine # [ 5.865728] systemd[1]: Initializing machine ID from random generator. machine # [ 6.040727] systemd[1]: bpf-restrict-fs: LSM BPF program attached machine # [ 6.159378] systemd[1]: Applying preset policy. machine # [ 6.604605] systemd[1]: Populated /etc with preset unit settings. machine # [ 7.007085] systemd[1]: initrd-switch-root.service: Deactivated successfully. machine # [ 7.010546] systemd[1]: Stopped initrd-switch-root.service. machine # [ 7.016488] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. machine # [ 7.022166] systemd[1]: Created slice Slice /system/getty. machine # [ 7.025725] systemd[1]: Created slice User and Session Slice. machine # [ 7.028048] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. machine # [ 7.030528] systemd[1]: Started Forward Password Requests to Wall Directory Watch. machine # [ 7.032823] systemd[1]: Expecting device /dev/hvc0... machine # [ 7.034362] systemd[1]: Expecting device /dev/ttyS0... machine # [ 7.036022] systemd[1]: Reached target Local Encrypted Volumes. machine # [ 7.037724] systemd[1]: Stopped target initrd-fs.target. machine # [ 7.039351] systemd[1]: Stopped target initrd-root-fs.target. machine # [ 7.041047] systemd[1]: Stopped target initrd-switch-root.target. machine # [ 7.042917] systemd[1]: Reached target Virtual Machines and Containers. machine # [ 7.044838] systemd[1]: Reached target Path Units. machine # [ 7.046374] systemd[1]: Reached target Remote File Systems. machine # [ 7.048007] systemd[1]: Reached target Slice Units. machine # [ 7.049495] systemd[1]: Reached target Swaps. machine # [ 7.053382] systemd[1]: Listening on Query the User Interactively for a Password. machine # [ 7.057160] systemd[1]: Listening on Process Core Dump Socket. machine # [ 7.059930] systemd[1]: Listening on Credential Encryption/Decryption. machine # [ 7.062644] systemd[1]: Listening on Factory Reset Management. machine # [ 7.063676] systemd[1]: Listening on Hostname Service Socket. machine # [ 7.067616] systemd[1]: Starting Journal Log Access Socket... machine # [ 7.069388] systemd[1]: Listening on Journal Audit Socket. machine # [ 7.076611] systemd[1]: Listening on Console Output Muting Service Socket. machine # [ 7.077914] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. machine # [ 7.079666] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.081093] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki machine # [ 7.089368] systemd[1]: Listening on Disk Repartitioning Service Socket. machine # [ 7.090475] systemd[1]: Listening on udev Control Socket. machine # [ 7.091455] systemd[1]: Listening on udev Varlink Socket. machine # [ 7.096669] systemd[1]: Mounting Huge Pages File System... machine # [ 7.099645] systemd[1]: Mounting POSIX Message Queue File System... machine # [ 7.103403] systemd[1]: Mounting Kernel Debug File System... machine # [ 7.118358] systemd[1]: Mounting Kernel Trace File System... machine # [ 7.128822] systemd[1]: Starting Create List of Static Device Nodes... machine # [ 7.134732] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio machine # [ 7.146215] systemd[1]: Starting Load Kernel Module configfs... machine # [ 7.149793] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm machine # [ 7.153386] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 7.157318] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 7.177102] systemd[1]: Mounting FUSE Control File System... machine # [ 7.180209] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 7.202147] systemd[1]: Starting Journal Service... machine # [ 7.223121] systemd[1]: Starting Load Kernel Modules... machine # [ 7.236491] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... machine # [ 7.246561] systemd[1]: Starting Remount Root and Kernel File Systems... machine # [ 7.248267] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.252611] systemd[1]: Starting Coldplug All udev Devices... machine # [ 7.256073] systemd-journald[340]: Collecting audit messages is enabled. machine # [ 7.256119] systemd[1]: Listening on Journal Log Access Socket. machine # [ 7.258993] systemd[1]: Mounted Huge Pages File System. machine # [ 7.260545] systemd[1]: Mounted POSIX Message Queue File System. machine # [ 7.262358] systemd[1]: Mounted Kernel Debug File System. machine # [ 7.263604] systemd[1]: Mounted Kernel Trace File System. machine # [ 7.267553] systemd[1]: Finished Create List of Static Device Nodes. machine # [ 7.269663] systemd[1]: modprobe@configfs.service: Deactivated successfully. machine # [ 7.272015] systemd[1]: Finished Load Kernel Module configfs. machine # [ 7.125366] systemd[1]: Queued start job for default target Multi-User System. machine # [ 7.126928] systemd[1]: systemd-journald.service: Deactivated successfully. machine # [ 7.277462] systemd[1]: Started Journal Service. machine # [ 7.129069] systemd-modules-load[342]: Using 2 probe threads machine # [ 7.132027] systemd[1]: Mounted FUSE Control File System. machine # [ 7.137353] systemd[1]: Mounting Kernel Configuration File System... machine # [ 7.286714] loop: module loaded machine # [ 7.140894] systemd-modules-load[342]: Inserted module 'loop' machine # [ 7.143327] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... machine # [ 7.147261] systemd[1]: Finished Load Kernel Modules. machine # [ 7.152895] systemd[1]: Starting Apply Kernel Variables... machine # [ 7.313973] EXT4-fs (vda): re-mounted 99b0fcc0-bff8-4fd4-9bf0-af85ec662256. machine # [ 7.165408] systemd-oomd[343]: No swap; memory pressure usage will be degraded machine # [ 7.171051] systemd[1]: Finished Remount Root and Kernel File Systems. machine # [ 7.172510] systemd[1]: Listening on Disk Image Download Service Socket. machine # [ 7.176268] systemd[1]: Starting Flush Journal to Persistent Storage... machine # [ 7.177635] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 7.182787] systemd[1]: Starting Load/Save OS Random Seed... machine # [ 7.183851] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.185965] systemd[1]: Mounted Kernel Configuration File System. machine # [ 7.187186] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. machine # [ 7.360041] systemd-journald[340]: Received client request to flush runtime journal. machine # [ 7.262312] systemd[1]: Finished Load/Save OS Random Seed. machine # [ 7.263834] systemd[1]: Reached target First Boot Complete. machine # [ 7.265070] systemd[1]: Finished Apply Kernel Variables. machine # [ 7.266083] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. machine # [ 7.267407] systemd[1]: Starting Create Static Device Nodes in /dev... machine # [ 7.268555] systemd[1]: Finished Flush Journal to Persistent Storage. machine # [ 7.291140] systemd[1]: Finished Create Static Device Nodes in /dev. machine # [ 7.292527] systemd[1]: Reached target Preparation for Local File Systems. machine # [ 7.294274] systemd[1]: Starting Rule-based Manager for Device Events and Files... machine # [ 7.295688] systemd[1]: Finished Coldplug All udev Devices. machine # [ 7.361823] systemd-udevd[371]: Using default interface naming scheme 'v261'. machine # [ 7.466673] systemd[1]: Started Rule-based Manager for Device Events and Files. machine # [ 7.542571] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse machine # [ 7.554672] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. machine # [ 7.577704] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. machine # [ 7.593711] (udev-worker)[390]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. machine # [ 7.596383] (udev-worker)[393]: Network interface NamePolicy= disabled on kernel command line. machine # [ 7.597991] (udev-worker)[390]: Network interface NamePolicy= disabled on kernel command line. machine # [ 7.767046] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console machine # [ 7.771166] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 machine # [ 7.784944] Console: switching to colour dummy device 80x25 machine # [ 7.786755] [drm] Found bochs VGA, ID 0xb0c5. machine # [ 7.786758] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. machine # [ 7.641209] systemd[1]: Condition check resulted in Virtio network device being skipped. machine # [ 7.642541] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore machine # [ 7.644088] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 machine # [ 7.646182] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore machine # [ 7.647862] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.649143] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os machine # [ 7.805512] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic machine # [ 7.806707] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 machine # [ 7.821531] parport_pc 00:02: reported by Plug and Play ACPI machine # [ 7.824528] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized machine # [ 7.824998] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] machine # [ 7.827080] Console: switching to colour frame buffer device 160x50 machine # [ 7.827197] ACPI: button: Power Button [PWRF] machine # [ 7.828291] rtc_cmos 00:04: RTC can wake from S4 machine # [ 7.828832] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device machine # [ 7.838231] rtc_cmos 00:04: registered as rtc0 machine # [ 7.838794] rtc_cmos 00:04: setting system clock to 2026-09-22T10:44:28 UTC (1790073868) machine # [ 7.840491] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs machine # [ 7.841066] systemd-journald[340]: Time jumped backwards, rotating. machine # [ 7.844517] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:09.0/virtio7/input/input4 machine # [ 7.897095] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6 machine # [ 7.900673] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt machine # [ 7.904336] mousedev: PS/2 mouse device common for all mice machine # [ 7.908121] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD machine # [ 7.909591] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 machine # [ 7.827093] systemd[1]: Starting Virtual Console Setup... machine # [ 7.870082] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. machine # [ 8.024415] ppdev: user-space parallel port driver machine # [ 7.876216] systemd[1]: Stopped Virtual Console Setup. machine # [ 7.884805] systemd[1]: Mounting /run/wrappers... machine # [ 7.886423] systemd[1]: Starting Virtual Console Setup... machine # [ 8.049162] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) machine # [ 8.053334] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) machine # [ 8.060374] kvm_amd: TSC scaling supported machine # [ 8.061288] kvm_amd: Nested Virtualization enabled machine # [ 8.062229] kvm_amd: Nested Paging enabled machine # [ 8.063275] kvm_amd: LBR virtualization supported machine # [ 8.064406] kvm_amd: Virtual VMLOAD VMSAVE supported machine # [ 8.065608] kvm_amd: Virtual GIF supported machine # [ 8.066952] kvm_amd: Virtual NMI enabled machine # [ 7.928288] systemd[1]: Mounted /run/wrappers. machine # [ 7.929675] systemd[1]: Reached target Local File Systems. machine # [ 7.932128] systemd[1]: Listening on Boot Loader Control Service Socket. machine # [ 7.936619] systemd[1]: Starting register-nix-paths.service... machine # [ 7.941357] systemd[1]: Starting Create SUID/SGID Wrappers... machine # [ 7.942440] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. machine # [ 7.948892] systemd[1]: Starting Save Transient machine-id to Disk... machine # [ 7.951052] systemd[1]: Starting Create System Files and Directories... machine # [ 8.121013] EDAC MC: Ver: 3.0.0 machine # [ 7.998919] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. machine # [ 8.001141] systemd[1]: Finished Save Transient machine-id to Disk. machine # [ 8.033717] systemd[1]: Finished Create System Files and Directories. machine # [ 8.038266] systemd[1]: Starting Rebuild Journal Catalog... machine # [ 8.041161] systemd[1]: Starting Record System Boot/Shutdown in UTMP... machine # [ 8.078299] systemd[1]: Finished Record System Boot/Shutdown in UTMP. machine # [ 8.102234] systemd[1]: Finished Rebuild Journal Catalog. machine # [ 8.105271] systemd[1]: Starting Update is Completed... machine # [ 8.130912] systemd[1]: Finished Update is Completed. machine # [ 8.285769] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. machine # [ 8.287149] systemd[1]: Finished Create SUID/SGID Wrappers. machine # [ 8.294337] systemd-vconsole-setup[413]: Configuration of first virtual console was skipped, ignoring remaining ones. machine # [ 8.297548] systemd[1]: Finished Virtual Console Setup. machine # [ 8.750969] systemd[1]: Finished register-nix-paths.service. machine # [ 8.752037] systemd[1]: Reached target System Initialization. machine # [ 8.752882] systemd[1]: Started Discard unused filesystem blocks once a week. machine # [ 8.753908] systemd[1]: Started niks3 garbage collection timer. machine # [ 8.754764] systemd[1]: Started Daily Cleanup of Temporary Directories. machine # [ 8.755685] systemd[1]: Reached target Timer Units. machine # [ 8.756416] systemd[1]: Listening on D-Bus System Message Bus Socket. machine # [ 8.760555] systemd[1]: Listening on niks3 server socket. machine # [ 8.761354] systemd[1]: Listening on Nix Daemon Socket. machine # [ 8.762147] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. machine # [ 8.763555] systemd[1]: Reached target Socket Units. machine # [ 8.764403] systemd[1]: Reached target Basic System. machine # [ 8.765438] systemd[1]: Started backdoor.service. machine # [ 8.766324] systemd[1]: Starting Import lastlog data into lastlog2 database... machine # [ 8.767672] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.769307] systemd[1]: Starting Post-Boot Actions... machine # [ 8.777110] systemd[1]: Started Reset console on configuration changes. machine # [ 8.780637] systemd[1]: Starting resolvconf update... machine # [ 8.784076] systemd[1]: Started rustfs.service. machine # [ 8.789165] systemd[1]: Starting rustfs-bucket.service... machine # [ 8.792448] systemd[1]: Starting D-Bus System Message Bus... machine # [ 8.812175] systemd[1]: Finished Post-Boot Actions. machine # [ 8.830912] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # connecting to host... machine # [ 8.834285] nsncd[497]: Sep 22 10:44:29.638 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.835562] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.836800] systemd[1]: Reached target User and Group Name Lookups. machine # [ 8.837548] systemd[1]: Starting User Login Management... machine # [ 8.840136] systemd[1]: Finished Import lastlog data into lastlog2 database. machine: Guest shell says: b'Spawning backdoor root shell...\n' machine: connected to guest root shell machine: (connecting took 9.51 seconds) machine: (finished: waiting for the VM to finish booting, in 9.91 seconds) machine # [ 8.893171] dbus-broker-launch[504]: Looking up NSS user entry for 'systemd-timesync'... machine # [ 8.899470] systemd-logind[526]: New seat seat0. machine # [ 8.905493] systemd-logind[526]: Watching system buttons on /dev/input/event2 (Power Button) machine # [ 8.907283] systemd-logind[526]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) machine # [ 8.907920] systemd-logind[526]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) machine # [ 8.908667] systemd[1]: Started User Login Management. machine # [ 8.927948] systemd[1]: Stopped target Host and Network Name Lookups. machine # [ 8.928824] systemd[1]: Stopping Host and Network Name Lookups... machine # [ 8.929706] dbus-broker-launch[504]: NSS returned no entry for 'systemd-timesync' machine # [ 8.929985] dbus-broker-launch[504]: Invalid user-name in /nix/store/sjdn8ydiry7lgasbr6jfz0ilm5vcd4dl-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" machine # [ 8.930762] systemd[1]: Stopped target User and Group Name Lookups. machine # [ 8.931474] systemd[1]: Stopping User and Group Name Lookups... machine # [ 8.932478] systemd[1]: Starting linger-users.service... machine # [ 8.933092] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... machine # [ 8.942703] systemd[1]: nscd.service: Deactivated successfully. machine # [ 8.943575] systemd[1]: Stopped Name Service Cache Daemon (nsncd). machine # [ 8.947824] systemd[1]: Starting Name Service Cache Daemon (nsncd)... machine # [ 8.952469] systemd[1]: Started D-Bus System Message Bus. machine # [ 8.976952] dbus-broker-launch[504]: Ready machine # [ 8.979191] systemd[1]: linger-users.service: Deactivated successfully. machine # [ 8.981355] systemd[1]: Finished linger-users.service. machine # [ 8.985496] nsncd[588]: Sep 22 10:44:29.795 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" machine # [ 8.988269] systemd[1]: Started Name Service Cache Daemon (nsncd). machine # [ 8.989853] systemd[1]: Reached target Host and Network Name Lookups. machine # [ 8.991392] systemd[1]: Reached target User and Group Name Lookups. machine # [ 9.000533] systemd[1]: Finished resolvconf update. machine # [ 9.001562] systemd[1]: Reached target Preparation for Network. machine # [ 9.004632] systemd[1]: Starting DHCP Client... machine # [ 9.006437] systemd[1]: Starting Address configuration of eth1... machine # [ 9.008508] systemd[1]: Starting Extra networking commands.... machine # [ 9.072586] network-addresses-eth1-start[619]: adding address 192.168.1.1/24... done machine # [ 9.083793] network-addresses-eth1-start[619]: adding address 2001:db8:1::1/64... done machine # [ 9.093866] systemd[1]: Finished Address configuration of eth1. machine # [ 9.101328] dhcpcd[626]: dhcpcd-10.3.2 starting machine # [ 9.108081] dhcpcd[683]: dev: loaded udev machine # [ 9.116411] systemd[1]: Finished Extra networking commands.. machine # [ 9.117787] systemd[1]: Reached target Network. machine # [ 9.120130] systemd[1]: Starting PostgreSQL Server... machine # [ 9.121786] systemd[1]: Starting Permit User Sessions... machine # [ 9.274692] 8021q: 802.1Q VLAN Support v1.8 machine # [ 9.276363] 8021q: adding VLAN 0 to HW filter on device eth1 machine # [ 9.152745] systemd[1]: Finished Permit User Sessions. machine # [ 9.155193] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. machine # [ 9.156092] systemd[1]: Started Getty on tty1. machine # [ 9.157487] systemd[1]: Reached target Login Prompts. machine # [ 9.372009] cfg80211: Loading compiled-in X.509 certificates for regulatory database machine # [ 9.392867] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' machine # [ 9.394343] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' machine # [ 9.397881] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 machine # [ 9.399857] cfg80211: failed to load regulatory.db machine # [ 9.283891] postgresql-pre-start[705]: The files belonging to this database system will be owned by user "postgres". machine # [ 9.284680] postgresql-pre-start[705]: This user must also own the server process. machine # [ 9.290869] postgresql-pre-start[705]: The database cluster will be initialized with locale "en_US.UTF-8". machine # [ 9.291856] postgresql-pre-start[705]: The default database encoding has accordingly been set to "UTF8". machine # [ 9.293049] postgresql-pre-start[705]: The default text search configuration will be set to "english". machine # [ 9.294246] postgresql-pre-start[705]: Data page checksums are enabled. machine # [ 9.296329] postgresql-pre-start[705]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok machine # [ 9.446380] 8021q: adding VLAN 0 to HW filter on device eth0 machine # [ 9.298483] postgresql-pre-start[705]: creating subdirectories ... ok machine # [ 9.299571] dhcpcd[683]: eth0: waiting for carrier machine # [ 9.300651] dhcpcd[683]: eth0: carrier acquired machine # [ 9.301670] postgresql-pre-start[705]: selecting dynamic shared memory implementation ... posix machine # [ 9.307841] dhcpcd[683]: DUID 00:01:00:01:32:45:18:8e:52:54:00:12:34:56 machine # [ 9.309087] dhcpcd[683]: eth0: IAID 00:12:34:56 machine # [ 9.309741] dhcpcd[683]: eth0: adding address fe80::5054:ff:fe12:3456 machine # [ 9.374288] postgresql-pre-start[705]: selecting default "max_connections" ... 100 machine # [ 9.441719] postgresql-pre-start[705]: selecting default "shared_buffers" ... 128MB machine # [ 10.392192] dhcpcd[683]: eth0: soliciting a DHCP lease machine # [ 10.562933] NET: Registered PF_PACKET protocol family machine # [ 10.422665] dhcpcd[683]: eth0: offered 10.0.2.15 from 10.0.2.2 machine # [ 10.428316] dhcpcd[683]: eth0: probing address 10.0.2.15/24 machine # [ 10.746091] dhcpcd[683]: eth0: soliciting an IPv6 router machine # [ 10.747387] dhcpcd[683]: eth0: Router Advertisement from fe80::2 machine # [ 10.748341] dhcpcd[683]: eth0: adding address fec0::5054:ff:fe12:3456/64 machine # [ 10.749343] dhcpcd[683]: eth0: adding route to fec0::/64 machine # [ 10.750451] dhcpcd[683]: eth0: adding default route via fe80::2 machine # [ 11.256966] postgresql-pre-start[705]: selecting default time zone ... UTC machine # [ 11.260466] postgresql-pre-start[705]: creating configuration files ... ok machine # [ 11.500909] postgresql-pre-start[705]: running bootstrap script ... ok machine # [ 12.090404] postgresql-pre-start[705]: performing post-bootstrap initialization ... ok machine # [ 12.213381] postgresql-pre-start[705]: syncing data to disk ... ok machine # [ 12.215773] postgresql-pre-start[705]: initdb: warning: enabling "trust" authentication for local connections machine # [ 12.217901] postgresql-pre-start[705]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. machine # [ 12.220616] postgresql-pre-start[705]: Success. You can now start the database server using: machine # [ 12.223321] postgresql-pre-start[705]: pg_ctl -D /var/lib/postgresql/18 -l logfile start machine # [ 12.367054] postgres[769]: [769] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit machine # [ 12.373062] postgres[769]: [769] LOG: listening on IPv6 address "::1", port 5432 machine # [ 12.374099] postgres[769]: [769] LOG: listening on IPv4 address "127.0.0.1", port 5432 machine # [ 12.377962] postgres[769]: [769] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" machine # [ 12.393135] postgres[778]: [778] LOG: database system was shut down at 2026-09-22 10:44:32 GMT machine # [ 12.401180] postgres[769]: [769] LOG: database system is ready to accept connections machine # [ 12.407916] systemd[1]: Started PostgreSQL Server. machine # [ 12.411672] systemd[1]: Starting PostgreSQL Setup Scripts... machine # [ 12.695880] postgresql-setup-start[789]: CREATE DATABASE machine # [ 12.741424] postgresql-setup-start[799]: CREATE ROLE machine # [ 12.779466] postgresql-setup-start[801]: ALTER DATABASE machine # [ 12.786618] systemd[1]: Finished PostgreSQL Setup Scripts. machine # [ 12.788439] systemd[1]: Reached target PostgreSQL. machine # [ 16.206255] dhcpcd[683]: eth0: leased 10.0.2.15 for 86400 seconds machine # [ 16.209374] dhcpcd[683]: eth0: adding route to 10.0.2.0/24 machine # [ 16.211508] dhcpcd[683]: eth0: adding default route via 10.0.2.2 machine # [ 16.383233] systemd[1]: Started DHCP Client. machine # [ 16.386311] systemd[1]: Reached target Network is Online. machine # [ 16.392663] systemd[1]: Starting k3s service... machine # [ 16.493475] k3s[887]: time="2026-09-22T10:44:37Z" level=info msg="Acquiring lock file /var/lib/rancher/k3s/data/.lock" machine # [ 16.494347] k3s[887]: time="2026-09-22T10:44:37Z" level=info msg="Preparing data dir /var/lib/rancher/k3s/data/76c98da5fd74d9a243cba8d533ae287fc547ab08ccd8c5ea4811608ce7075724" machine # [ 19.172874] rustfs-bucket-start[906]: mb s3://farm machine # [ 19.177420] systemd[1]: Finished rustfs-bucket.service. machine # [ 19.870088] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Starting k3s 1.35.8+k3s1 (e952d68a)" machine # [ 19.878932] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdle=20, maxOpen=0, maxLifetime=0s, maxIdleTime=2m0s" machine # [ 19.884253] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Kine built with sqlite from github.com/mattn/go-sqlite3 version 3.53.3" machine # [ 19.888535] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." machine # [ 19.893237] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Database tables and indexes are up to date" machine # [ 19.896316] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Running startup VACUUM to reclaim disk space, this may take a moment..." machine # [ 19.900081] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Startup VACUUM completed successfully" machine # [ 19.903132] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Kine available at unix://kine.sock" machine # [ 19.906072] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 19.909640] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Datastore connection validated successfully, proceeding with bootstrap data generation" machine # [ 19.913754] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="generated self-signed CA certificate CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:40.707798755 +0000 UTC notAfter=2036-09-19 09:44:40.707798755 +0000 UTC" machine # [ 19.918825] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.923649] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=system:k3s-supervisor,O=system:masters signed by CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.928626] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.933367] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.936572] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=system:apiserver,O=system:masters signed by CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.939060] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=k3s-cloud-controller-manager signed by CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.941506] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="generated self-signed CA certificate CN=k3s-server-ca@1790073880: notBefore=2026-09-22 09:44:40.710640177 +0000 UTC notAfter=2036-09-19 09:44:40.710640177 +0000 UTC" machine # [ 19.943952] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.946263] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=kube-scheduler signed by CN=k3s-server-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.948535] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=kube-controller-manager signed by CN=k3s-server-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.950900] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="generated self-signed CA certificate CN=k3s-request-header-ca@1790073880: notBefore=2026-09-22 09:44:40.712224177 +0000 UTC notAfter=2036-09-19 09:44:40.712224177 +0000 UTC" machine # [ 19.953454] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.955868] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="generated self-signed CA certificate CN=etcd-server-ca@1790073880: notBefore=2026-09-22 09:44:40.712878451 +0000 UTC notAfter=2036-09-19 09:44:40.712878451 +0000 UTC" machine # [ 19.958279] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.960568] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="generated self-signed CA certificate CN=etcd-peer-ca@1790073880: notBefore=2026-09-22 09:44:40.713562057 +0000 UTC notAfter=2036-09-19 09:44:40.713562057 +0000 UTC" machine # [ 19.963098] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.965376] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 19.998483] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1790073880: notBefore=2026-09-22 09:44:40 +0000 UTC notAfter=2027-09-22 09:44:40 +0000 UTC" machine # [ 20.001134] k3s[887]: time="2026-09-22T10:44:40Z" level=warning msg="dynamiclistener [::]:6443: no cached certificate available for preload - deferring certificate load until storage initialization or first client request" machine # [ 20.003916] k3s[887]: time="2026-09-22T10:44:40Z" level=info msg="Active TLS secret / (ver=) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__8e8d_ea40_7aff_8a9b-bf3d6e:fec0::8e8d:ea40:7aff:8a9b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=F14BAB3BF79F87D967062E59D7A55678F0DB9678]" machine # [ 20.967499] k3s[887]: time="2026-09-22T10:44:41Z" level=info msg="Password verified locally for node machine" machine # [ 20.969913] k3s[887]: time="2026-09-22T10:44:41Z" level=info msg="certificate CN=machine signed by CN=k3s-server-ca@1790073880: notBefore=2026-09-22 09:44:41 +0000 UTC notAfter=2027-09-22 09:44:41 +0000 UTC" machine # [ 21.191690] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="certificate CN=system:node:machine,O=system:nodes signed by CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:42 +0000 UTC notAfter=2027-09-22 09:44:42 +0000 UTC" machine # [ 21.265060] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:42 +0000 UTC notAfter=2027-09-22 09:44:42 +0000 UTC" machine # [ 21.371442] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1790073880: notBefore=2026-09-22 09:44:42 +0000 UTC notAfter=2027-09-22 09:44:42 +0000 UTC" machine # [ 21.471990] k3s[887]: time="2026-09-22T10:44:42Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:43818: runtime core not ready" machine # [ 21.554556] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Module overlay was already loaded" machine # [ 21.800678] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. machine # [ 21.806224] Bridge firewalling registered machine # [ 21.681977] k3s[887]: time="2026-09-22T10:44:42Z" level=warning msg="Failed to load kernel module iptable_nat with modprobe" machine # [ 21.704456] k3s[887]: time="2026-09-22T10:44:42Z" level=warning msg="Failed to load kernel module iptable_filter with modprobe" machine # [ 21.722658] k3s[887]: time="2026-09-22T10:44:42Z" level=warning msg="Failed to load kernel module nft-expr-counter with modprobe" machine # [ 21.831780] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_max' to 131072" machine # [ 21.833222] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400" machine # [ 21.834893] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600" machine # [ 21.836761] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Set sysctl 'net/ipv4/conf/all/forwarding' to 1" machine # [ 21.847439] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Creating k3s-cert-monitor event broadcaster" machine # [ 21.848094] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 21.848678] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Saving cluster bootstrap data to datastore" machine # [ 21.854068] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Polling for API server readiness: GET /readyz failed: the server is currently unable to handle the request" machine # [ 21.854890] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Opening etcd client connection with endpoints [unix://kine.sock]" machine # [ 21.855843] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Connection to etcd is ready" machine # [ 21.857247] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="ETCD server is now running" machine # [ 21.858410] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Handling backend connection request [machine]" machine # [ 21.859469] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 21.861292] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Remotedialer connected to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 21.862793] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --etcd-servers=unix://kine.sock --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 21.864203] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 21.865360] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,tokencleaner,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.current.key --service-cluster-ip-range=10.43.0.0/16 --tls-cert-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key --use-service-account-credentials=true" machine # [ 21.874335] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-config=/var/lib/rancher/k3s/server/etc/cloud-config.yaml --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --controllers=*,-route --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --leader-elect-resource-name=k3s-cloud-controller-manager --node-status-update-frequency=1m0s --profiling=false" machine # [ 21.932436] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Server node token is available at /var/lib/rancher/k3s/server/token" machine # [ 21.933110] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="To join server node to cluster: k3s server -s https://10.0.2.15:6443 -t ${SERVER_NODE_TOKEN}" machine # [ 21.933803] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Agent node token is available at /var/lib/rancher/k3s/server/agent-token" machine # [ 21.934545] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="To join agent node to cluster: k3s agent -s https://10.0.2.15:6443 -t ${AGENT_NODE_TOKEN}" machine # [ 21.935114] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml" machine # [ 21.935657] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Run: k3s kubectl" machine # [ 21.936230] k3s[887]: I0922 10:44:42.670280 887 options.go:263] external host was not specified, using 10.0.2.15 machine # [ 21.937062] k3s[887]: I0922 10:44:42.672873 887 server.go:158] Version: v1.35.8+k3s1 machine # [ 21.937866] k3s[887]: I0922 10:44:42.672912 887 server.go:160] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 21.938658] k3s[887]: time="2026-09-22T10:44:42Z" level=error msg="Sending HTTP/1.1 503 response to 127.0.0.1:43870: runtime core not ready" machine # [ 21.959088] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" machine # [ 21.960093] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml" machine # [ 22.006329] k3s[887]: I0922 10:44:42.816006 887 shared_informer.go:349] "Waiting for caches to sync" controller="node_authorizer" machine # [ 22.008414] k3s[887]: I0922 10:44:42.818348 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 22.010461] k3s[887]: I0922 10:44:42.820033 887 plugins.go:157] Loaded 14 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,PodTopologyLabels,MutatingAdmissionPolicy,MutatingAdmissionWebhook. machine # [ 22.014818] k3s[887]: I0922 10:44:42.820056 887 plugins.go:160] Loaded 14 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,NodeDeclaredFeatureValidator,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota. machine # [ 22.019206] k3s[887]: I0922 10:44:42.820368 887 instance.go:240] Using reconciler: lease machine # [ 22.020330] k3s[887]: I0922 10:44:42.827922 887 handler.go:304] Adding GroupVersion apiextensions.k8s.io v1 to ResourceManager machine # [ 22.021766] k3s[887]: W0922 10:44:42.827948 887 genericapiserver.go:787] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources. machine # [ 22.023410] k3s[887]: I0922 10:44:42.831938 887 cidrallocator.go:198] starting ServiceCIDR Allocator Controller machine # [ 22.054246] k3s[887]: I0922 10:44:42.864221 887 handler.go:304] Adding GroupVersion v1 to ResourceManager machine # [ 22.055614] k3s[887]: I0922 10:44:42.864391 887 apis.go:112] API group "internal.apiserver.k8s.io" is not enabled, skipping. machine # [ 22.084759] k3s[887]: time="2026-09-22T10:44:42Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" machine # [ 22.094859] k3s[887]: I0922 10:44:42.904819 887 apis.go:112] API group "storagemigration.k8s.io" is not enabled, skipping. machine # [ 22.140846] k3s[887]: I0922 10:44:42.950802 887 handler.go:304] Adding GroupVersion authentication.k8s.io v1 to ResourceManager machine # [ 22.141820] k3s[887]: W0922 10:44:42.950837 887 genericapiserver.go:787] Skipping API authentication.k8s.io/v1beta1 because it has no resources. machine # [ 22.142711] k3s[887]: W0922 10:44:42.950850 887 genericapiserver.go:787] Skipping API authentication.k8s.io/v1alpha1 because it has no resources. machine # [ 22.147092] k3s[887]: I0922 10:44:42.957105 887 handler.go:304] Adding GroupVersion authorization.k8s.io v1 to ResourceManager machine # [ 22.147810] k3s[887]: W0922 10:44:42.957126 887 genericapiserver.go:787] Skipping API authorization.k8s.io/v1beta1 because it has no resources. machine # [ 22.151935] k3s[887]: I0922 10:44:42.961931 887 handler.go:304] Adding GroupVersion autoscaling v2 to ResourceManager machine # [ 22.154282] k3s[887]: I0922 10:44:42.964284 887 handler.go:304] Adding GroupVersion autoscaling v1 to ResourceManager machine # [ 22.154940] k3s[887]: W0922 10:44:42.964306 887 genericapiserver.go:787] Skipping API autoscaling/v2beta1 because it has no resources. machine # [ 22.155779] k3s[887]: W0922 10:44:42.964316 887 genericapiserver.go:787] Skipping API autoscaling/v2beta2 because it has no resources. machine # [ 22.160547] k3s[887]: I0922 10:44:42.970545 887 handler.go:304] Adding GroupVersion batch v1 to ResourceManager machine # [ 22.161543] k3s[887]: W0922 10:44:42.970569 887 genericapiserver.go:787] Skipping API batch/v1beta1 because it has no resources. machine # [ 22.164787] k3s[887]: I0922 10:44:42.974785 887 handler.go:304] Adding GroupVersion certificates.k8s.io v1 to ResourceManager machine # [ 22.165756] k3s[887]: W0922 10:44:42.974809 887 genericapiserver.go:787] Skipping API certificates.k8s.io/v1beta1 because it has no resources. machine # [ 22.166590] k3s[887]: W0922 10:44:42.974822 887 genericapiserver.go:787] Skipping API certificates.k8s.io/v1alpha1 because it has no resources. machine # [ 22.171834] k3s[887]: I0922 10:44:42.981833 887 handler.go:304] Adding GroupVersion coordination.k8s.io v1 to ResourceManager machine # [ 22.172446] k3s[887]: W0922 10:44:42.981878 887 genericapiserver.go:787] Skipping API coordination.k8s.io/v1beta1 because it has no resources. machine # [ 22.172949] k3s[887]: W0922 10:44:42.981894 887 genericapiserver.go:787] Skipping API coordination.k8s.io/v1alpha2 because it has no resources. machine # [ 22.173560] k3s[887]: I0922 10:44:42.982305 887 handler.go:304] Adding GroupVersion discovery.k8s.io v1 to ResourceManager machine # [ 22.174058] k3s[887]: W0922 10:44:42.982321 887 genericapiserver.go:787] Skipping API discovery.k8s.io/v1beta1 because it has no resources. machine # [ 22.174763] k3s[887]: I0922 10:44:42.983781 887 handler.go:304] Adding GroupVersion networking.k8s.io v1 to ResourceManager machine # [ 22.175679] k3s[887]: W0922 10:44:42.983799 887 genericapiserver.go:787] Skipping API networking.k8s.io/v1beta1 because it has no resources. machine # [ 22.176457] k3s[887]: I0922 10:44:42.984272 887 handler.go:304] Adding GroupVersion node.k8s.io v1 to ResourceManager machine # [ 22.176956] k3s[887]: W0922 10:44:42.984287 887 genericapiserver.go:787] Skipping API node.k8s.io/v1beta1 because it has no resources. machine # [ 22.177638] k3s[887]: W0922 10:44:42.984298 887 genericapiserver.go:787] Skipping API node.k8s.io/v1alpha1 because it has no resources. machine # [ 22.178139] k3s[887]: I0922 10:44:42.984907 887 handler.go:304] Adding GroupVersion policy v1 to ResourceManager machine # [ 22.178601] k3s[887]: W0922 10:44:42.984925 887 genericapiserver.go:787] Skipping API policy/v1beta1 because it has no resources. machine # [ 22.179113] k3s[887]: I0922 10:44:42.986325 887 handler.go:304] Adding GroupVersion rbac.authorization.k8s.io v1 to ResourceManager machine # [ 22.179655] k3s[887]: W0922 10:44:42.986342 887 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources. machine # [ 22.180082] k3s[887]: W0922 10:44:42.986354 887 genericapiserver.go:787] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. machine # [ 22.180584] k3s[887]: I0922 10:44:42.986758 887 handler.go:304] Adding GroupVersion scheduling.k8s.io v1 to ResourceManager machine # [ 22.181102] k3s[887]: W0922 10:44:42.986774 887 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1beta1 because it has no resources. machine # [ 22.181609] k3s[887]: W0922 10:44:42.986785 887 genericapiserver.go:787] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. machine # [ 22.182141] k3s[887]: I0922 10:44:42.988478 887 handler.go:304] Adding GroupVersion storage.k8s.io v1 to ResourceManager machine # [ 22.182654] k3s[887]: W0922 10:44:42.988499 887 genericapiserver.go:787] Skipping API storage.k8s.io/v1beta1 because it has no resources. machine # [ 22.183158] k3s[887]: W0922 10:44:42.988511 887 genericapiserver.go:787] Skipping API storage.k8s.io/v1alpha1 because it has no resources. machine # [ 22.183663] k3s[887]: I0922 10:44:42.989386 887 handler.go:304] Adding GroupVersion flowcontrol.apiserver.k8s.io v1 to ResourceManager machine # [ 22.184137] k3s[887]: W0922 10:44:42.989402 887 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta3 because it has no resources. machine # [ 22.184647] k3s[887]: W0922 10:44:42.989414 887 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta2 because it has no resources. machine # [ 22.185143] k3s[887]: W0922 10:44:42.989423 887 genericapiserver.go:787] Skipping API flowcontrol.apiserver.k8s.io/v1beta1 because it has no resources. machine # [ 22.185629] k3s[887]: I0922 10:44:42.992006 887 handler.go:304] Adding GroupVersion apps v1 to ResourceManager machine # [ 22.186154] k3s[887]: W0922 10:44:42.992026 887 genericapiserver.go:787] Skipping API apps/v1beta2 because it has no resources. machine # [ 22.186637] k3s[887]: W0922 10:44:42.992037 887 genericapiserver.go:787] Skipping API apps/v1beta1 because it has no resources. machine # [ 22.187147] k3s[887]: I0922 10:44:42.993390 887 handler.go:304] Adding GroupVersion admissionregistration.k8s.io v1 to ResourceManager machine # [ 22.187620] k3s[887]: W0922 10:44:42.993407 887 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources. machine # [ 22.188164] k3s[887]: W0922 10:44:42.993418 887 genericapiserver.go:787] Skipping API admissionregistration.k8s.io/v1alpha1 because it has no resources. machine # [ 22.188333] k3s[887]: I0922 10:44:42.993821 887 handler.go:304] Adding GroupVersion events.k8s.io v1 to ResourceManager machine # [ 22.188819] k3s[887]: W0922 10:44:42.993835 887 genericapiserver.go:787] Skipping API events.k8s.io/v1beta1 because it has no resources. machine # [ 22.189503] k3s[887]: I0922 10:44:42.995209 887 handler.go:304] Adding GroupVersion resource.k8s.io v1 to ResourceManager machine # [ 22.190134] k3s[887]: W0922 10:44:42.995225 887 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta2 because it has no resources. machine # [ 22.190644] k3s[887]: W0922 10:44:42.995235 887 genericapiserver.go:787] Skipping API resource.k8s.io/v1beta1 because it has no resources. machine # [ 22.191173] k3s[887]: W0922 10:44:42.995245 887 genericapiserver.go:787] Skipping API resource.k8s.io/v1alpha3 because it has no resources. machine # [ 22.191675] k3s[887]: I0922 10:44:42.998707 887 handler.go:304] Adding GroupVersion apiregistration.k8s.io v1 to ResourceManager machine # [ 22.192127] k3s[887]: W0922 10:44:42.998744 887 genericapiserver.go:787] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources. machine # [ 22.536614] k3s[887]: I0922 10:44:43.346406 887 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 22.537504] k3s[887]: I0922 10:44:43.346574 887 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 22.538250] k3s[887]: I0922 10:44:43.346819 887 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" machine # [ 22.539083] k3s[887]: I0922 10:44:43.347177 887 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 22.544822] k3s[887]: I0922 10:44:43.346774 887 secure_serving.go:211] Serving securely on 127.0.0.1:6444 machine # [ 22.548150] k3s[887]: I0922 10:44:43.355756 887 system_namespaces_controller.go:66] Starting system namespaces controller machine # [ 22.548917] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="Starting apiserver lease garbage collector" logger=k3s machine # [ 22.549622] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 22.550096] k3s[887]: I0922 10:44:43.356225 887 local_available_controller.go:156] Starting LocalAvailability controller machine # [ 22.550421] k3s[887]: I0922 10:44:43.356239 887 cache.go:32] Waiting for caches to sync for LocalAvailability controller machine # [ 22.550886] k3s[887]: I0922 10:44:43.356284 887 apiservice_controller.go:100] Starting APIServiceRegistrationController machine # [ 22.551380] k3s[887]: I0922 10:44:43.356287 887 customresource_discovery_controller.go:294] Starting DiscoveryController machine # [ 22.551928] k3s[887]: I0922 10:44:43.356322 887 aggregator.go:185] waiting for initial CRD sync... machine # [ 22.552590] k3s[887]: I0922 10:44:43.356360 887 controller.go:78] Starting OpenAPI AggregationController machine # [ 22.553062] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="Starting legacy_token_tracking_controller" logger=k3s machine # [ 22.553520] k3s[887]: I0922 10:44:43.356424 887 controller.go:142] Starting OpenAPI controller machine # [ 22.553981] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 22.557476] k3s[887]: I0922 10:44:43.356516 887 controller.go:90] Starting OpenAPI V3 controller machine # [ 22.557939] k3s[887]: I0922 10:44:43.356558 887 naming_controller.go:305] Starting NamingConditionController machine # [ 22.558553] k3s[887]: I0922 10:44:43.356568 887 apf_controller.go:377] Starting API Priority and Fairness config controller machine # [ 22.559037] k3s[887]: I0922 10:44:43.356658 887 nonstructuralschema_controller.go:202] Starting NonStructuralSchemaConditionController machine # [ 22.559492] k3s[887]: I0922 10:44:43.356672 887 controller.go:113] "Deleting old lease on startup" lease="kube-system/apiserver-ik4pcwfs7qgdl76byc4pomgvia" machine # [ 22.559955] k3s[887]: I0922 10:44:43.356691 887 apiapproval_controller.go:196] Starting KubernetesAPIApprovalPolicyConformantConditionController machine # [ 22.560592] k3s[887]: I0922 10:44:43.356729 887 crd_finalizer.go:273] Starting CRDFinalizer machine # [ 22.561077] k3s[887]: I0922 10:44:43.356737 887 cluster_authentication_trust_controller.go:459] Starting cluster_authentication_trust_controller controller machine # [ 22.561547] k3s[887]: I0922 10:44:43.356294 887 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller machine # [ 22.562030] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="Waiting for caches to sync" logger=k3s machine # [ 22.562479] k3s[887]: I0922 10:44:43.357227 887 dynamic_serving_content.go:135] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key" machine # [ 22.562952] k3s[887]: I0922 10:44:43.357345 887 remote_available_controller.go:425] Starting RemoteAvailability controller machine # [ 22.577869] k3s[887]: I0922 10:44:43.357358 887 cache.go:32] Waiting for caches to sync for RemoteAvailability controller machine # [ 22.578473] k3s[887]: I0922 10:44:43.357408 887 controller.go:80] Starting OpenAPI V3 AggregationController machine # [ 22.578913] k3s[887]: I0922 10:44:43.357768 887 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt" machine # [ 22.579388] k3s[887]: I0922 10:44:43.357843 887 dynamic_cafile_content.go:161] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt" machine # [ 22.579896] k3s[887]: I0922 10:44:43.366867 887 repairip.go:210] Starting ipallocator-repair-controller machine # [ 22.580541] k3s[887]: I0922 10:44:43.366885 887 shared_informer.go:349] "Waiting for caches to sync" controller="ipallocator-repair-controller" machine # [ 22.580958] k3s[887]: I0922 10:44:43.373354 887 default_servicecidr_controller.go:110] Starting kubernetes-service-cidr-controller machine # [ 22.581602] k3s[887]: I0922 10:44:43.373375 887 shared_informer.go:349] "Waiting for caches to sync" controller="kubernetes-service-cidr-controller" machine # [ 22.582087] k3s[887]: I0922 10:44:43.373612 887 crdregistration_controller.go:114] Starting crd-autoregister controller machine # [ 22.582390] k3s[887]: I0922 10:44:43.373623 887 shared_informer.go:349] "Waiting for caches to sync" controller="crd-autoregister" machine # [ 22.608810] k3s[887]: I0922 10:44:43.418816 887 shared_informer.go:377] "Caches are synced" machine # [ 22.609531] k3s[887]: I0922 10:44:43.419563 887 policy_source.go:248] refreshing policies machine # [ 22.646056] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="Caches are synced" logger=k3s machine # [ 22.646770] k3s[887]: I0922 10:44:43.456310 887 cache.go:39] Caches are synced for LocalAvailability controller machine # [ 22.647248] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="Caches are synced" logger=k3s machine # [ 22.647697] k3s[887]: I0922 10:44:43.457017 887 cache.go:39] Caches are synced for APIServiceRegistrationController controller machine # [ 22.649313] k3s[887]: I0922 10:44:43.457713 887 handler_discovery.go:451] Starting ResourceDiscoveryManager machine # [ 22.649857] k3s[887]: I0922 10:44:43.458175 887 cache.go:39] Caches are synced for RemoteAvailability controller machine # [ 22.650536] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="Caches are synced" logger=k3s machine # [ 22.651040] k3s[887]: I0922 10:44:43.458755 887 apf_controller.go:382] Running API Priority and Fairness config worker machine # [ 22.651400] k3s[887]: I0922 10:44:43.458770 887 apf_controller.go:385] Running API Priority and Fairness periodic rebalancing process machine # [ 22.651919] k3s[887]: I0922 10:44:43.461308 887 controller.go:667] quota admission added evaluator for: namespaces machine # [ 22.658095] k3s[887]: I0922 10:44:43.467143 887 shared_informer.go:356] "Caches are synced" controller="ipallocator-repair-controller" machine # [ 22.660207] k3s[887]: I0922 10:44:43.470161 887 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io machine # [ 22.663895] k3s[887]: I0922 10:44:43.473492 887 shared_informer.go:356] "Caches are synced" controller="kubernetes-service-cidr-controller" machine # [ 22.665817] k3s[887]: I0922 10:44:43.473548 887 default_servicecidr_controller.go:169] Creating default ServiceCIDR with CIDRs: [10.43.0.0/16] machine # [ 22.667588] k3s[887]: I0922 10:44:43.473760 887 shared_informer.go:356] "Caches are synced" controller="crd-autoregister" machine # [ 22.669084] k3s[887]: I0922 10:44:43.473841 887 aggregator.go:187] initial CRD sync complete... machine # [ 22.670240] k3s[887]: I0922 10:44:43.473862 887 autoregister_controller.go:144] Starting autoregister controller machine # [ 22.671657] k3s[887]: I0922 10:44:43.473876 887 cache.go:32] Waiting for caches to sync for autoregister controller machine # [ 22.673129] k3s[887]: I0922 10:44:43.473888 887 cache.go:39] Caches are synced for autoregister controller machine # [ 22.674517] k3s[887]: I0922 10:44:43.479132 887 cidrallocator.go:302] created ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 22.676156] k3s[887]: I0922 10:44:43.480576 887 default_servicecidr_controller.go:231] Setting default ServiceCIDR condition Ready to True machine # [ 22.679758] k3s[887]: I0922 10:44:43.488329 887 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 22.701967] k3s[887]: I0922 10:44:43.511925 887 alloc.go:329] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.43.0.1"} machine # [ 22.707072] k3s[887]: I0922 10:44:43.517027 887 shared_informer.go:356] "Caches are synced" controller="node_authorizer" machine # [ 22.713068] k3s[887]: W0922 10:44:43.520387 887 lease.go:265] Resetting endpoints for master service "kubernetes" to [10.0.2.15] machine # [ 22.714720] k3s[887]: I0922 10:44:43.521723 887 controller.go:667] quota admission added evaluator for: endpoints machine # [ 22.717497] k3s[887]: I0922 10:44:43.527516 887 controller.go:667] quota admission added evaluator for: endpointslices.discovery.k8s.io machine # [ 22.724810] k3s[887]: E0922 10:44:43.534798 887 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service machine # [ 22.967603] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="containerd is now running" machine # [ 22.975864] k3s[887]: time="2026-09-22T10:44:43Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst" machine # [ 23.551709] k3s[887]: I0922 10:44:44.361299 887 storage_scheduling.go:123] created PriorityClass system-node-critical with value 2000001000 machine # [ 23.556230] k3s[887]: I0922 10:44:44.366238 887 storage_scheduling.go:123] created PriorityClass system-cluster-critical with value 2000000000 machine # [ 23.558184] k3s[887]: I0922 10:44:44.366263 887 storage_scheduling.go:139] all system priority classes are created successfully or already exist. machine # [ 23.839329] k3s[887]: time="2026-09-22T10:44:44Z" level=info msg="Polling for API server readiness: GET /readyz failed: unknown" machine # [ 24.480505] k3s[887]: I0922 10:44:45.290449 887 controller.go:667] quota admission added evaluator for: roles.rbac.authorization.k8s.io machine # [ 24.514432] k3s[887]: I0922 10:44:45.324412 887 controller.go:667] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io machine # [ 25.842232] k3s[887]: time="2026-09-22T10:44:46Z" level=info msg="Waiting for untainted node" machine # [ 25.847340] k3s[887]: time="2026-09-22T10:44:46Z" level=info msg="Creating k3s-supervisor event broadcaster" machine # [ 25.848039] k3s[887]: time="2026-09-22T10:44:46Z" level=info msg="Kube API server is now running" machine # [ 25.848549] k3s[887]: time="2026-09-22T10:44:46Z" level=info msg="k3s is up and running" machine # [ 25.849518] systemd[1]: Started k3s service. machine # [ 25.850319] k3s[887]: time="2026-09-22T10:44:46Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=machine reason=CertificateExpirationOK type=Normal machine # [ 25.855311] systemd[1]: Starting niks3 server... machine # [ 25.865602] k3s[887]: I0922 10:44:46.675591 887 controllermanager.go:189] "Starting" version="v1.35.8+k3s1" machine # [ 25.866266] k3s[887]: I0922 10:44:46.675623 887 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 25.873836] k3s[887]: I0922 10:44:46.682929 887 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 25.874519] k3s[887]: I0922 10:44:46.682971 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.875041] k3s[887]: I0922 10:44:46.683018 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 25.875516] k3s[887]: I0922 10:44:46.683036 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.876077] k3s[887]: I0922 10:44:46.683110 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 25.876590] k3s[887]: I0922 10:44:46.683130 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 25.877134] k3s[887]: I0922 10:44:46.683139 887 secure_serving.go:211] Serving securely on 127.0.0.1:10257 machine # [ 25.877545] k3s[887]: I0922 10:44:46.683512 887 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.crt::/var/lib/rancher/k3s/server/tls/kube-controller-manager/kube-controller-manager.key" machine # [ 25.878100] k3s[887]: I0922 10:44:46.683621 887 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 25.887418] k3s[887]: I0922 10:44:46.697404 887 controller.go:667] quota admission added evaluator for: serviceaccounts machine # [ 25.897513] k3s[887]: I0922 10:44:46.707455 887 controllermanager.go:627] "Warning: controller is disabled" controller="bootstrap-signer-controller" machine: (finished: waiting for unit k3s.service, in 27.01 seconds) machine: waiting for success: kubectl get ns farm machine # [ 26.003290] k3s[887]: I0922 10:44:46.813145 887 shared_informer.go:370] "Waiting for caches to sync" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 26.898555] k3s[887]: time="2026-09-22T10:44:47Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" machine # [ 26.900153] k3s[887]: I0922 10:44:47.710135 887 range_allocator.go:113] "No Secondary Service CIDR provided. Skipping filtering out secondary service addresses" logger="node-ipam-controller" machine # [ 26.900815] k3s[887]: I0922 10:44:47.710218 887 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" requiredFeatureGates=["ClusterTrustBundle"] machine # [ 26.901434] k3s[887]: I0922 10:44:47.710255 887 controllermanager.go:579] "Warning: skipping controller" controller="kube-apiserver-serving-clustertrustbundle-publisher-controller" machine # [ 26.903486] k3s[887]: I0922 10:44:47.713432 887 shared_informer.go:377] "Caches are synced" machine # [ 26.911661] k3s[887]: time="2026-09-22T10:44:47Z" level=info msg="Creating embedded CRD etcdsnapshotfiles.k3s.cattle.io" machine # [ 26.921096] k3s[887]: time="2026-09-22T10:44:47Z" level=info msg="Creating embedded CRD helmcharts.helm.cattle.io" machine # [ 26.928755] k3s[887]: I0922 10:44:47.738763 887 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 26.930123] k3s[887]: time="2026-09-22T10:44:47Z" level=info msg="Creating embedded CRD helmchartconfigs.helm.cattle.io" machine # [ 26.936075] k3s[887]: I0922 10:44:47.746051 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="serviceaccounts" machine # [ 26.936788] k3s[887]: I0922 10:44:47.746146 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="podtemplates" machine # [ 26.937621] k3s[887]: I0922 10:44:47.746175 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="daemonsets.apps" machine # [ 26.938195] k3s[887]: I0922 10:44:47.746205 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="statefulsets.apps" machine # [ 26.938739] k3s[887]: I0922 10:44:47.746231 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="jobs.batch" machine # [ 26.940474] k3s[887]: I0922 10:44:47.746260 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="networkpolicies.networking.k8s.io" machine # [ 26.941867] k3s[887]: I0922 10:44:47.746293 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="roles.rbac.authorization.k8s.io" machine # [ 26.942653] k3s[887]: I0922 10:44:47.746327 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="csistoragecapacities.storage.k8s.io" machine # [ 26.943144] k3s[887]: I0922 10:44:47.746353 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="resourceclaimtemplates.resource.k8s.io" machine # [ 26.943797] k3s[887]: I0922 10:44:47.746378 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="ingresses.networking.k8s.io" machine # [ 26.944490] k3s[887]: I0922 10:44:47.746404 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="leases.coordination.k8s.io" machine # [ 26.945031] k3s[887]: I0922 10:44:47.746429 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="rolebindings.rbac.authorization.k8s.io" machine # [ 26.945705] k3s[887]: I0922 10:44:47.746455 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpoints" machine # [ 26.946243] k3s[887]: I0922 10:44:47.746495 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="controllerrevisions.apps" machine # [ 26.946778] k3s[887]: I0922 10:44:47.746520 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="replicasets.apps" machine # [ 26.947490] k3s[887]: I0922 10:44:47.746563 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="horizontalpodautoscalers.autoscaling" machine # [ 26.948190] k3s[887]: I0922 10:44:47.746592 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="cronjobs.batch" machine # [ 26.948691] k3s[887]: I0922 10:44:47.746628 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="addons.k3s.cattle.io" machine # [ 26.949426] k3s[887]: I0922 10:44:47.746698 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="poddisruptionbudgets.policy" machine # [ 26.949924] k3s[887]: time="2026-09-22T10:44:47Z" level=info msg="Waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available" machine # [ 26.979101] k3s[887]: I0922 10:44:47.787591 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="limitranges" machine # [ 26.979663] k3s[887]: I0922 10:44:47.787717 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="deployments.apps" machine # [ 26.981465] k3s[887]: I0922 10:44:47.787765 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" logger="resourcequota-controller" resource="endpointslices.discovery.k8s.io" machine # [ 26.982113] k3s[887]: I0922 10:44:47.788825 887 shared_informer.go:377] "Caches are synced" machine # [ 26.982599] k3s[887]: I0922 10:44:47.788941 887 shared_informer.go:377] "Caches are synced" machine # [ 26.983114] k3s[887]: I0922 10:44:47.789007 887 shared_informer.go:377] "Caches are synced" machine # [ 26.990654] k3s[887]: I0922 10:44:47.800640 887 handler.go:304] Adding GroupVersion k3s.cattle.io v1 to ResourceManager machine # [ 27.007573] k3s[887]: I0922 10:44:47.817568 887 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 27.015682] k3s[887]: I0922 10:44:47.825644 887 handler.go:304] Adding GroupVersion helm.cattle.io v1 to ResourceManager machine # [ 27.039687] k3s[887]: I0922 10:44:47.849643 887 node_lifecycle_controller.go:419] "Controller will reconcile labels" logger="node-lifecycle-controller" machine # [ 27.215992] k3s[887]: W0922 10:44:48.025871 887 probe.go:272] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating. machine # Error from server (NotFound): namespaces "farm" not found machine # [ 27.496905] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Done waiting for CRD etcdsnapshotfiles.k3s.cattle.io to become available" machine # [ 27.497790] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 27.509069] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" machine # [ 27.509932] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 27.515493] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" machine # [ 27.515994] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.4+up40.1.0.tgz" machine # [ 27.516742] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.4+up40.1.0.tgz" machine # [ 27.517661] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" machine # [ 27.518202] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" machine # [ 27.518798] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" machine # [ 27.519576] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" machine # [ 27.520192] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" machine # [ 27.520773] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" machine # [ 27.657600] k3s[887]: I0922 10:44:48.467515 887 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="podcertificaterequest-cleaner-controller" requiredFeatureGates=["PodCertificateRequest"] machine # [ 27.658398] k3s[887]: I0922 10:44:48.467558 887 controllermanager.go:579] "Warning: skipping controller" controller="podcertificaterequest-cleaner-controller" machine # [ 27.662756] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Tunnel server egress proxy mode: agent" machine # [ 27.663595] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost machine 10.0.2.15 fec0::8e8d:ea40:7aff:8a9b 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" machine # [ 27.827422] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Imported docker.io/rancher/klipper-helm:v0.13.3-build20260727" machine # [ 27.832865] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Tagged docker.io/rancher/klipper-helm@sha256:5425a2b4613d2458dbdff99218e8d487ebb59c20e7a941f061c0777070f0aac1" machine # [ 27.833413] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Imported docker.io/rancher/klipper-lb:v0.4.17" machine # [ 27.834697] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Tagged docker.io/rancher/klipper-lb@sha256:910944bb0bd94f060a82a56ca1ea1c577d3e49b3473a093a47a985f32e92d94a" machine # [ 27.835677] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Imported docker.io/rancher/local-path-provisioner:v0.0.37" machine # [ 27.837051] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Tagged docker.io/rancher/local-path-provisioner@sha256:e757967a5ec338f6a9b371c5a9688bedaa8c3578ea3dd4db329ea0084be0a86f" machine # [ 27.837784] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Imported docker.io/rancher/mirrored-coredns-coredns:1.14.6" machine # [ 27.838966] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Tagged docker.io/rancher/mirrored-coredns-coredns@sha256:900f9c109f7a33545d3c811516e8376df9019147b750f5ce3e254468769176ea" machine # [ 27.839645] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Imported docker.io/rancher/mirrored-library-busybox:1.37.0" machine # [ 27.842191] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Tagged docker.io/rancher/mirrored-library-busybox@sha256:101b4afd76732482eff9b95cae5f94bcf295e521fbec4e01b69c5421f3f3f3e5" machine # [ 27.843262] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Imported docker.io/rancher/mirrored-library-traefik:3.7.8" machine # [ 27.844037] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Tagged docker.io/rancher/mirrored-library-traefik@sha256:4299bbed850421258fc5448c2e0e6ad350981d4d335a68de11b92448aedbefe5" machine # [ 27.845031] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Imported docker.io/rancher/mirrored-metrics-server:v0.9.0" machine # [ 27.847081] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Tagged docker.io/rancher/mirrored-metrics-server@sha256:d9862115e7c7881280d3d75ca26bda8ffc0fc213315979575bf23ce9826205c0" machine # [ 27.847712] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Imported docker.io/rancher/mirrored-pause:3.10.2" machine # [ 27.860100] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Tagged docker.io/rancher/mirrored-pause@sha256:f548e0e8e3dc1896ca956272154dde3314e8cc4fde0a57577ee9fa1c63f5baf4" machine # [ 27.955740] k3s[887]: I0922 10:44:48.765329 887 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="storageversion-garbage-collector-controller" requiredFeatureGates=["APIServerIdentity","StorageVersionAPI"] machine # [ 27.956750] k3s[887]: I0922 10:44:48.765369 887 controllermanager.go:579] "Warning: skipping controller" controller="storageversion-garbage-collector-controller" machine # [ 27.999872] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Creating new TLS secret for kube-system/k3s-serving (count: 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__8e8d_ea40_7aff_8a9b-bf3d6e:fec0::8e8d:ea40:7aff:8a9b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=F14BAB3BF79F87D967062E59D7A55678F0DB9678]" machine # [ 28.007855] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=239) (count 11): map[listener.cattle.io/cn-10.0.2.15:10.0.2.15 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-fec0__8e8d_ea40_7aff_8a9b-bf3d6e:fec0::8e8d:ea40:7aff:8a9b listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-machine:machine listener.cattle.io/fingerprint:SHA1=F14BAB3BF79F87D967062E59D7A55678F0DB9678]" machine # [ 28.085837] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Imported 8 images from /var/lib/rancher/k3s/agent/images/k3s-airgap-images-amd64.tar.zst in 5.110602324s" machine # [ 28.088731] k3s[887]: time="2026-09-22T10:44:48Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar" machine # [ 28.656918] k3s[887]: I0922 10:44:49.466856 887 controllermanager.go:627] "Warning: controller is disabled" controller="node-route-controller" machine # [ 28.658279] k3s[887]: I0922 10:44:49.466894 887 controllermanager.go:579] "Warning: skipping controller" controller="storage-version-migrator-controller" machine # [ 28.658424] k3s[887]: I0922 10:44:49.466907 887 controllermanager.go:627] "Warning: controller is disabled" controller="selinux-warning-controller" machine # Error from server (NotFound): namespaces "farm" not found machine # [ 28.873900] k3s[887]: time="2026-09-22T10:44:49Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" machine # [ 28.874871] k3s[887]: time="2026-09-22T10:44:49Z" level=info msg="Creating deploy event broadcaster" machine # [ 28.879854] k3s[887]: I0922 10:44:49.689864 887 controller.go:667] quota admission added evaluator for: addons.k3s.cattle.io machine # [ 28.881678] k3s[887]: time="2026-09-22T10:44:49Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 28.882960] k3s[887]: time="2026-09-22T10:44:49Z" level=info msg="Creating helm-controller event broadcaster" machine # [ 28.888824] k3s[887]: time="2026-09-22T10:44:49Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 28.891185] k3s[887]: time="2026-09-22T10:44:49Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=ApplyingManifest type=Normal machine # [ 28.897184] k3s[887]: time="2026-09-22T10:44:49Z" level=info msg="Cluster dns configmap has been set successfully" machine # [ 29.361051] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\"" object=kube-system/ccm reason=AppliedManifest type=Normal machine # [ 29.372085] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=ApplyingManifest type=Normal machine # [ 29.505320] k3s[887]: I0922 10:44:50.315265 887 controller_descriptor.go:99] "Controller is disabled by a feature gate" controller="device-taint-eviction-controller" requiredFeatureGates=["DynamicResourceAllocation","DRADeviceTaints"] machine # [ 29.508325] k3s[887]: I0922 10:44:50.315297 887 controllermanager.go:579] "Warning: skipping controller" controller="device-taint-eviction-controller" machine # [ 29.659185] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ci.yaml\"" object=kube-system/ci reason=AppliedManifest type=Normal machine # [ 29.667069] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=ApplyingManifest type=Normal machine # [ 29.854192] k3s[887]: I0922 10:44:50.664135 887 controllermanager.go:627] "Warning: controller is disabled" controller="service-lb-controller" machine # [ 29.883943] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine: (finished: waiting for success: kubectl get ns farm, in 3.94 seconds) machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key machine # [ 29.989366] k3s[887]: I0922 10:44:50.799236 887 serving.go:392] Generated self-signed cert in-memory machine # [ 29.999530] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller" machine # [ 30.004240] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Starting batch/v1, Kind=Job controller" machine # [ 30.005598] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Starting /v1, Kind=ConfigMap controller" machine # [ 30.006935] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Starting /v1, Kind=ServiceAccount controller" machine # [ 30.008401] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Starting /v1, Kind=Secret controller" machine # [ 30.012952] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" machine # [ 30.014562] k3s[887]: time="2026-09-22T10:44:50Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" machine # [ 30.029972] k3s[887]: I0922 10:44:50.839917 887 serving.go:392] Generated self-signed cert in-memory machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb.key, in 0.26 seconds) machine: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key machine # [ 30.191750] k3s[887]: I0922 10:44:51.000738 887 controllermanager.go:160] Version: v1.35.8+k3s1 machine # [ 30.194707] k3s[887]: I0922 10:44:51.004710 887 secure_serving.go:211] Serving securely on 127.0.0.1:10258 machine # [ 30.196183] k3s[887]: I0922 10:44:51.005143 887 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 30.197659] k3s[887]: I0922 10:44:51.005238 887 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 30.199200] k3s[887]: I0922 10:44:51.005260 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.200509] k3s[887]: I0922 10:44:51.005325 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 30.202891] k3s[887]: I0922 10:44:51.005344 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.204652] k3s[887]: I0922 10:44:51.005374 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 30.207853] k3s[887]: I0922 10:44:51.005390 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.209602] k3s[887]: time="2026-09-22T10:44:51Z" level=info msg="Creating service-lb-controller event broadcaster" machine # [ 30.295961] k3s[887]: I0922 10:44:51.105587 887 shared_informer.go:377] "Caches are synced" machine # [ 30.297274] k3s[887]: I0922 10:44:51.105631 887 shared_informer.go:377] "Caches are synced" machine # [ 30.298665] k3s[887]: I0922 10:44:51.105690 887 shared_informer.go:377] "Caches are synced" machine # [ 30.363115] k3s[887]: I0922 10:44:51.172632 887 controller.go:667] quota admission added evaluator for: deployments.apps machine: (finished: must succeed: kubectl -n farm create secret tls farm-worker-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/worker.key, in 0.21 seconds) machine: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine # [ 30.454536] k3s[887]: I0922 10:44:51.264472 887 controllermanager.go:627] "Warning: controller is disabled" controller="cloud-node-lifecycle-controller" machine: (finished: must succeed: kubectl -n farm create secret generic farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.21 seconds) subtest: chart deploys and workers become Ready machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine # [ 30.587810] k3s[887]: I0922 10:44:51.397637 887 alloc.go:329] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.43.0.10"} machine # [ 30.589991] k3s[887]: time="2026-09-22T10:44:51Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\"" object=kube-system/coredns reason=AppliedManifest type=Normal machine # [ 30.667291] k3s[887]: time="2026-09-22T10:44:51Z" level=info msg="Starting /v1, Kind=Node controller" machine # [ 30.671949] k3s[887]: time="2026-09-22T10:44:51Z" level=info msg="Starting /v1, Kind=Pod controller" machine # [ 30.678558] k3s[887]: time="2026-09-22T10:44:51Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller" machine # [ 30.683669] k3s[887]: time="2026-09-22T10:44:51Z" level=info msg="Starting discovery.k8s.io/v1, Kind=EndpointSlice controller" machine # [ 30.685835] k3s[887]: I0922 10:44:51.495446 887 controllermanager.go:329] Started "cloud-node-controller" machine # [ 30.687701] k3s[887]: I0922 10:44:51.495561 887 controllermanager.go:329] Started "cloud-node-lifecycle-controller" machine # [ 30.689825] k3s[887]: I0922 10:44:51.495879 887 controllermanager.go:329] Started "service-lb-controller" machine # [ 30.691655] k3s[887]: W0922 10:44:51.495892 887 controllermanager.go:306] "node-route-controller" is disabled machine # [ 30.693060] k3s[887]: I0922 10:44:51.496271 887 node_controller.go:176] Sending events to api server. machine # [ 30.694376] k3s[887]: I0922 10:44:51.496319 887 node_lifecycle_controller.go:112] Sending events to api server machine # [ 30.695925] k3s[887]: I0922 10:44:51.496524 887 controller.go:235] Starting service controller machine # [ 30.697223] k3s[887]: I0922 10:44:51.496543 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.698756] k3s[887]: I0922 10:44:51.496606 887 node_controller.go:185] Waiting for informer caches to sync machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 30.884763] k3s[887]: time="2026-09-22T10:44:51Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 30.907130] k3s[887]: I0922 10:44:51.717112 887 pv_protection_controller.go:81] "Starting PV protection controller" machine # [ 30.908735] k3s[887]: I0922 10:44:51.717148 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.910199] k3s[887]: I0922 10:44:51.718231 887 expand_controller.go:328] "Starting expand controller" machine # [ 30.911606] k3s[887]: I0922 10:44:51.718263 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.912926] k3s[887]: I0922 10:44:51.718389 887 daemon_controller.go:309] "Starting daemon sets controller" machine # [ 30.914368] k3s[887]: I0922 10:44:51.718412 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.915709] k3s[887]: I0922 10:44:51.718532 887 job_controller.go:254] "Starting job controller" machine # [ 30.917074] k3s[887]: I0922 10:44:51.718547 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.918531] k3s[887]: I0922 10:44:51.718590 887 clusterroleaggregation_controller.go:194] "Starting ClusterRoleAggregator controller" machine # [ 30.920353] k3s[887]: I0922 10:44:51.718592 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.921891] k3s[887]: I0922 10:44:51.718607 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.923372] k3s[887]: I0922 10:44:51.718646 887 pvc_protection_controller.go:166] "Starting PVC protection controller" machine # [ 30.924987] k3s[887]: I0922 10:44:51.718669 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.926456] k3s[887]: I0922 10:44:51.718712 887 deployment_controller.go:172] "Starting controller" controller="deployment" machine # [ 30.928152] k3s[887]: I0922 10:44:51.718716 887 legacy_serviceaccount_token_cleaner.go:103] "Starting legacy service account token cleaner controller" machine # [ 30.930219] k3s[887]: I0922 10:44:51.718728 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.931750] k3s[887]: I0922 10:44:51.718731 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.933230] k3s[887]: I0922 10:44:51.718799 887 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-legacy-unknown" machine # [ 30.935210] k3s[887]: I0922 10:44:51.718809 887 endpointslicemirroring_controller.go:226] "Starting EndpointSliceMirroring controller" machine # [ 30.936905] k3s[887]: I0922 10:44:51.718814 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.938287] k3s[887]: I0922 10:44:51.718822 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.939641] k3s[887]: I0922 10:44:51.718898 887 namespace_controller.go:202] "Starting namespace controller" machine # [ 30.941144] k3s[887]: I0922 10:44:51.718913 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.942771] k3s[887]: I0922 10:44:51.718951 887 node_ipam_controller.go:142] "Starting ipam controller" machine # [ 30.944433] k3s[887]: I0922 10:44:51.718966 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.946052] k3s[887]: I0922 10:44:51.718992 887 cronjob_controllerv2.go:143] "Starting cronjob controller v2" machine # [ 30.947863] k3s[887]: I0922 10:44:51.719006 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.949553] k3s[887]: I0922 10:44:51.719016 887 taint_eviction.go:283] "Starting" controller="taint-eviction-controller" machine # [ 30.951369] k3s[887]: I0922 10:44:51.719099 887 taint_eviction.go:288] "Sending events to API server" machine # [ 30.952607] k3s[887]: I0922 10:44:51.719110 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.953834] k3s[887]: I0922 10:44:51.719122 887 replica_set.go:241] "Starting controller" name="replicationcontroller" machine # [ 30.955253] k3s[887]: I0922 10:44:51.719138 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.956459] k3s[887]: I0922 10:44:51.719365 887 ttl_controller.go:127] "Starting TTL controller" machine # [ 30.957890] k3s[887]: I0922 10:44:51.719368 887 serviceaccounts_controller.go:117] "Starting service account controller" machine # [ 30.959877] k3s[887]: I0922 10:44:51.719380 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.961426] k3s[887]: I0922 10:44:51.719384 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.963047] k3s[887]: I0922 10:44:51.719420 887 publisher.go:107] "Starting root CA cert publisher controller" machine # [ 30.964756] k3s[887]: I0922 10:44:51.719436 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.966400] k3s[887]: I0922 10:44:51.719478 887 replica_set.go:241] "Starting controller" name="replicaset" machine # [ 30.968058] k3s[887]: I0922 10:44:51.719486 887 controller.go:174] "Starting ephemeral volume controller" machine # [ 30.969876] k3s[887]: I0922 10:44:51.719495 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.971437] k3s[887]: I0922 10:44:51.719501 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.973049] k3s[887]: I0922 10:44:51.719532 887 vac_protection_controller.go:206] "Starting VAC protection controller" machine # [ 30.974975] k3s[887]: I0922 10:44:51.719567 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.976695] k3s[887]: I0922 10:44:51.719609 887 ttlafterfinished_controller.go:112] "Starting TTL after finished controller" machine # [ 30.978721] k3s[887]: I0922 10:44:51.719623 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.980393] k3s[887]: I0922 10:44:51.719612 887 servicecidrs_controller.go:136] "Starting" controller="service-cidr-controller" machine # [ 30.982030] k3s[887]: I0922 10:44:51.719639 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.983280] k3s[887]: I0922 10:44:51.719665 887 tokencleaner.go:117] "Starting token cleaner controller" machine # [ 30.984541] k3s[887]: I0922 10:44:51.719679 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.985785] k3s[887]: I0922 10:44:51.719695 887 gc_controller.go:98] "Starting GC controller" machine # [ 30.987035] k3s[887]: I0922 10:44:51.719710 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.988590] k3s[887]: I0922 10:44:51.719734 887 node_lifecycle_controller.go:453] "Sending events to api server" machine # [ 30.990149] k3s[887]: I0922 10:44:51.719749 887 horizontal.go:204] "Starting HPA controller" machine # [ 30.991619] k3s[887]: I0922 10:44:51.719764 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.993149] k3s[887]: I0922 10:44:51.719800 887 disruption.go:458] "Sending events to api server." machine # [ 30.994721] k3s[887]: I0922 10:44:51.719831 887 endpoints_controller.go:193] "Starting endpoint controller" machine # [ 30.996524] k3s[887]: I0922 10:44:51.719840 887 disruption.go:465] "Starting disruption controller" machine # [ 30.998199] k3s[887]: I0922 10:44:51.719845 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 30.999794] k3s[887]: I0922 10:44:51.719852 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.001414] k3s[887]: I0922 10:44:51.719891 887 cleaner.go:83] "Starting CSR cleaner controller" machine # [ 31.003056] k3s[887]: I0922 10:44:51.719929 887 endpointslice_controller.go:283] "Starting endpoint slice controller" machine # [ 31.004930] k3s[887]: I0922 10:44:51.719943 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.006607] k3s[887]: I0922 10:44:51.720003 887 controller.go:423] "Starting resource claim controller" machine # [ 31.008534] k3s[887]: I0922 10:44:51.720020 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.010205] k3s[887]: I0922 10:44:51.720028 887 stateful_set.go:180] "Starting stateful set controller" machine # [ 31.012026] k3s[887]: I0922 10:44:51.720043 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.013287] k3s[887]: I0922 10:44:51.720097 887 certificate_controller.go:120] "Starting certificate controller" name="csrapproving" machine # [ 31.014984] k3s[887]: I0922 10:44:51.720113 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.016332] k3s[887]: I0922 10:44:51.720121 887 pv_controller_base.go:307] "Starting persistent volume controller" machine # [ 31.017790] k3s[887]: I0922 10:44:51.720136 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.019088] k3s[887]: I0922 10:44:51.720203 887 attach_detach_controller.go:335] "Starting attach detach controller" machine # [ 31.020544] k3s[887]: I0922 10:44:51.720218 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.021893] k3s[887]: I0922 10:44:51.720321 887 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-serving" machine # [ 31.023751] k3s[887]: I0922 10:44:51.720336 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.025030] k3s[887]: I0922 10:44:51.720370 887 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kubelet-client" machine # [ 31.026793] k3s[887]: I0922 10:44:51.720382 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.028515] k3s[887]: I0922 10:44:51.720417 887 certificate_controller.go:120] "Starting certificate controller" name="csrsigning-kube-apiserver-client" machine # [ 31.030973] k3s[887]: I0922 10:44:51.720432 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.032791] k3s[887]: I0922 10:44:51.720466 887 garbagecollector.go:141] "Starting controller" controller="garbagecollector" machine # [ 31.034774] k3s[887]: I0922 10:44:51.720475 887 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 31.038872] k3s[887]: I0922 10:44:51.720497 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.039530] k3s[887]: I0922 10:44:51.719765 887 node_lifecycle_controller.go:460] "Starting node controller" machine # [ 31.040143] k3s[887]: I0922 10:44:51.720562 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.040645] k3s[887]: I0922 10:44:51.720642 887 resource_quota_controller.go:297] "Starting resource quota controller" machine # [ 31.041188] k3s[887]: I0922 10:44:51.720666 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.041690] k3s[887]: I0922 10:44:51.719534 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.042205] k3s[887]: I0922 10:44:51.720774 887 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/server-ca.key" machine # [ 31.042735] k3s[887]: I0922 10:44:51.720844 887 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 31.043588] k3s[887]: I0922 10:44:51.720915 887 dynamic_serving_content.go:135] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.nochain.crt::/var/lib/rancher/k3s/server/tls/client-ca.key" machine # [ 31.047142] k3s[887]: I0922 10:44:51.721215 887 resource_quota_monitor.go:309] "QuotaMonitor running" machine # [ 31.047887] k3s[887]: I0922 10:44:51.720775 887 graph_builder.go:386] "Running" component="GraphBuilder" machine # [ 31.048375] k3s[887]: I0922 10:44:51.727169 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmchartconfigs.helm.cattle.io" machine # [ 31.048917] k3s[887]: I0922 10:44:51.727214 887 resource_quota_monitor.go:229] "QuotaMonitor created object count evaluator" resource="helmcharts.helm.cattle.io" machine # [ 31.049564] k3s[887]: I0922 10:44:51.727276 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.050053] k3s[887]: I0922 10:44:51.796657 887 shared_informer.go:377] "Caches are synced" machine # [ 31.050625] k3s[887]: I0922 10:44:51.834844 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.088498] k3s[887]: time="2026-09-22T10:44:51Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Deferred node password secret validation complete" object=machine reason=NodePasswordValidationComplete type=Normal machine # [ 31.107275] k3s[887]: I0922 10:44:51.917263 887 shared_informer.go:377] "Caches are synced" machine # [ 31.109202] k3s[887]: I0922 10:44:51.918998 887 shared_informer.go:377] "Caches are synced" machine # [ 31.109893] k3s[887]: I0922 10:44:51.919037 887 shared_informer.go:377] "Caches are synced" machine # [ 31.110729] k3s[887]: I0922 10:44:51.919053 887 shared_informer.go:377] "Caches are synced" machine # [ 31.111497] k3s[887]: I0922 10:44:51.919103 887 range_allocator.go:177] "Sending events to api server" machine # [ 31.111982] k3s[887]: I0922 10:44:51.919153 887 shared_informer.go:377] "Caches are synced" machine # [ 31.112826] k3s[887]: I0922 10:44:51.919166 887 shared_informer.go:377] "Caches are synced" machine # [ 31.113519] k3s[887]: I0922 10:44:51.919215 887 shared_informer.go:377] "Caches are synced" machine # [ 31.114111] k3s[887]: I0922 10:44:51.919220 887 shared_informer.go:377] "Caches are synced" machine # [ 31.115098] k3s[887]: I0922 10:44:51.919282 887 shared_informer.go:377] "Caches are synced" machine # [ 31.115721] k3s[887]: I0922 10:44:51.919340 887 shared_informer.go:377] "Caches are synced" machine # [ 31.116643] k3s[887]: I0922 10:44:51.919447 887 shared_informer.go:377] "Caches are synced" machine # [ 31.117537] k3s[887]: I0922 10:44:51.919485 887 shared_informer.go:377] "Caches are synced" machine # [ 31.118176] k3s[887]: I0922 10:44:51.919798 887 shared_informer.go:377] "Caches are synced" machine # [ 31.118946] k3s[887]: I0922 10:44:51.919867 887 shared_informer.go:377] "Caches are synced" machine # [ 31.119800] k3s[887]: I0922 10:44:51.919888 887 shared_informer.go:377] "Caches are synced" machine # [ 31.120660] k3s[887]: I0922 10:44:51.919914 887 shared_informer.go:377] "Caches are synced" machine # [ 31.121541] k3s[887]: I0922 10:44:51.919958 887 range_allocator.go:181] "Starting range CIDR allocator" machine # [ 31.122159] k3s[887]: I0922 10:44:51.919960 887 shared_informer.go:377] "Caches are synced" machine # [ 31.122651] k3s[887]: I0922 10:44:51.919970 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 31.122882] k3s[887]: I0922 10:44:51.919983 887 shared_informer.go:377] "Caches are synced" machine # [ 31.123365] k3s[887]: I0922 10:44:51.920045 887 shared_informer.go:377] "Caches are synced" machine # [ 31.124076] k3s[887]: I0922 10:44:51.920115 887 shared_informer.go:377] "Caches are synced" machine # [ 31.124756] k3s[887]: I0922 10:44:51.920144 887 shared_informer.go:377] "Caches are synced" machine # [ 31.125225] k3s[887]: I0922 10:44:51.920264 887 shared_informer.go:377] "Caches are synced" machine # [ 31.125949] k3s[887]: I0922 10:44:51.920388 887 shared_informer.go:377] "Caches are synced" machine # [ 31.126897] k3s[887]: I0922 10:44:51.920423 887 shared_informer.go:377] "Caches are synced" machine # [ 31.127838] k3s[887]: I0922 10:44:51.920462 887 shared_informer.go:377] "Caches are synced" machine # [ 31.128752] k3s[887]: I0922 10:44:51.920512 887 shared_informer.go:377] "Caches are synced" machine # [ 31.129646] k3s[887]: I0922 10:44:51.920567 887 shared_informer.go:377] "Caches are synced" machine # [ 31.130518] k3s[887]: I0922 10:44:51.920586 887 shared_informer.go:377] "Caches are synced" machine # [ 31.131165] k3s[887]: I0922 10:44:51.920627 887 shared_informer.go:377] "Caches are synced" machine # [ 31.131822] k3s[887]: I0922 10:44:51.920732 887 shared_informer.go:377] "Caches are synced" machine # [ 31.132714] k3s[887]: I0922 10:44:51.920805 887 shared_informer.go:377] "Caches are synced" machine # [ 31.132920] k3s[887]: I0922 10:44:51.920840 887 shared_informer.go:377] "Caches are synced" machine # [ 31.133751] k3s[887]: I0922 10:44:51.920876 887 shared_informer.go:377] "Caches are synced" machine # [ 31.133994] k3s[887]: I0922 10:44:51.920890 887 shared_informer.go:377] "Caches are synced" machine # [ 31.134561] k3s[887]: I0922 10:44:51.920905 887 shared_informer.go:377] "Caches are synced" machine # [ 31.135084] k3s[887]: I0922 10:44:51.921018 887 shared_informer.go:377] "Caches are synced" machine # [ 31.135619] k3s[887]: I0922 10:44:51.921065 887 shared_informer.go:377] "Caches are synced" machine # [ 31.136162] k3s[887]: I0922 10:44:51.921430 887 shared_informer.go:377] "Caches are synced" machine # [ 31.136696] k3s[887]: I0922 10:44:51.921478 887 shared_informer.go:377] "Caches are synced" machine # [ 31.137433] k3s[887]: I0922 10:44:51.921701 887 shared_informer.go:377] "Caches are synced" machine # [ 31.137959] k3s[887]: I0922 10:44:51.922002 887 shared_informer.go:377] "Caches are synced" machine # [ 31.138707] k3s[887]: I0922 10:44:51.922285 887 shared_informer.go:377] "Caches are synced" machine # [ 31.139517] k3s[887]: I0922 10:44:51.927418 887 shared_informer.go:377] "Caches are synced" machine # [ 31.459549] k3s[887]: I0922 10:44:52.269108 887 controller.go:667] quota admission added evaluator for: replicasets.apps machine # [ 31.515830] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\"" object=kube-system/local-storage reason=DeletingManifest type=Normal machine # [ 31.527144] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=ApplyingManifest type=Normal machine # [ 31.621974] k3s[887]: I0922 10:44:52.431933 887 controller.go:667] quota admission added evaluator for: helmcharts.helm.cattle.io machine # [ 31.627902] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/nix-grpc-farm.yaml\"" object=kube-system/nix-grpc-farm reason=AppliedManifest type=Normal machine # [ 31.639644] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=ApplyingManifest type=Normal machine # [ 31.760488] k3s[887]: I0922 10:44:52.570359 887 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 31.763492] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Applying HelmChart from https://%{KUBERNETES_API}%/static/charts/nix-grpc-farm.tgz using Job kube-system/helm-install-nix-grpc-farm " object=kube-system/nix-grpc-farm reason=ApplyJob type=Normal machine # [ 31.767975] k3s[887]: I0922 10:44:52.574345 887 cidrallocator.go:278] updated ClusterIP allocator for Service CIDR 10.43.0.0/16 machine # [ 31.784067] k3s[887]: I0922 10:44:52.593984 887 controller.go:667] quota admission added evaluator for: jobs.batch machine # [ 31.800101] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\"" object=kube-system/rolebindings reason=AppliedManifest type=Normal machine # [ 31.811071] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applying manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=ApplyingManifest type=Normal machine # [ 31.885892] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 31.951550] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Applied manifest at \"/var/lib/rancher/k3s/server/manifests/runtimes.yaml\"" object=kube-system/runtimes reason=AppliedManifest type=Normal machine # [ 32.022172] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=k3s.cattle.io/v1 fieldPath= kind=Addon logger=k3s/deploy message="Deleting manifest at \"/var/lib/rancher/k3s/server/manifests/traefik.yaml\"" object=kube-system/traefik reason=DeletingManifest type=Normal machine # [ 32.029083] k3s[887]: time="2026-09-22T10:44:52Z" level=info msg="Event occurred" apiVersion=helm.cattle.io/v1 fieldPath= kind=HelmChart logger=k3s/helm-controller message="Resumed synced Job kube-system/helm-install-nix-grpc-farm" object=kube-system/nix-grpc-farm reason=ResumeJob type=Normal machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 32.885056] k3s[887]: time="2026-09-22T10:44:53Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 32.911760] k3s[887]: I0922 10:44:53.721713 887 shared_informer.go:377] "Caches are synced" machine # [ 32.912597] k3s[887]: I0922 10:44:53.721739 887 garbagecollector.go:166] "Garbage collector: all resource monitors have synced" machine # [ 32.913118] k3s[887]: I0922 10:44:53.721751 887 garbagecollector.go:169] "Proceeding to collect garbage" machine # [ 32.925621] k3s[887]: I0922 10:44:53.735601 887 shared_informer.go:377] "Caches are synced" machine # [ 33.126661] postgres[1210]: [1210] ERROR: relation "goose_db_version" does not exist at character 36 machine # [ 33.127675] postgres[1210]: [1210] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC machine # [ 33.163154] niks3-server[1194]: 2026/09/22 10:44:53 OK 20241026095416_initial_model.sql (13.68ms) machine # [ 33.168285] niks3-server[1194]: 2026/09/22 10:44:53 OK 20251210153512_drop_unused_gin_index.sql (2.6ms) machine # [ 33.173336] niks3-server[1194]: 2026/09/22 10:44:53 OK 20251218171726_add_pins.sql (5.01ms) machine # [ 33.179170] niks3-server[1194]: 2026/09/22 10:44:53 OK 20260628120000_add_object_size_and_stats.sql (5.71ms) machine # [ 33.183507] niks3-server[1194]: 2026/09/22 10:44:53 OK 20260905000000_add_claims.sql (4.23ms) machine # [ 33.187871] niks3-server[1194]: 2026/09/22 10:44:53 OK 20260920000000_drop_claims.sql (4.33ms) machine # [ 33.188837] niks3-server[1194]: 2026/09/22 10:44:53 goose: successfully migrated database to version: 20260920000000 machine # [ 33.196050] niks3-server[1194]: 2026/09/22 10:44:54 OK 1_commit_pending_closure.sql (8.08ms) machine # [ 33.199115] niks3-server[1194]: 2026/09/22 10:44:54 OK 2_object_stats_trigger.sql (3.05ms) machine # [ 33.199815] niks3-server[1194]: 2026/09/22 10:44:54 goose: up to current file version: 2 machine # [ 33.220385] niks3-server[1194]: 2026/09/22 10:44:54 INFO OIDC provider initialized name=kubernetes issuer=https://kubernetes.default.svc.cluster.local machine # [ 33.221231] niks3-server[1194]: 2026/09/22 10:44:54 INFO OIDC authentication enabled config=/nix/store/2xcn0lgmca14rg9xzcfqj65j9hs85hn6-niks3-oidc.json machine # [ 33.222850] niks3-server[1194]: 2026/09/22 10:44:54 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key machine # [ 33.300347] niks3-server[1194]: 2026/09/22 10:44:54 INFO Read proxy enabled — serving cache objects from S3 machine # [ 33.302324] niks3-server[1194]: 2026/09/22 10:44:54 INFO Using socket-activated listener address=0.0.0.0:5751 machine # [ 33.304178] niks3-server[1194]: 2026/09/22 10:44:54 INFO systemd watchdog enabled interval=15s machine # [ 33.306114] systemd[1]: Started niks3 server. machine # [ 33.307162] niks3-server[1194]: 2026/09/22 10:44:54 INFO Starting HTTP server address=0.0.0.0:5751 machine # [ 33.308754] systemd[1]: Reached target Multi-User System. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 33.311104] systemd[1]: Startup finished in 1.108s (kernel) + 4.110s (initrd) + 28.085s (userspace) = 33.304s. machine # [ 33.884616] k3s[887]: time="2026-09-22T10:44:54Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 34.885372] k3s[887]: time="2026-09-22T10:44:55Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 34.899867] k3s[887]: time="2026-09-22T10:44:55Z" level=info msg="Started tunnel to 10.0.2.15:6443" machine # [ 34.900770] k3s[887]: time="2026-09-22T10:44:55Z" level=info msg="Stopped tunnel to 127.0.0.1:6443" machine # [ 34.901226] k3s[887]: time="2026-09-22T10:44:55Z" level=info msg="Connecting to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 34.901703] k3s[887]: time="2026-09-22T10:44:55Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect" machine # [ 34.906127] k3s[887]: time="2026-09-22T10:44:55Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF" machine # [ 34.907426] k3s[887]: time="2026-09-22T10:44:55Z" level=info msg="Handling backend connection request [machine]" machine # [ 34.908194] k3s[887]: time="2026-09-22T10:44:55Z" level=info msg="Connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # [ 34.908738] k3s[887]: time="2026-09-22T10:44:55Z" level=info msg="Remotedialer connected to proxy" url="wss://10.0.2.15:6443/v1-k3s/connect" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 35.885059] k3s[887]: time="2026-09-22T10:44:56Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 36.885410] k3s[887]: time="2026-09-22T10:44:57Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 37.886348] k3s[887]: time="2026-09-22T10:44:58Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 38.885132] k3s[887]: time="2026-09-22T10:44:59Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 39.885411] k3s[887]: time="2026-09-22T10:45:00Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 40.886703] k3s[887]: time="2026-09-22T10:45:01Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 41.341636] k3s[887]: time="2026-09-22T10:45:02Z" level=info msg="Imported docker.io/library/nix-grpc-farm-client:0.1.0-beta.1" machine # [ 41.347116] k3s[887]: time="2026-09-22T10:45:02Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-client@sha256:22aa8ef08220377da516eb76d2e802a59013f9edb4f3bf42267fb3b8ec4583c0" machine # [ 41.709524] k3s[887]: time="2026-09-22T10:45:02Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-client.tar in 13.621029487s" machine # [ 41.711400] k3s[887]: time="2026-09-22T10:45:02Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 41.886260] k3s[887]: time="2026-09-22T10:45:02Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 42.886230] k3s[887]: time="2026-09-22T10:45:03Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 43.884417] k3s[887]: time="2026-09-22T10:45:04Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 44.884801] k3s[887]: time="2026-09-22T10:45:05Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 45.697688] k3s[887]: time="2026-09-22T10:45:06Z" level=info msg="Imported docker.io/library/nix-grpc-farm-lb:0.1.0-beta.1" machine # [ 45.704305] k3s[887]: time="2026-09-22T10:45:06Z" level=info msg="Tagged docker.io/library/nix-grpc-farm-lb@sha256:a3fb275e15335967c368c203214cabcce2886a8867fcd31c07e4effd2ad9a5ec" machine # [ 45.745738] k3s[887]: time="2026-09-22T10:45:06Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm-lb.tar in 4.035274036s" machine # [ 45.747858] k3s[887]: time="2026-09-22T10:45:06Z" level=info msg="Importing images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar" machine # [ 45.887495] k3s[887]: time="2026-09-22T10:45:06Z" level=info msg="Unable to set control-plane role label: nodes \"machine\" not found" machine # [ 45.997652] k3s[887]: time="2026-09-22T10:45:06Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=nodefs.available<1%,imagefs.available<1% --hostname-override=machine --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.0.2.15,fec0::8e8d:ea40:7aff:8a9b --node-labels= --read-only-port=0" machine # [ 46.003211] k3s[887]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. machine # [ 46.020986] k3s[887]: I0922 10:45:06.830958 887 server.go:521] "Kubelet version" kubeletVersion="v1.35.8+k3s1" machine # [ 46.021700] k3s[887]: I0922 10:45:06.831014 887 server.go:523] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 46.022205] k3s[887]: I0922 10:45:06.831137 887 watchdog_linux.go:95] "Systemd watchdog is not enabled" machine # [ 46.022642] k3s[887]: I0922 10:45:06.831164 887 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." machine # [ 46.023588] k3s[887]: I0922 10:45:06.833575 887 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt" machine # [ 46.031757] k3s[887]: I0922 10:45:06.841758 887 server.go:1414] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" machine # [ 46.040294] k3s[887]: I0922 10:45:06.850242 887 server.go:771] "--cgroups-per-qos enabled, but --cgroup-root was not specified. Defaulting to /" machine # [ 46.041120] k3s[887]: I0922 10:45:06.850305 887 server.go:832] "NoSwap is set due to memorySwapBehavior not specified" memorySwapBehavior="" FailSwapOn=false machine # [ 46.041915] k3s[887]: I0922 10:45:06.850724 887 container_manager_linux.go:272] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] machine # [ 46.042521] k3s[887]: I0922 10:45:06.850770 887 container_manager_linux.go:277] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"machine","RuntimeCgroupsName":"","SystemCgroupsName":"","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":false,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":null,"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.01},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":-1,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} machine # [ 46.043266] k3s[887]: I0922 10:45:06.851152 887 topology_manager.go:143] "Creating topology manager with none policy" machine # [ 46.043959] k3s[887]: I0922 10:45:06.851187 887 container_manager_linux.go:308] "Creating device plugin manager" machine # [ 46.044561] k3s[887]: I0922 10:45:06.851328 887 container_manager_linux.go:317] "Creating Dynamic Resource Allocation (DRA) manager" machine # [ 46.045957] k3s[887]: I0922 10:45:06.855951 887 state_mem.go:41] "Initialized" logger="CPUManager state memory" machine # [ 46.046787] k3s[887]: I0922 10:45:06.856233 887 kubelet.go:482] "Attempting to sync node with API server" machine # [ 46.047502] k3s[887]: I0922 10:45:06.856256 887 kubelet.go:383] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests" machine # [ 46.048083] k3s[887]: I0922 10:45:06.856286 887 kubelet.go:394] "Adding apiserver pod source" machine # [ 46.048679] k3s[887]: I0922 10:45:06.856305 887 apiserver.go:42] "Waiting for node sync before watching apiserver pods" machine # [ 46.050454] k3s[887]: I0922 10:45:06.859972 887 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="containerd" version="2.2.7-k3s1" apiVersion="v1" machine # [ 46.051558] k3s[887]: I0922 10:45:06.861551 887 kubelet.go:945] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" machine # [ 46.052218] k3s[887]: I0922 10:45:06.861618 887 kubelet.go:972] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" machine # [ 46.056115] k3s[887]: I0922 10:45:06.865739 887 server.go:1252] "Started kubelet" machine # [ 46.058936] k3s[887]: I0922 10:45:06.866942 887 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 machine # [ 46.059597] k3s[887]: I0922 10:45:06.867017 887 server_v1.go:49] "podresources" method="list" useActivePods=true machine # [ 46.060072] k3s[887]: I0922 10:45:06.867222 887 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" machine # [ 46.060541] k3s[887]: I0922 10:45:06.867274 887 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 machine # [ 46.060987] k3s[887]: I0922 10:45:06.868306 887 server.go:317] "Adding debug handlers to kubelet server" machine # [ 46.066323] k3s[887]: I0922 10:45:06.876336 887 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" machine # [ 46.068484] k3s[887]: I0922 10:45:06.877323 887 dynamic_serving_content.go:135] "Starting controller" name="kubelet-server-cert-files::/var/lib/rancher/k3s/agent/serving-kubelet.crt::/var/lib/rancher/k3s/agent/serving-kubelet.key" machine # [ 46.069139] k3s[887]: E0922 10:45:06.877389 887 kubelet_node_status.go:392] "Error getting the current node from lister" err="node \"machine\" not found" machine # [ 46.069643] k3s[887]: I0922 10:45:06.877437 887 volume_manager.go:311] "Starting Kubelet Volume Manager" machine # [ 46.070434] k3s[887]: I0922 10:45:06.877781 887 desired_state_of_world_populator.go:146] "Desired state populator starts to run" machine # [ 46.073101] k3s[887]: I0922 10:45:06.877842 887 reconciler.go:29] "Reconciler: start to sync state" machine # [ 46.078703] k3s[887]: I0922 10:45:06.888723 887 factory.go:223] Registration of the systemd container factory successfully machine # [ 46.080105] k3s[887]: I0922 10:45:06.890105 887 factory.go:221] Registration of the crio container factory failed: Get "http://%2Fvar%2Frun%2Fcrio%2Fcrio.sock/info": dial unix /var/run/crio/crio.sock: connect: no such file or directory machine # [ 46.081806] k3s[887]: E0922 10:45:06.891717 887 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"machine\" not found" node="machine" machine # [ 46.082961] k3s[887]: I0922 10:45:06.892835 887 factory.go:223] Registration of the containerd container factory successfully machine # [ 46.099058] k3s[887]: I0922 10:45:06.908977 887 cpu_manager.go:225] "Starting" policy="none" machine # [ 46.099684] k3s[887]: I0922 10:45:06.908994 887 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" machine # [ 46.100162] k3s[887]: I0922 10:45:06.909015 887 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" machine # [ 46.111170] k3s[887]: I0922 10:45:06.920933 887 policy_none.go:50] "Start" machine # [ 46.112642] k3s[887]: I0922 10:45:06.920957 887 memory_manager.go:187] "Starting memorymanager" policy="None" machine # [ 46.113559] k3s[887]: I0922 10:45:06.920976 887 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" machine # [ 46.119332] k3s[887]: I0922 10:45:06.929354 887 policy_none.go:44] "Start" machine # [ 46.124590] systemd[1]: Created slice libcontainer container kubepods.slice. machine # [ 46.137877] systemd[1]: Created slice libcontainer container kubepods-burstable.slice. machine # [ 46.141703] systemd[1]: Created slice libcontainer container kubepods-besteffort.slice. machine # [ 46.149449] k3s[887]: E0922 10:45:06.959389 887 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" machine # [ 46.150106] k3s[887]: I0922 10:45:06.959513 887 eviction_manager.go:194] "Eviction manager: starting control loop" machine # [ 46.150784] k3s[887]: I0922 10:45:06.959542 887 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" machine # [ 46.151430] k3s[887]: I0922 10:45:06.959980 887 plugin_manager.go:121] "Starting Kubelet Plugin Manager" machine # [ 46.151894] k3s[887]: E0922 10:45:06.961049 887 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="no imagefs label for configured runtime" machine # [ 46.152524] k3s[887]: E0922 10:45:06.961104 887 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"machine\" not found" machine # [ 46.252395] k3s[887]: I0922 10:45:07.062297 887 kubelet_node_status.go:74] "Attempting to register node" node="machine" machine # [ 46.260070] k3s[887]: time="2026-09-22T10:45:07Z" level=info msg="Adding node OwnerReference to node-password secret machine.node-password.k3s" machine # [ 46.261347] k3s[887]: I0922 10:45:07.071011 887 node_controller.go:429] Initializing node machine with cloud provider machine # [ 46.262074] k3s[887]: I0922 10:45:07.071111 887 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 46.262531] k3s[887]: E0922 10:45:07.071136 887 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 46.264087] k3s[887]: I0922 10:45:07.071846 887 actual_state_of_world.go:541] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"machine\" does not exist" machine # [ 46.265052] k3s[887]: I0922 10:45:07.073576 887 kubelet_node_status.go:77] "Successfully registered node" node="machine" machine # [ 46.269892] k3s[887]: I0922 10:45:07.079276 887 node_controller.go:429] Initializing node machine with cloud provider machine # [ 46.270707] k3s[887]: I0922 10:45:07.079334 887 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 46.271462] k3s[887]: E0922 10:45:07.079357 887 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 46.277754] k3s[887]: time="2026-09-22T10:45:07Z" level=info msg="Synced coredns NodeHosts entries for machine" machine # [ 46.284595] k3s[887]: I0922 10:45:07.093729 887 node_controller.go:429] Initializing node machine with cloud provider machine # [ 46.287192] k3s[887]: I0922 10:45:07.097211 887 node_controller.go:233] error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing machine # [ 46.287979] k3s[887]: E0922 10:45:07.097239 887 node_controller.go:244] "Unhandled Error" err="error syncing 'machine': failed to get instance metadata for node machine: address annotations not yet set, requeuing" logger="UnhandledError" machine # [ 46.290218] k3s[887]: time="2026-09-22T10:45:07Z" level=info msg="Annotations and labels have been set successfully on node: machine" machine # [ 46.290649] k3s[887]: I0922 10:45:07.097279 887 node_controller.go:429] Initializing node machine with cloud provider machine # [ 46.292089] k3s[887]: I0922 10:45:07.100236 887 range_allocator.go:433] "Set node PodCIDR" node="machine" podCIDRs=["10.42.0.0/24"] machine # [ 46.292727] k3s[887]: time="2026-09-22T10:45:07Z" level=info msg="Starting flannel with backend vxlan" machine # [ 46.296164] k3s[887]: I0922 10:45:07.106158 887 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" machine # [ 46.308446] k3s[887]: time="2026-09-22T10:45:07Z" level=info msg="Flannel found PodCIDR assigned for node machine" machine # [ 46.309198] k3s[887]: time="2026-09-22T10:45:07Z" level=info msg="The interface eth0 with ipv4 address 10.0.2.15 will be used by flannel" machine # [ 46.309650] k3s[887]: I0922 10:45:07.119515 887 kube.go:139] Waiting 10m0s for node controller to sync machine # [ 46.310102] k3s[887]: I0922 10:45:07.119589 887 kube.go:537] Starting kube subnet manager machine # [ 46.315161] k3s[887]: I0922 10:45:07.125155 887 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" machine # [ 46.315570] k3s[887]: I0922 10:45:07.125192 887 status_manager.go:249] "Starting to sync pod status with apiserver" machine # [ 46.316390] k3s[887]: I0922 10:45:07.125226 887 kubelet.go:2506] "Starting kubelet main sync loop" machine # [ 46.316980] k3s[887]: E0922 10:45:07.125276 887 kubelet.go:2530] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" machine # [ 46.399095] k3s[887]: I0922 10:45:07.208804 887 kuberuntime_manager.go:2095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24" machine # [ 46.401575] k3s[887]: I0922 10:45:07.211592 887 kubelet_network.go:47] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24" machine # [ 46.402637] k3s[887]: I0922 10:45:07.212659 887 node_controller.go:474] Successfully initialized node machine with cloud provider machine # [ 46.403274] k3s[887]: I0922 10:45:07.212803 887 event.go:389] "Event occurred" object="machine" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully" machine # [ 46.406320] k3s[887]: I0922 10:45:07.216350 887 kubelet_node_status.go:427] "Fast updating node status as it just became ready" machine # [ 46.413272] k3s[887]: I0922 10:45:07.223257 887 topologycache.go:237] "Can't get CPU or zone information for node" node="machine" machine # [ 46.417345] k3s[887]: I0922 10:45:07.227252 887 server.go:173] "Starting Kubernetes Scheduler" version="v1.35.8+k3s1" machine # [ 46.419042] k3s[887]: I0922 10:45:07.227297 887 server.go:175] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 46.420886] k3s[887]: I0922 10:45:07.230895 887 requestheader_controller.go:180] Starting RequestHeaderAuthRequestController machine # [ 46.422900] k3s[887]: I0922 10:45:07.230950 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 46.424592] k3s[887]: I0922 10:45:07.230993 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file" machine # [ 46.427618] k3s[887]: I0922 10:45:07.231014 887 shared_informer.go:370] "Waiting for caches to sync" machine # [ 46.429217] k3s[887]: I0922 10:45:07.231043 887 secure_serving.go:211] Serving securely on 127.0.0.1:10259 machine # [ 46.430927] k3s[887]: I0922 10:45:07.231139 887 dynamic_serving_content.go:135] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.crt::/var/lib/rancher/k3s/server/tls/kube-scheduler/kube-scheduler.key" machine # [ 46.434371] k3s[887]: I0922 10:45:07.231360 887 tlsconfig.go:243] "Starting DynamicServingCertificateController" machine # [ 46.435750] k3s[887]: I0922 10:45:07.231042 887 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file" machine # [ 46.437924] k3s[887]: I0922 10:45:07.231411 887 shared_informer.go:370] "Waiting for caches to sync" machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 46.860231] k3s[887]: time="2026-09-22T10:45:07Z" level=info msg="Tunnel authorizer set Kubelet Port 0.0.0.0:10250" machine # [ 46.893330] k3s[887]: time="2026-09-22T10:45:07Z" level=info msg="Labels and annotations have been set successfully on node: machine" machine # [ 46.904597] k3s[887]: I0922 10:45:07.714481 887 server.go:218] "Successfully retrieved NodeIPs" NodeIPs=["10.0.2.15","fec0::8e8d:ea40:7aff:8a9b"] machine # [ 46.906935] k3s[887]: E0922 10:45:07.714584 887 server.go:255] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`" machine # [ 46.921415] k3s[887]: I0922 10:45:07.731370 887 shared_informer.go:377] "Caches are synced" machine # [ 46.922154] k3s[887]: I0922 10:45:07.731449 887 shared_informer.go:377] "Caches are synced" machine # [ 46.922717] k3s[887]: I0922 10:45:07.732164 887 shared_informer.go:377] "Caches are synced" machine # [ 46.949822] k3s[887]: I0922 10:45:07.759752 887 server.go:264] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4" machine # [ 46.950721] k3s[887]: I0922 10:45:07.759818 887 server_linux.go:136] "Using iptables Proxier" machine # [ 46.986255] k3s[887]: I0922 10:45:07.796046 887 proxier.go:242] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4" machine # [ 47.007518] k3s[887]: I0922 10:45:07.817490 887 server.go:529] "Version info" version="v1.35.8+k3s1" machine # [ 47.008209] k3s[887]: I0922 10:45:07.817523 887 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" machine # [ 47.009095] k3s[887]: I0922 10:45:07.819101 887 config.go:200] "Starting service config controller" machine # [ 47.010292] k3s[887]: I0922 10:45:07.819133 887 shared_informer.go:349] "Waiting for caches to sync" controller="service config" machine # [ 47.011211] k3s[887]: I0922 10:45:07.819188 887 config.go:106] "Starting endpoint slice config controller" machine # [ 47.011901] k3s[887]: I0922 10:45:07.819202 887 shared_informer.go:349] "Waiting for caches to sync" controller="endpoint slice config" machine # [ 47.012570] k3s[887]: I0922 10:45:07.819230 887 config.go:403] "Starting serviceCIDR config controller" machine # [ 47.013030] k3s[887]: I0922 10:45:07.819242 887 shared_informer.go:349] "Waiting for caches to sync" controller="serviceCIDR config" machine # [ 47.013340] k3s[887]: I0922 10:45:07.820394 887 config.go:309] "Starting node config controller" machine # [ 47.013824] k3s[887]: I0922 10:45:07.820425 887 shared_informer.go:349] "Waiting for caches to sync" controller="node config" machine # [ 47.014472] k3s[887]: I0922 10:45:07.820438 887 shared_informer.go:356] "Caches are synced" controller="node config" machine # [ 47.047433] k3s[887]: I0922 10:45:07.857384 887 apiserver.go:52] "Watching apiserver" machine # [ 47.310812] k3s[887]: I0922 10:45:08.120702 887 kube.go:163] Node controller sync successful machine # [ 47.312543] k3s[887]: I0922 10:45:08.120816 887 vxlan.go:128] VXLAN config: VNI=1 Port=0 GBP=false Learning=false DirectRouting=false machine # [ 47.315155] k3s[887]: I0922 10:45:08.125141 887 kube.go:704] List of node(machine) annotations: map[string]string{"alpha.kubernetes.io/provided-node-ip":"10.0.2.15,fec0::8e8d:ea40:7aff:8a9b", "k3s.io/hostname":"machine", "k3s.io/internal-ip":"10.0.2.15,fec0::8e8d:ea40:7aff:8a9b", "k3s.io/node-args":"[\"server\",\"--disable\",\"traefik\",\"--disable\",\"metrics-server\",\"--disable\",\"local-storage\",\"--kubelet-arg\",\"eviction-hard=nodefs.available\\u003c1%,imagefs.available\\u003c1%\"]", "k3s.io/node-config-hash":"EFXPOZ7ZWHRCLFNW4X4ZDPFQMSAOP3BLEIN2VE47TDRKQ4UIWKUQ====", "k3s.io/node-env":"{}", "node.alpha.kubernetes.io/ttl":"0", "volumes.kubernetes.io/controller-managed-attach-detach":"true"} machine # [ 47.359984] (udev-worker)[1431]: Network interface NamePolicy= disabled on kernel command line. machine # [ 47.367203] k3s[887]: I0922 10:45:08.177196 887 kube.go:558] Creating the node lease for IPv4. This is the n.Spec.PodCIDRs: [10.42.0.0/24] machine # [ 47.371278] k3s[887]: I0922 10:45:08.181287 887 iptables.go:50] Starting flannel in iptables mode... machine # [ 47.372430] k3s[887]: time="2026-09-22T10:45:08Z" level=warning msg="no subnet found for key: FLANNEL_NETWORK in file: /run/flannel/subnet.env" machine # [ 47.374253] k3s[887]: time="2026-09-22T10:45:08Z" level=warning msg="no subnet found for key: FLANNEL_SUBNET in file: /run/flannel/subnet.env" machine # [ 47.374657] k3s[887]: time="2026-09-22T10:45:08Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_NETWORK in file: /run/flannel/subnet.env" machine # [ 47.375373] k3s[887]: time="2026-09-22T10:45:08Z" level=warning msg="no subnet found for key: FLANNEL_IPV6_SUBNET in file: /run/flannel/subnet.env" machine # [ 47.376042] k3s[887]: I0922 10:45:08.181377 887 iptables.go:101] Current network or subnet (10.42.0.0/16, 10.42.0.0/24) is not equal to previous one (0.0.0.0/0, 0.0.0.0/0), trying to recycle old iptables rules machine # [ 47.395201] systemd[1]: Created slice libcontainer container kubepods-burstable-podfa5aef02_44bb_40c9_a70e_b3a3fad5f8e4.slice. machine # [ 47.409378] k3s[887]: I0922 10:45:08.219348 887 shared_informer.go:356] "Caches are synced" controller="serviceCIDR config" machine # [ 47.410180] k3s[887]: I0922 10:45:08.219389 887 shared_informer.go:356] "Caches are synced" controller="service config" machine # [ 47.411047] k3s[887]: I0922 10:45:08.219420 887 shared_informer.go:356] "Caches are synced" controller="endpoint slice config" machine # [ 47.411479] systemd[1]: Created slice libcontainer container kubepods-burstable-pod31c0c032_d16c_4852_a322_06a878108a18.slice. machine # [ 47.424766] dhcpcd[683]: flannel.1: IAID ff:98:72:8f machine # [ 47.425688] dhcpcd[683]: flannel.1: adding address fe80::4c94:ffff:fe98:728f machine # [ 47.465701] k3s[887]: I0922 10:45:08.275669 887 iptables.go:111] Setting up masking rules machine # [ 47.468623] k3s[887]: I0922 10:45:08.278622 887 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" machine # [ 47.473626] k3s[887]: I0922 10:45:08.283620 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbwxh\" (UniqueName: \"kubernetes.io/projected/fa5aef02-44bb-40c9-a70e-b3a3fad5f8e4-kube-api-access-lbwxh\") pod \"coredns-c5fdd76cf-6bfrh\" (UID: \"fa5aef02-44bb-40c9-a70e-b3a3fad5f8e4\") " pod="kube-system/coredns-c5fdd76cf-6bfrh" machine # [ 47.474467] k3s[887]: I0922 10:45:08.283666 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-cache\") pod \"helm-install-nix-grpc-farm-lnq9c\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " pod="kube-system/helm-install-nix-grpc-farm-lnq9c" machine # [ 47.475048] k3s[887]: I0922 10:45:08.283711 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-config\") pod \"helm-install-nix-grpc-farm-lnq9c\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " pod="kube-system/helm-install-nix-grpc-farm-lnq9c" machine # [ 47.475320] k3s[887]: I0922 10:45:08.283739 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-tmp\") pod \"helm-install-nix-grpc-farm-lnq9c\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " pod="kube-system/helm-install-nix-grpc-farm-lnq9c" machine # [ 47.475781] k3s[887]: I0922 10:45:08.283769 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"values\" (UniqueName: \"kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-values\") pod \"helm-install-nix-grpc-farm-lnq9c\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " pod="kube-system/helm-install-nix-grpc-farm-lnq9c" machine # [ 47.476472] k3s[887]: I0922 10:45:08.283801 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgpkz\" (UniqueName: \"kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-kube-api-access-zgpkz\") pod \"helm-install-nix-grpc-farm-lnq9c\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " pod="kube-system/helm-install-nix-grpc-farm-lnq9c" machine # [ 47.476704] k3s[887]: I0922 10:45:08.283829 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5aef02-44bb-40c9-a70e-b3a3fad5f8e4-custom-config-volume\") pod \"coredns-c5fdd76cf-6bfrh\" (UID: \"fa5aef02-44bb-40c9-a70e-b3a3fad5f8e4\") " pod="kube-system/coredns-c5fdd76cf-6bfrh" machine # [ 47.477174] k3s[887]: I0922 10:45:08.283859 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-helm\") pod \"helm-install-nix-grpc-farm-lnq9c\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " pod="kube-system/helm-install-nix-grpc-farm-lnq9c" machine # [ 47.477622] k3s[887]: I0922 10:45:08.283889 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"content\" (UniqueName: \"kubernetes.io/configmap/31c0c032-d16c-4852-a322-06a878108a18-content\") pod \"helm-install-nix-grpc-farm-lnq9c\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " pod="kube-system/helm-install-nix-grpc-farm-lnq9c" machine # [ 47.478088] k3s[887]: I0922 10:45:08.283920 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa5aef02-44bb-40c9-a70e-b3a3fad5f8e4-config-volume\") pod \"coredns-c5fdd76cf-6bfrh\" (UID: \"fa5aef02-44bb-40c9-a70e-b3a3fad5f8e4\") " pod="kube-system/coredns-c5fdd76cf-6bfrh" machine # [ 47.538381] k3s[887]: I0922 10:45:08.348329 887 iptables.go:212] Changing default FORWARD chain policy to ACCEPT machine # [ 47.555368] k3s[887]: time="2026-09-22T10:45:08Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env" machine # [ 47.556143] k3s[887]: time="2026-09-22T10:45:08Z" level=info msg="Running flannel backend" machine # [ 47.556763] k3s[887]: I0922 10:45:08.365251 887 vxlan_network.go:68] watching for new subnet leases machine # [ 47.557611] k3s[887]: I0922 10:45:08.365282 887 vxlan_network.go:115] starting vxlan device watcher machine # [ 47.631530] k3s[887]: I0922 10:45:08.441460 887 iptables.go:358] bootstrap done machine # [ 47.702685] k3s[887]: I0922 10:45:08.512645 887 iptables.go:358] bootstrap done machine # [ 47.969728] cni0: port 1(vethf7994f8a) entered blocking state machine # [ 47.970413] cni0: port 1(vethf7994f8a) entered disabled state machine # [ 47.971337] vethf7994f8a: entered allmulticast mode machine # [ 47.972131] vethf7994f8a: entered promiscuous mode machine # [ 47.983527] cni0: port 1(vethf7994f8a) entered blocking state machine # [ 47.984517] cni0: port 1(vethf7994f8a) entered forwarding state machine # [ 47.862841] dhcpcd[683]: vethf7994f8a: IAID f0:bd:44:0f machine # [ 47.864076] dhcpcd[683]: vethf7994f8a: adding address fe80::4428:f0ff:febd:440f machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 48.192262] cni0: port 2(veth8a99e6fd) entered blocking state machine # [ 48.043714] ([ 48.193335] cni0: port 2(veth8a99e6fd) entered disabled state machine # udev-worker)[1621]: Network interface NamePolicy= disabled on kernel command line. machine # [ 48.195723] veth8a99e6fd: entered allmulticast mode machine # [ 48.196580] veth8a99e6fd: entered promiscuous mode machine # [ 48.207122] cni0: port 2(veth8a99e6fd) entered blocking state machine # [ 48.208423] cni0: port 2(veth8a99e6fd) entered forwarding state machine # [ 48.087628] dhcpcd[683]: veth8a99e6fd: IAID ab:0b:1d:48 machine # [ 48.088251] dhcpcd[683]: veth8a99e6fd: adding address fe80::c819:abff:fe0b:1d48 machine # [ 48.199428] systemd[1]: Started libcontainer container 49cb8293d5daf3ab7cdc04b15e5ccb3ab9114d911325e1584996e17067c501ec. machine # [ 48.202933] systemd[1]: Started libcontainer container ee7d6815e9f64fdc2d80d51fc9d00b2998740d25f5122c3a55ab41394bfb25b9. machine # [ 48.335199] dhcpcd[683]: vethf7994f8a: soliciting a DHCP lease machine # [ 48.973840] k3s[887]: time="2026-09-22T10:45:09Z" level=info msg="Starting network policy controller version v2.6.3-k3s1, built on 1970-01-01T01:01:01Z, go1.26.7" machine # [ 48.976399] k3s[887]: I0922 10:45:09.786423 887 network_policy_controller.go:164] Starting network policy controller machine # [ 49.061554] dhcpcd[683]: flannel.1: soliciting a DHCP lease machine # [ 49.066388] dhcpcd[683]: veth8a99e6fd: soliciting a DHCP lease machine # [ 49.111798] systemd[1]: Started libcontainer container 14604737185445e6475e8a32b17f0941e548593ef47cc8349fd36058f04912a8. machine # Error from server (NotFound): deployments.apps "nix-grpc-farm-lb" not found machine # [ 49.370688] k3s[887]: I0922 10:45:10.180567 887 network_policy_controller.go:179] Starting network policy controller full sync goroutine machine # [ 49.382475] dhcpcd[683]: vethf7994f8a: soliciting an IPv6 router machine # [ 49.429092] systemd[1]: Started libcontainer container a48d48a35e4b1e1ea2244316d9b6586c3491103ae2b057f2759f57ad83a78c46. machine # [ 49.586316] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount2733189820.mount: Deactivated successfully. machine # [ 50.160178] dhcpcd[683]: flannel.1: soliciting an IPv6 router machine # [ 50.246128] dhcpcd[683]: veth8a99e6fd: soliciting an IPv6 router machine # [ 50.327044] k3s[887]: I0922 10:45:11.135961 887 alloc.go:329] "allocated clusterIPs" service="farm/nix-grpc-farm" clusterIPs={"IPv4":"10.43.246.73"} machine # [ 50.385883] k3s[887]: I0922 10:45:11.195488 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/coredns-c5fdd76cf-6bfrh" podStartSLOduration=19.195464921 podStartE2EDuration="19.195464921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:45:10.156262453 +0000 UTC m=+29.615931631" watchObservedRunningTime="2026-09-22 10:45:11.195464921 +0000 UTC m=+30.655133820" machine # [ 50.386691] k3s[887]: I0922 10:45:11.195635 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/helm-install-nix-grpc-farm-lnq9c" podStartSLOduration=19.195625835 podStartE2EDuration="19.195625835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:44:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:45:11.193890699 +0000 UTC m=+30.653559877" watchObservedRunningTime="2026-09-22 10:45:11.195625835 +0000 UTC m=+30.655294734" machine # [ 50.426422] systemd[1]: cri-containerd-a48d48a35e4b1e1ea2244316d9b6586c3491103ae2b057f2759f57ad83a78c46.scope: Deactivated successfully. machine # [ 50.427423] systemd[1]: cri-containerd-a48d48a35e4b1e1ea2244316d9b6586c3491103ae2b057f2759f57ad83a78c46.scope: Consumed 550ms CPU time over 996ms wall clock time, 30.3M memory peak, 2.4M incoming IP traffic, 139.8K outgoing IP traffic. machine # [ 50.495213] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-a48d48a35e4b1e1ea2244316d9b6586c3491103ae2b057f2759f57ad83a78c46-rootfs.mount: Deactivated successfully. machine # [ 50.949397] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod64a2a7bc_2078_4ab8_8ada_decc76cc978b.slice. machine # [ 50.969316] systemd[1]: Created slice libcontainer container kubepods-besteffort-podb1e19932_33f3_48d3_9764_40d642f1116c.slice. machine # [ 50.976421] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod3379f40a_6023_4ae4_a382_5b31c8ca80f9.slice. machine # [ 50.987099] systemd[1]: Created slice libcontainer container kubepods-besteffort-podb516042a_93a1_4586_abf0_71693e1dde6d.slice. machine # [ 51.007930] k3s[887]: I0922 10:45:11.817704 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/b516042a-93a1-4586-abf0-71693e1dde6d-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q\" (UID: \"b516042a-93a1-4586-abf0-71693e1dde6d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" machine # [ 51.013967] k3s[887]: I0922 10:45:11.817754 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1e19932-33f3-48d3-9764-40d642f1116c-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb\" (UID: \"b1e19932-33f3-48d3-9764-40d642f1116c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" machine # [ 51.019703] k3s[887]: I0922 10:45:11.817790 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnxmr\" (UniqueName: \"kubernetes.io/projected/3379f40a-6023-4ae4-a382-5b31c8ca80f9-kube-api-access-vnxmr\") pod \"nix-grpc-farm-scheduler-5844ddf54b-wrkr4\" (UID: \"3379f40a-6023-4ae4-a382-5b31c8ca80f9\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-wrkr4" machine # [ 51.027208] k3s[887]: I0922 10:45:11.817891 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n296\" (UniqueName: \"kubernetes.io/projected/b1e19932-33f3-48d3-9764-40d642f1116c-kube-api-access-8n296\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb\" (UID: \"b1e19932-33f3-48d3-9764-40d642f1116c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" machine # [ 51.034809] k3s[887]: I0922 10:45:11.817938 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/b516042a-93a1-4586-abf0-71693e1dde6d-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q\" (UID: \"b516042a-93a1-4586-abf0-71693e1dde6d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" machine # [ 51.041110] k3s[887]: I0922 10:45:11.817968 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-rvgn2\" (UID: \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-rvgn2" machine # [ 51.046518] k3s[887]: I0922 10:45:11.817997 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b516042a-93a1-4586-abf0-71693e1dde6d-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q\" (UID: \"b516042a-93a1-4586-abf0-71693e1dde6d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" machine # [ 51.052903] k3s[887]: I0922 10:45:11.818028 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j2wk\" (UniqueName: \"kubernetes.io/projected/b516042a-93a1-4586-abf0-71693e1dde6d-kube-api-access-5j2wk\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q\" (UID: \"b516042a-93a1-4586-abf0-71693e1dde6d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" machine # [ 51.060940] k3s[887]: I0922 10:45:11.818094 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-rvgn2\" (UID: \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-rvgn2" machine # [ 51.068133] k3s[887]: I0922 10:45:11.818135 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3379f40a-6023-4ae4-a382-5b31c8ca80f9-ca\") pod \"nix-grpc-farm-scheduler-5844ddf54b-wrkr4\" (UID: \"3379f40a-6023-4ae4-a382-5b31c8ca80f9\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-wrkr4" machine # [ 51.068910] k3s[887]: I0922 10:45:11.818161 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/b516042a-93a1-4586-abf0-71693e1dde6d-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q\" (UID: \"b516042a-93a1-4586-abf0-71693e1dde6d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" machine # [ 51.069625] k3s[887]: I0922 10:45:11.818189 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/b1e19932-33f3-48d3-9764-40d642f1116c-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb\" (UID: \"b1e19932-33f3-48d3-9764-40d642f1116c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" machine # [ 51.070770] k3s[887]: I0922 10:45:11.818228 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/b1e19932-33f3-48d3-9764-40d642f1116c-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb\" (UID: \"b1e19932-33f3-48d3-9764-40d642f1116c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" machine # [ 51.071783] k3s[887]: I0922 10:45:11.818255 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/3379f40a-6023-4ae4-a382-5b31c8ca80f9-oidc\") pod \"nix-grpc-farm-scheduler-5844ddf54b-wrkr4\" (UID: \"3379f40a-6023-4ae4-a382-5b31c8ca80f9\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-wrkr4" machine # [ 51.072526] k3s[887]: I0922 10:45:11.818282 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/b516042a-93a1-4586-abf0-71693e1dde6d-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q\" (UID: \"b516042a-93a1-4586-abf0-71693e1dde6d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" machine # [ 51.073182] k3s[887]: I0922 10:45:11.818311 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64a2a7bc-2078-4ab8-8ada-decc76cc978b-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-rvgn2\" (UID: \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-rvgn2" machine # [ 51.073881] k3s[887]: I0922 10:45:11.818339 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/b1e19932-33f3-48d3-9764-40d642f1116c-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb\" (UID: \"b1e19932-33f3-48d3-9764-40d642f1116c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" machine # [ 51.074817] k3s[887]: I0922 10:45:11.818366 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/b1e19932-33f3-48d3-9764-40d642f1116c-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb\" (UID: \"b1e19932-33f3-48d3-9764-40d642f1116c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" machine # [ 51.075785] k3s[887]: I0922 10:45:11.818396 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/b516042a-93a1-4586-abf0-71693e1dde6d-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q\" (UID: \"b516042a-93a1-4586-abf0-71693e1dde6d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" machine # [ 51.076822] k3s[887]: I0922 10:45:11.818421 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/b516042a-93a1-4586-abf0-71693e1dde6d-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q\" (UID: \"b516042a-93a1-4586-abf0-71693e1dde6d\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" machine # [ 51.077704] k3s[887]: I0922 10:45:11.818446 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-rvgn2\" (UID: \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-rvgn2" machine # [ 51.124704] k3s[887]: I0922 10:45:11.818476 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/b1e19932-33f3-48d3-9764-40d642f1116c-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb\" (UID: \"b1e19932-33f3-48d3-9764-40d642f1116c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" machine # [ 51.125755] k3s[887]: I0922 10:45:11.818548 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/b1e19932-33f3-48d3-9764-40d642f1116c-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb\" (UID: \"b1e19932-33f3-48d3-9764-40d642f1116c\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" machine # [ 51.126533] k3s[887]: I0922 10:45:11.818615 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/3379f40a-6023-4ae4-a382-5b31c8ca80f9-niks3-token\") pod \"nix-grpc-farm-scheduler-5844ddf54b-wrkr4\" (UID: \"3379f40a-6023-4ae4-a382-5b31c8ca80f9\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-wrkr4" machine # [ 51.130134] k3s[887]: I0922 10:45:11.818685 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/3379f40a-6023-4ae4-a382-5b31c8ca80f9-tls\") pod \"nix-grpc-farm-scheduler-5844ddf54b-wrkr4\" (UID: \"3379f40a-6023-4ae4-a382-5b31c8ca80f9\") " pod="farm/nix-grpc-farm-scheduler-5844ddf54b-wrkr4" machine # [ 51.130839] k3s[887]: I0922 10:45:11.922592 887 node_lifecycle_controller.go:1234] "Initializing eviction metric for zone" zone="" machine # [ 51.131670] k3s[887]: I0922 10:45:11.922699 887 node_lifecycle_controller.go:886] "Missing timestamp for Node. Assuming now as a timestamp" node="machine" machine # [ 51.132386] k3s[887]: I0922 10:45:11.922791 887 node_lifecycle_controller.go:1080] "Controller detected that zone is now in new state" zone="" newState="Normal" machine # [ 51.437595] cni0: port 3(vethb351ab99) entered blocking state machine # [ 51.439392] cni0: port 3(vethb351ab99) entered disabled state machine # [ 51.440827] vethb351ab99: entered allmulticast mode machine # [ 51.442180] vethb351ab99: entered promiscuous mode machine # [ 51.297237] (udev-worker)[1967]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.459814] cni0: port 3(vethb351ab99) entered blocking state machine # [ 51.460593] cni0: port 3(vethb351ab99) entered forwarding state machine # [ 51.340521] dhcpcd[683]: vethb351ab99: IAID 4c:a8:1b:f2 machine # [ 51.342086] dhcpcd[683]: vethb351ab99: adding address fe80::dc4b:4cff:fea8:1bf2 machine # [ 51.497118] cni0: port 4(vethfd93888d) entered blocking state machine # [ 51.500274] cni0: port 4(vethfd93888d) entered disabled state machine # [ 51.501770] vethfd93888d: entered allmulticast mode machine # [ 51.502630] vethfd93888d: entered promiscuous mode machine # [ 51.357199] (udev-worker)[2194]: Network interface NamePolicy= disabled on ke[ 51.506865] cni0: port 5(veth9a91cac0) entered blocking state machine # rnel command line. machine # [ 51.508511] cni0: port 5(veth9a91cac0) entered disabled state machine # [ 51.509979] veth9a91cac0: entered allmulticast mode machine # [ 51.511245] veth9a91cac0: entered promiscuous mode machine # [ 51.528910] cni0: port 4(vethfd93888d) entered blocking state machine # [ 51.529600] cni0: port 4(vethfd93888d) entered forwarding state machine # [ 51.533625] cni0: port 5(veth9a91cac0) entered blocking state machine # [ 51.534696] cni0: port 5(veth9a91cac0) entered forwarding state machine # [ 51.400401] (udev-worker)[2196]: Network interface NamePolicy= disabled on kernel command line. machine # [ 51.552506] cni0: port 6(veth44e40f15) entered blocking state machine # [ 51.553573] cni0: port 6(veth44e40f15) entered disabled state machine # [ 51.554449] veth44e40f15: entered allmulticast mode machine # [ 51.555579] veth44e40f15: entered promiscuous mode machine # [ 51.582489] cni0: port 6(veth44e40f15) entered blocking state machine # [ 51.583242] cni0: port 6(veth44e40f15) entered forwarding state machine # [ 51.436996] dhcpcd[683]: vethfd93888d: waiting for carrier machine # [ 51.459182] dhcpcd[683]: veth9a91cac0: IAID e9:a7:8f:e2 machine # [ 51.460058] dhcpcd[683]: veth9a91cac0: adding address fe80::5c80:e9ff:fea7:8fe2 machine # [ 51.481531] dhcpcd[683]: veth44e40f15: IAID ad:c3:b8:ce machine # [ 51.482751] dhcpcd[683]: veth44e40f15: adding address fe80::dc0c:adff:fec3:b8ce machine # [ 51.483531] dhcpcd[683]: vethfd93888d: carrier acquired machine # [ 51.495576] dhcpcd[683]: vethfd93888d: IAID a9:68:31:ca machine # [ 51.497411] dhcpcd[683]: vethfd93888d: adding address fe80::5054:a9ff:fe68:31ca machine # [ 51.498690] dhcpcd[683]: veth44e40f15: old hardware address: de:0c:ad:c3:b8:ce machine # [ 51.500690] dhcpcd[683]: veth44e40f15: new hardware address: 46:71:a8:13:ce:13 machine # [ 51.501837] dhcpcd[683]: veth44e40f15: carrier lost machine # [ 51.505792] systemd[1]: Started libcontainer container 86b885fba9719af79f6cbd66af7d0e5bef5748f15538c31b543cd43140704fb2. machine # [ 51.549958] dhcpcd[683]: veth44e40f15: deleting address fe80::dc0c:adff:fec3:b8ce machine # [ 51.551296] dhcpcd[683]: veth44e40f15: old hardware address: 46:71:a8:13:ce:13 machine # [ 51.552809] dhcpcd[683]: veth44e40f15: new hardware address: de:0c:ad:c3:b8:ce machine # [ 51.553744] dhcpcd[683]: veth44e40f15: carrier acquired machine # [ 51.562849] dhcpcd[683]: veth44e40f15: IAID ad:c3:b8:ce machine # [ 51.563560] dhcpcd[683]: veth44e40f15: adding address fe80::dc0c:adff:fec3:b8ce machine # [ 51.588224] systemd[1]: Started libcontainer container c059ab19ce0400623b5688969fed1c7d2a55687f041ceecd70f43529f677e173. machine # [ 51.593288] systemd[1]: Started libcontainer container db71662b1ef01f4f5360c067e33f1cd3341f6149a4a6f51c71c1d0c515d968e6. machine # [ 51.638443] systemd[1]: Started libcontainer container f1be927cd113f84255d57fda2879fed071514f7d0b11c8b16e8a47ec3ea7f4ac. machine # [ 51.694178] k3s[887]: E0922 10:45:12.503672 887 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 51.700242] k3s[887]: E0922 10:45:12.504163 887 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 51.706590] k3s[887]: E0922 10:45:12.516561 887 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb_farm(b1e19932-33f3-48d3-9764-40d642f1116c): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 51.707286] k3s[887]: E0922 10:45:12.516637 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" podUID="b1e19932-33f3-48d3-9764-40d642f1116c" machine # [ 51.743045] k3s[887]: E0922 10:45:12.552780 887 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 51.743521] k3s[887]: E0922 10:45:12.552849 887 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 51.744820] k3s[887]: E0922 10:45:12.553553 887 kuberuntime_manager.go:1674] "Unhandled Error" err="container nix-grpc-daemon start failed in pod nix-grpc-farm-scheduler-5844ddf54b-wrkr4_farm(3379f40a-6023-4ae4-a382-5b31c8ca80f9): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 51.754202] k3s[887]: E0922 10:45:12.553631 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-wrkr4" podUID="3379f40a-6023-4ae4-a382-5b31c8ca80f9" machine # [ 51.787547] k3s[887]: E0922 10:45:12.597139 887 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 51.788544] k3s[887]: E0922 10:45:12.597190 887 kuberuntime_image.go:43] "Failed to pull image" err="failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" image="nix-grpc-farm:0.1.0-beta.1" machine # [ 51.789304] k3s[887]: E0922 10:45:12.597418 887 kuberuntime_manager.go:1674] "Unhandled Error" err="init container seed-store start failed in pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q_farm(b516042a-93a1-4586-abf0-71693e1dde6d): ErrImagePull: failed to pull and unpack image \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to resolve reference \"docker.io/library/nix-grpc-farm:0.1.0-beta.1\": failed to do request: Head \"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\": dial tcp: lookup registry-1.docker.io: no such host" logger="UnhandledError" machine # [ 51.790131] k3s[887]: E0922 10:45:12.597479 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ErrImagePull: \"failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" podUID="b516042a-93a1-4586-abf0-71693e1dde6d" machine # [ 52.107395] systemd[1]: Started libcontainer container 9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9. machine # [ 52.178219] dhcpcd[683]: veth44e40f15: soliciting a DHCP lease machine # [ 52.336444] dhcpcd[683]: vethb351ab99: soliciting a DHCP lease machine # [ 52.377392] k3s[887]: E0922 10:45:13.187310 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" podUID="b516042a-93a1-4586-abf0-71693e1dde6d" machine # [ 52.386275] k3s[887]: E0922 10:45:13.189221 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nix-grpc-daemon\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-wrkr4" podUID="3379f40a-6023-4ae4-a382-5b31c8ca80f9" machine # [ 52.393972] k3s[887]: E0922 10:45:13.192896 887 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"seed-store\" with ImagePullBackOff: \"Back-off pulling image \\\"nix-grpc-farm:0.1.0-beta.1\\\": ErrImagePull: failed to pull and unpack image \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to resolve reference \\\"docker.io/library/nix-grpc-farm:0.1.0-beta.1\\\": failed to do request: Head \\\"https://registry-1.docker.io/v2/library/nix-grpc-farm/manifests/0.1.0-beta.1\\\": dial tcp: lookup registry-1.docker.io: no such host\"" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" podUID="b1e19932-33f3-48d3-9764-40d642f1116c" machine # [ 52.417870] k3s[887]: I0922 10:45:13.227594 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-rvgn2" podStartSLOduration=2.227571795 podStartE2EDuration="2.227571795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:45:13.226195642 +0000 UTC m=+32.685864821" watchObservedRunningTime="2026-09-22 10:45:13.227571795 +0000 UTC m=+32.687240694" machine # [ 52.428408] systemd[1]: cri-containerd-49cb8293d5daf3ab7cdc04b15e5ccb3ab9114d911325e1584996e17067c501ec.scope: Deactivated successfully. machine # [ 52.476184] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-49cb8293d5daf3ab7cdc04b15e5ccb3ab9114d911325e1584996e17067c501ec-rootfs.mount: Deactivated successfully. machine # [ 52.631745] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-49cb8293d5daf3ab7cdc04b15e5ccb3ab9114d911325e1584996e17067c501ec-shm.mount: Deactivated successfully. machine # [ 52.674071] dhcpcd[683]: vethfd93888d: soliciting a DHCP lease machine # [ 52.833605] cni0: port 2(veth8a99e6fd) entered disabled state machine # [ 52.685044] dhcpcd[683]: veth8a99e6fd: carrier lost machine # [ 52.835899] veth8a99e6fd (unregistering): left allmulticast mode machine # [ 52.837182] veth8a99e6fd (unregistering): left promiscuous mode machine # [ 52.838392] cni0: port 2(veth8a99e6fd) entered disabled state machine # [ 52.716937] systemd[1]: run-netns-cni\x2d1af9f007\x2d439d\x2d2505\x2d613e\x2db003c9b5fa0a.mount: Deactivated successfully. machine # [ 52.741382] dhcpcd[683]: veth8a99e6fd: deleting address fe80::c819:abff:fe0b:1d48 machine # [ 52.800375] dhcpcd[683]: veth8a99e6fd: removing interface machine # [ 52.822129] k3s[887]: I0922 10:45:13.631770 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-values\" (UniqueName: \"kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-values\") pod \"31c0c032-d16c-4852-a322-06a878108a18\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " machine # [ 52.823326] k3s[887]: I0922 10:45:13.631840 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-cache\") pod \"31c0c032-d16c-4852-a322-06a878108a18\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " machine # [ 52.823476] k3s[887]: I0922 10:45:13.631875 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-kube-api-access-zgpkz\" (UniqueName: \"kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-kube-api-access-zgpkz\") pod \"31c0c032-d16c-4852-a322-06a878108a18\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " machine # [ 52.824208] k3s[887]: I0922 10:45:13.631909 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-tmp\") pod \"31c0c032-d16c-4852-a322-06a878108a18\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " machine # [ 52.824894] k3s[887]: I0922 10:45:13.631937 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-config\") pod \"31c0c032-d16c-4852-a322-06a878108a18\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " machine # [ 52.826779] k3s[887]: I0922 10:45:13.635514 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/31c0c032-d16c-4852-a322-06a878108a18-content\" (UniqueName: \"kubernetes.io/configmap/31c0c032-d16c-4852-a322-06a878108a18-content\") pod \"31c0c032-d16c-4852-a322-06a878108a18\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " machine # [ 52.827967] k3s[887]: I0922 10:45:13.635576 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-helm\") pod \"31c0c032-d16c-4852-a322-06a878108a18\" (UID: \"31c0c032-d16c-4852-a322-06a878108a18\") " machine # [ 52.829509] k3s[887]: I0922 10:45:13.636124 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31c0c032-d16c-4852-a322-06a878108a18-content" pod "31c0c032-d16c-4852-a322-06a878108a18" (UID: "31c0c032-d16c-4852-a322-06a878108a18"). InnerVolumeSpecName "content". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 52.832834] systemd[1]: var-lib-kubelet-pods-31c0c032\x2dd16c\x2d4852\x2da322\x2d06a878108a18-volumes-kubernetes.io\x7eprojected-values.mount: Deactivated successfully. machine # [ 52.834459] systemd[1]: var-lib-kubelet-pods-31c0c032\x2dd16c\x2d4852\x2da322\x2d06a878108a18-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dconfig.mount: Deactivated successfully. machine # [ 52.871044] k3s[887]: I0922 10:45:13.680992 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-cache" pod "31c0c032-d16c-4852-a322-06a878108a18" (UID: "31c0c032-d16c-4852-a322-06a878108a18"). InnerVolumeSpecName "klipper-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 52.876374] k3s[887]: I0922 10:45:13.681182 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-values" pod "31c0c032-d16c-4852-a322-06a878108a18" (UID: "31c0c032-d16c-4852-a322-06a878108a18"). InnerVolumeSpecName "values". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 52.876979] k3s[887]: I0922 10:45:13.681229 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-kube-api-access-zgpkz" pod "31c0c032-d16c-4852-a322-06a878108a18" (UID: "31c0c032-d16c-4852-a322-06a878108a18"). InnerVolumeSpecName "kube-api-access-zgpkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 52.877887] k3s[887]: I0922 10:45:13.681347 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-helm" pod "31c0c032-d16c-4852-a322-06a878108a18" (UID: "31c0c032-d16c-4852-a322-06a878108a18"). InnerVolumeSpecName "klipper-helm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 52.878548] k3s[887]: I0922 10:45:13.681283 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-config" pod "31c0c032-d16c-4852-a322-06a878108a18" (UID: "31c0c032-d16c-4852-a322-06a878108a18"). InnerVolumeSpecName "klipper-config". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 52.879000] k3s[887]: I0922 10:45:13.682017 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-tmp" pod "31c0c032-d16c-4852-a322-06a878108a18" (UID: "31c0c032-d16c-4852-a322-06a878108a18"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 52.925992] k3s[887]: I0922 10:45:13.735888 887 reconciler_common.go:299] "Volume detached for volume \"values\" (UniqueName: \"kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-values\") on node \"machine\" DevicePath \"\"" machine # [ 52.926764] k3s[887]: I0922 10:45:13.735925 887 reconciler_common.go:299] "Volume detached for volume \"klipper-cache\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-cache\") on node \"machine\" DevicePath \"\"" machine # [ 52.927516] k3s[887]: I0922 10:45:13.735943 887 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgpkz\" (UniqueName: \"kubernetes.io/projected/31c0c032-d16c-4852-a322-06a878108a18-kube-api-access-zgpkz\") on node \"machine\" DevicePath \"\"" machine # [ 52.928027] k3s[887]: I0922 10:45:13.735957 887 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 52.928800] k3s[887]: I0922 10:45:13.735969 887 reconciler_common.go:299] "Volume detached for volume \"klipper-config\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-config\") on node \"machine\" DevicePath \"\"" machine # [ 52.929711] k3s[887]: I0922 10:45:13.735980 887 reconciler_common.go:299] "Volume detached for volume \"content\" (UniqueName: \"kubernetes.io/configmap/31c0c032-d16c-4852-a322-06a878108a18-content\") on node \"machine\" DevicePath \"\"" machine # [ 52.930630] k3s[887]: I0922 10:45:13.735992 887 reconciler_common.go:299] "Volume detached for volume \"klipper-helm\" (UniqueName: \"kubernetes.io/empty-dir/31c0c032-d16c-4852-a322-06a878108a18-klipper-helm\") on node \"machine\" DevicePath \"\"" machine # [ 53.119270] systemd[1]: var-lib-kubelet-pods-31c0c032\x2dd16c\x2d4852\x2da322\x2d06a878108a18-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dzgpkz.mount: Deactivated successfully. machine # [ 53.120070] systemd[1]: var-lib-kubelet-pods-31c0c032\x2dd16c\x2d4852\x2da322\x2d06a878108a18-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 53.120620] systemd[1]: var-lib-kubelet-pods-31c0c032\x2dd16c\x2d4852\x2da322\x2d06a878108a18-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dcache.mount: Deactivated successfully. machine # [ 53.121108] systemd[1]: var-lib-kubelet-pods-31c0c032\x2dd16c\x2d4852\x2da322\x2d06a878108a18-volumes-kubernetes.io\x7eempty\x2ddir-klipper\x2dhelm.mount: Deactivated successfully. machine # [ 53.335615] dhcpcd[683]: vethf7994f8a: probing for an IPv4LL address machine # [ 53.392262] k3s[887]: I0922 10:45:14.202202 887 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49cb8293d5daf3ab7cdc04b15e5ccb3ab9114d911325e1584996e17067c501ec" machine # [ 53.402686] systemd[1]: Removed slice libcontainer container kubepods-burstable-pod31c0c032_d16c_4852_a322_06a878108a18.slice. machine # [ 53.403852] systemd[1]: kubepods-burstable-pod31c0c032_d16c_4852_a322_06a878108a18.slice: Consumed 585ms CPU time over 5.991s wall clock time, 30.9M memory peak, 2.4M incoming IP traffic, 139.8K outgoing IP traffic. machine # [ 53.408629] dhcpcd[683]: vethb351ab99: soliciting an IPv6 router machine # [ 53.429899] dhcpcd[683]: veth9a91cac0: soliciting a DHCP lease machine # [ 53.449373] dhcpcd[683]: veth9a91cac0: soliciting an IPv6 router machine # [ 53.496621] dhcpcd[683]: veth44e40f15: soliciting an IPv6 router machine # [ 53.531818] dhcpcd[683]: vethfd93888d: soliciting an IPv6 router machine # [ 54.062610] dhcpcd[683]: flannel.1: probing for an IPv4LL address machine # [ 55.536890] k3s[887]: time="2026-09-22T10:45:16Z" level=info msg="Imported docker.io/library/nix-grpc-farm:0.1.0-beta.1" machine # [ 55.540511] k3s[887]: time="2026-09-22T10:45:16Z" level=info msg="Tagged docker.io/library/nix-grpc-farm@sha256:f89fd703c5b55b1b21ab278a45a181626068e93239a8c32943a638f6b2c84a31" machine # [ 55.807419] k3s[887]: time="2026-09-22T10:45:16Z" level=info msg="Imported 1 images from /var/lib/rancher/k3s/agent/images/nix-grpc-farm.tar in 10.060012375s" machine # [ 57.179703] dhcpcd[683]: veth44e40f15: probing for an IPv4LL address machine # [ 57.337778] dhcpcd[683]: vethb351ab99: probing for an IPv4LL address machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 26.87 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s machine # [ 57.674512] dhcpcd[683]: vethfd93888d: probing for an IPv4LL address machine # [ 58.430558] dhcpcd[683]: veth9a91cac0: probing for an IPv4LL address machine # [ 58.902232] dhcpcd[683]: vethf7994f8a: using IPv4LL address 169.254.13.190 machine # [ 58.903685] dhcpcd[683]: vethf7994f8a: adding route to 169.254.0.0/16 machine # [ 58.970722] dhcpcd[683]: flannel.1: using IPv4LL address 169.254.62.255 machine # [ 58.973546] dhcpcd[683]: flannel.1: adding route to 169.254.0.0/16 machine # [ 61.385281] dhcpcd[683]: vethf7994f8a: no IPv6 Routers available machine # [ 62.041271] dhcpcd[683]: vethb351ab99: using IPv4LL address 169.254.111.224 machine # [ 62.044456] dhcpcd[683]: vethb351ab99: adding route to 169.254.0.0/16 machine # [ 62.163208] dhcpcd[683]: flannel.1: no IPv6 Routers available machine # [ 62.181289] dhcpcd[683]: vethfd93888d: using IPv4LL address 169.254.239.156 machine # [ 62.183705] dhcpcd[683]: vethfd93888d: adding route to 169.254.0.0/16 machine # [ 62.574097] dhcpcd[683]: veth44e40f15: using IPv4LL address 169.254.239.181 machine # [ 62.576245] dhcpcd[683]: veth44e40f15: adding route to 169.254.0.0/16 machine # [ 63.202656] dhcpcd[683]: veth9a91cac0: using IPv4LL address 169.254.228.9 machine # [ 63.206341] dhcpcd[683]: veth9a91cac0: adding route to 169.254.0.0/16 machine # [ 65.411265] dhcpcd[683]: vethb351ab99: no IPv6 Routers available machine # [ 65.450774] dhcpcd[683]: veth9a91cac0: no IPv6 Routers available machine # [ 65.498145] dhcpcd[683]: veth44e40f15: no IPv6 Routers available machine # [ 65.533378] dhcpcd[683]: vethfd93888d: no IPv6 Routers available machine # [ 66.324138] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1167818999.mount: Deactivated successfully. machine # [ 66.353609] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2693522919.mount: Deactivated successfully. machine # [ 66.371343] systemd[1]: Started libcontainer container 2a10ae2846943dd1164e4ef1ee92db5b533ed0bc591951e32baf13ed8cd15cd0. machine # [ 66.513471] systemd[1]: Started libcontainer container 23dbb9548e51d1ef0f24e38ee602057db94e25476c6b27259e2feddd7bc6c36a. machine # [ 66.529330] systemd[1]: Started libcontainer container c3a254697742fe614975340e1b80ef69b20d3897c093ad30137d61eb19cd9220. machine # [ 66.532222] niks3-server[1194]: 2026/09/22 10:45:27 INFO lead: acquired remote=10.42.0.6:54118 machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-scheduler --timeout=10s, in 10.05 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s machine # [ 67.697222] systemd[1]: cri-containerd-c3a254697742fe614975340e1b80ef69b20d3897c093ad30137d61eb19cd9220.scope: Deactivated successfully. machine # [ 67.700598] systemd[1]: cri-containerd-c3a254697742fe614975340e1b80ef69b20d3897c093ad30137d61eb19cd9220.scope: Consumed 605ms CPU time over 1.167s wall clock time, 367.9M memory peak, 52M read from disk, 190.5M written to disk. machine # [ 67.704933] systemd[1]: cri-containerd-23dbb9548e51d1ef0f24e38ee602057db94e25476c6b27259e2feddd7bc6c36a.scope: Deactivated successfully. machine # [ 67.707573] systemd[1]: cri-containerd-23dbb9548e51d1ef0f24e38ee602057db94e25476c6b27259e2feddd7bc6c36a.scope: Consumed 616ms CPU time over 1.185s wall clock time, 363.3M memory peak, 47.4M read from disk, 190.5M written to disk. machine # [ 67.751081] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-c3a254697742fe614975340e1b80ef69b20d3897c093ad30137d61eb19cd9220-rootfs.mount: Deactivated successfully. machine # [ 67.756551] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-23dbb9548e51d1ef0f24e38ee602057db94e25476c6b27259e2feddd7bc6c36a-rootfs.mount: Deactivated successfully. machine # [ 68.499897] k3s[887]: I0922 10:45:29.308946 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-scheduler-5844ddf54b-wrkr4" podStartSLOduration=5.721487361 podStartE2EDuration="18.308893581s" totalImagesPullingTime="12.58740622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:45:28.292445681 +0000 UTC m=+47.752114580" watchObservedRunningTime="2026-09-22 10:45:29.308893581 +0000 UTC m=+48.768568626" machine # [ 68.557069] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped3246621651.mount: Deactivated successfully. machine # [ 68.559238] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount3061711170.mount: Deactivated successfully. machine # [ 68.681355] systemd[1]: Started libcontainer container 6923bba49a3d35b7a5e176621e7b02bf4f1945c76aa5f34a09e696b10c7a2b1a. machine # [ 68.735623] systemd[1]: Started libcontainer container 90e636985cfd13c943fec721d8af65354ab1e67a89c80f2c021df3510af7a16e. machine # [ 68.881699] systemd[1]: Started libcontainer container 3e70fe457a94bf9440e60d1c8049a5c56219a176f41a56c97f9d5d36681e8750. machine # [ 68.949377] systemd[1]: Started libcontainer container 360af41455e0886db26b178eb3ceb7916563d4b2f45b0006b57cc1dbe141a390. machine # [ 69.114342] systemd[1]: Started libcontainer container d7847004265b61a567be116dbf1683afde57bc0d181d2fe6968e3322b24b18d1. machine # [ 69.177392] systemd[1]: Started libcontainer container 84e25a31c91655fd2a24dced7a7aac17cd235b0ca58bf99e26e52df98f2a90cc. machine # [ 69.488757] k3s[887]: I0922 10:45:30.298624 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q" podStartSLOduration=3.636525166 podStartE2EDuration="19.298600373s" totalImagesPullingTime="14.538858709s" totalInitContainerRuntime="1.123216498s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:45:30.298481084 +0000 UTC m=+49.758151380" watchObservedRunningTime="2026-09-22 10:45:30.298600373 +0000 UTC m=+49.758269272" machine # [ 71.301565] k3s[887]: I0922 10:45:32.110757 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb" podStartSLOduration=6.342375491 podStartE2EDuration="21.110715879s" totalImagesPullingTime="13.634245133s" totalInitContainerRuntime="1.134095255s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:45:30.309292514 +0000 UTC m=+49.768961972" watchObservedRunningTime="2026-09-22 10:45:32.110715879 +0000 UTC m=+51.570389807" machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-worker-x86-64-linux --timeout=10s, in 4.05 seconds) machine: waiting for unit niks3.service machine: (finished: waiting for unit niks3.service, in 0.06 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.29 seconds) machine: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3 machine: (finished: waiting for success: test $(curl -sf 10.42.0.4:9901/clusters | grep -c 'health_flags::healthy') -ge 3, in 4.39 seconds) machine: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod -l app.kubernetes.io/component=scheduler -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.30 seconds) machine: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2' machine: (finished: waiting for success: curl -sf http://10.42.0.6:9464/metrics | grep -qx 'nix_grpc_sched{kind="workers"} 2', in 0.05 seconds) (finished: subtest: chart deploys and workers become Ready, in 46.07 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=worker --field-selector=status.phase=Running -o jsonpath='{.items[*].metadata.name}', in 0.27 seconds) machine: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt machine: (finished: must succeed: kubectl -n ci create token builder --audience nix-grpc-farm > /tmp/builder.jwt, in 0.23 seconds) subtest: build through the balancer lands in the cache machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1 machine # [ 107.616325] niks3-server[1194]: 2026/09/22 10:46:08 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 107.655611] niks3-server[1194]: 2026/09/22 10:46:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign machine # [ 107.661277] niks3-server[1194]: 2026/09/22 10:46:08 INFO Registered completed upload object_key=nar/0nzzbas7l8d37mridr7mg162smfjvn7lhs6am4crl4ydaxicigj8.nar.zst machine # [ 107.670040] niks3-server[1194]: 2026/09/22 10:46:08 INFO Signed narinfos id=1 count=1 machine # [ 107.671790] niks3-server[1194]: 2026/09/22 10:46:08 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.ls machine # [ 107.676780] niks3-server[1194]: 2026/09/22 10:46:08 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete machine # [ 107.681427] niks3-server[1194]: 2026/09/22 10:46:08 INFO Registered completed upload object_key=yz1sqzb72i8v6h2ass0v76ba8cncqj9r.narinfo machine # [ 107.686119] niks3-server[1194]: 2026/09/22 10:46:08 INFO Completed upload id=1 machine # [ 116.568949] niks3-server[1194]: 2026/09/22 10:46:17 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 116.589863] niks3-server[1194]: 2026/09/22 10:46:17 INFO Registered completed upload object_key=nar/1p7jh5nyz9n68k5f18ymmdpgr34mpnnch1njw7ki7b2b97qlfbjk.nar.zst machine # [ 116.592238] niks3-server[1194]: 2026/09/22 10:46:17 INFO Registered completed upload object_key=log/yz1sqzb72i8v6h2ass0v76ba8cncqj9r-k3s-a.drv machine # [ 116.594694] niks3-server[1194]: 2026/09/22 10:46:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign machine # [ 116.596262] niks3-server[1194]: 2026/09/22 10:46:17 INFO Signed narinfos id=2 count=1 machine # [ 116.600133] niks3-server[1194]: 2026/09/22 10:46:17 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.ls machine # [ 116.604790] niks3-server[1194]: 2026/09/22 10:46:17 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete machine # [ 116.607229] niks3-server[1194]: 2026/09/22 10:46:17 INFO Completed upload id=2 machine # [ 116.609105] niks3-server[1194]: 2026/09/22 10:46:17 INFO Registered completed upload object_key=r95r891injj9ski5c4w89yxjvjy065mx.narinfo machine # [ 116.697372] niks3-server[1194]: 2026/09/22 10:46:17 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 116.709494] niks3-server[1194]: 2026/09/22 10:46:17 INFO Registered completed upload object_key=nar/03a4ywhyr5knmbc93z4gyml5y8fvgb431xvlmfxrwsm8mrb0qgx2.nar.zst machine # [ 116.710520] niks3-server[1194]: 2026/09/22 10:46:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign machine # [ 116.711183] niks3-server[1194]: 2026/09/22 10:46:17 INFO Signed narinfos id=3 count=1 machine # [ 116.715933] niks3-server[1194]: 2026/09/22 10:46:17 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.ls machine # [ 116.717833] niks3-server[1194]: 2026/09/22 10:46:17 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete machine # [ 116.719168] niks3-server[1194]: 2026/09/22 10:46:17 INFO Completed upload id=3 machine # [ 116.720257] niks3-server[1194]: 2026/09/22 10:46:17 INFO Registered completed upload object_key=zfq1xw9bmycqh35l0s44lmv65z4xc7br.narinfo machine # [ 125.376439] niks3-server[1194]: 2026/09/22 10:46:26 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 125.391781] niks3-server[1194]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=nar/05qjsj5ff3a6vnxkhb6k5f3m446dcc206p7cd37w4v3mgi95d7kh.nar.zst machine # [ 125.393974] niks3-server[1194]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=log/zfq1xw9bmycqh35l0s44lmv65z4xc7br-k3s-b.drv machine # [ 125.395795] niks3-server[1194]: 2026/09/22 10:46:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign machine # [ 125.397452] niks3-server[1194]: 2026/09/22 10:46:26 INFO Signed narinfos id=4 count=1 machine # [ 125.400744] niks3-server[1194]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.ls machine # [ 125.404048] niks3-server[1194]: 2026/09/22 10:46:26 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete machine # [ 125.406397] niks3-server[1194]: 2026/09/22 10:46:26 INFO Completed upload id=4 machine # [ 125.408623] niks3-server[1194]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=mrqsh0475wxsmnsvkk55g94v6g5nrcra.narinfo machine # [ 125.505881] niks3-server[1194]: 2026/09/22 10:46:26 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 125.520462] niks3-server[1194]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=nar/0jyw88klkf3nwxpnj5m5lx3i1dv2idf3hcn6im7883hnldm3gvyq.nar.zst machine # [ 125.522789] niks3-server[1194]: 2026/09/22 10:46:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign machine # [ 125.525098] niks3-server[1194]: 2026/09/22 10:46:26 INFO Signed narinfos id=5 count=1 machine # [ 125.526241] niks3-server[1194]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.ls machine # [ 125.529271] niks3-server[1194]: 2026/09/22 10:46:26 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete machine # [ 125.533241] niks3-server[1194]: 2026/09/22 10:46:26 INFO Completed upload id=5 machine # [ 125.534669] niks3-server[1194]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=n40czam6a4ldp1mh5fdmlcy07fv0akbm.narinfo machine # [ 134.202386] niks3-server[1194]: 2026/09/22 10:46:35 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 134.227785] niks3-server[1194]: 2026/09/22 10:46:35 INFO Registered completed upload object_key=nar/1q8vp5xqws560mpf8rxk8r8jhqrzibivh13x4wxy0cfqlzbk7cr5.nar.zst machine # [ 134.232670] niks3-server[1194]: 2026/09/22 10:46:35 INFO Registered completed upload object_key=log/n40czam6a4ldp1mh5fdmlcy07fv0akbm-k3s-top.drv machine # [ 134.236888] niks3-server[1194]: 2026/09/22 10:46:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign machine # [ 134.240760] niks3-server[1194]: 2026/09/22 10:46:35 INFO Signed narinfos id=6 count=1 machine # [ 134.243725] niks3-server[1194]: 2026/09/22 10:46:35 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.ls machine # [ 134.247940] niks3-server[1194]: 2026/09/22 10:46:35 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete machine # [ 134.252231] niks3-server[1194]: 2026/09/22 10:46:35 INFO Completed upload id=6 machine # [ 134.254225] niks3-server[1194]: 2026/09/22 10:46:35 INFO Registered completed upload object_key=0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 2>&1, in 58.18 seconds) machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t1 outPath, in 0.27 seconds) machine: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine: (finished: must fail: test -e /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.02 seconds) machine: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top machine # copying 3 paths... machine # copying path '/nix/store/r95r891injj9ski5c4w89yxjvjy065mx-k3s-a' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/mrqsh0475wxsmnsvkk55g94v6g5nrcra-k3s-b' from 'http://192.168.1.1:5751'... machine # copying path '/nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top' from 'http://192.168.1.1:5751'... machine: (finished: must succeed: nix copy --from http://192.168.1.1:5751 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top && grep k3s-top-t1 /nix/store/0vg7x9rp0cg9wyzr3fn2wj6nw4l33b5c-k3s-top, in 0.35 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1 machine # [ 136.388138] niks3-server[1194]: 2026/09/22 10:46:37 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 136.409260] niks3-server[1194]: 2026/09/22 10:46:37 INFO Registered completed upload object_key=nar/1fr26arhri17j9bj6hyjzmmd74v730biz1gb3kqd194vjx3ccvp9.nar.zst machine # [ 136.413213] niks3-server[1194]: 2026/09/22 10:46:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign machine # [ 136.414975] niks3-server[1194]: 2026/09/22 10:46:37 INFO Signed narinfos id=7 count=1 machine # [ 136.418679] niks3-server[1194]: 2026/09/22 10:46:37 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.ls machine # [ 136.425481] niks3-server[1194]: 2026/09/22 10:46:37 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete machine # [ 136.427284] niks3-server[1194]: 2026/09/22 10:46:37 INFO Completed upload id=7 machine # [ 136.428832] niks3-server[1194]: 2026/09/22 10:46:37 INFO Registered completed upload object_key=pbpqsh50ar10fpasdqqx8xg3lmr5j8iz.narinfo machine # [ 144.710087] niks3-server[1194]: 2026/09/22 10:46:45 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 144.727178] niks3-server[1194]: 2026/09/22 10:46:45 INFO Registered completed upload object_key=log/pbpqsh50ar10fpasdqqx8xg3lmr5j8iz-k3s-a.drv machine # [ 144.731671] niks3-server[1194]: 2026/09/22 10:46:45 INFO Registered completed upload object_key=nar/1hfc6x4x25k3b0fk091d3nb0k3mympfp05fkslcx19synp3ig0zd.nar.zst machine # [ 144.740615] niks3-server[1194]: 2026/09/22 10:46:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign machine # [ 144.743899] niks3-server[1194]: 2026/09/22 10:46:45 INFO Signed narinfos id=8 count=1 machine # [ 144.749667] niks3-server[1194]: 2026/09/22 10:46:45 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.ls machine # [ 144.750783] niks3-server[1194]: 2026/09/22 10:46:45 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete machine # [ 144.751608] niks3-server[1194]: 2026/09/22 10:46:45 INFO Completed upload id=8 machine # [ 144.754150] niks3-server[1194]: 2026/09/22 10:46:45 INFO Registered completed upload object_key=r1wl8yi1c55jrx53153rpsk307x9c14q.narinfo machine # [ 144.847518] niks3-server[1194]: 2026/09/22 10:46:45 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 144.866299] niks3-server[1194]: 2026/09/22 10:46:45 INFO Registered completed upload object_key=nar/0zzq2vgjln4shvh57091n14sam6wh6w06vja6lzb9ppcj4ffyx1n.nar.zst machine # [ 144.869862] niks3-server[1194]: 2026/09/22 10:46:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign machine # [ 144.871061] niks3-server[1194]: 2026/09/22 10:46:45 INFO Signed narinfos id=9 count=1 machine # [ 144.878288] niks3-server[1194]: 2026/09/22 10:46:45 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.ls machine # [ 144.882048] niks3-server[1194]: 2026/09/22 10:46:45 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete machine # [ 144.882757] niks3-server[1194]: 2026/09/22 10:46:45 INFO Completed upload id=9 machine # [ 144.883771] niks3-server[1194]: 2026/09/22 10:46:45 INFO Registered completed upload object_key=894h6wzw2l4w5f0hikj1k6q57jfnyi87.narinfo machine # [ 153.367502] niks3-server[1194]: 2026/09/22 10:46:54 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 153.386648] niks3-server[1194]: 2026/09/22 10:46:54 INFO Registered completed upload object_key=nar/0hh3nqk95r6g32lhdmxw8cxjv694vbpx9876zkhcpg4r4qxni2ch.nar.zst machine # [ 153.389085] niks3-server[1194]: 2026/09/22 10:46:54 INFO Registered completed upload object_key=log/894h6wzw2l4w5f0hikj1k6q57jfnyi87-k3s-b.drv machine # [ 153.392246] niks3-server[1194]: 2026/09/22 10:46:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign machine # [ 153.394266] niks3-server[1194]: 2026/09/22 10:46:54 INFO Signed narinfos id=10 count=1 machine # [ 153.397864] niks3-server[1194]: 2026/09/22 10:46:54 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.ls machine # [ 153.402842] niks3-server[1194]: 2026/09/22 10:46:54 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete machine # [ 153.405751] niks3-server[1194]: 2026/09/22 10:46:54 INFO Registered completed upload object_key=zqhpzdjr9k4lbxyx13lygsbapjhj6jbs.narinfo machine # [ 153.407439] niks3-server[1194]: 2026/09/22 10:46:54 INFO Completed upload id=10 machine # [ 153.512811] niks3-server[1194]: 2026/09/22 10:46:54 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 153.527510] niks3-server[1194]: 2026/09/22 10:46:54 INFO Registered completed upload object_key=nar/0ingamx56k31lwiyxmnxmscjj4n3qfx6sr2kpaynsrwhwz1278iw.nar.zst machine # [ 153.532164] niks3-server[1194]: 2026/09/22 10:46:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign machine # [ 153.532805] niks3-server[1194]: 2026/09/22 10:46:54 INFO Signed narinfos id=11 count=1 machine # [ 153.537778] niks3-server[1194]: 2026/09/22 10:46:54 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete machine # [ 153.539768] niks3-server[1194]: 2026/09/22 10:46:54 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.ls machine # [ 153.541161] niks3-server[1194]: 2026/09/22 10:46:54 INFO Completed upload id=11 machine # [ 153.546796] niks3-server[1194]: 2026/09/22 10:46:54 INFO Registered completed upload object_key=12zw7pp0zj6xgpqjxdyfrj7gbr252z3g.narinfo machine # [ 162.196244] niks3-server[1194]: 2026/09/22 10:47:03 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 162.211271] niks3-server[1194]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=nar/0v48x4sp58bvfra08axgkz7yl1n9nc4nirskyv1hwann4i7q277i.nar.zst machine # [ 162.213795] niks3-server[1194]: 2026/09/22 10:47:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign machine # [ 162.215773] niks3-server[1194]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=log/12zw7pp0zj6xgpqjxdyfrj7gbr252z3g-k3s-top.drv machine # [ 162.217819] niks3-server[1194]: 2026/09/22 10:47:03 INFO Signed narinfos id=12 count=1 machine # [ 162.220475] niks3-server[1194]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=5nkgigdq00qnxqr4vvknpjyrrz7d5rih.ls machine # [ 162.224257] niks3-server[1194]: 2026/09/22 10:47:03 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete machine # [ 162.227258] niks3-server[1194]: 2026/09/22 10:47:03 INFO Completed upload id=12 machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t2 2>&1, in 27.33 seconds) (finished: subtest: build through the balancer lands in the cache, in 86.15 seconds) subtest: a Job with the client image builds through the farm with its service account machine: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt machine: (finished: must succeed: kubectl -n ci create configmap nix-grpc-farm-ca --from-file=ca.crt=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt, in 0.21 seconds) machine: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix machine: (finished: must succeed: kubectl -n ci create configmap job --from-file=job.nix=/nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --from-file=flake.nix=/nix/store/b7xpzyk27yxzb4n6qbkzaknbd7x4jfx9-flake.nix, in 0.22 seconds) machine: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json machine: (finished: must succeed: kubectl apply -f /nix/store/xmn7479wyv43i1vcg4rqv7yh3mwzvqd3-ci-job.json, in 0.24 seconds) machine: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed' machine # [ 164.698667] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod83356cb4_6e78_4f68_81d3_5a6e058ca98d.slice. machine # [ 164.740192] k3s[887]: I0922 10:47:05.549240 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"job\" (UniqueName: \"kubernetes.io/configmap/83356cb4-6e78-4f68-81d3-5a6e058ca98d-job\") pod \"ci-hh2sw\" (UID: \"83356cb4-6e78-4f68-81d3-5a6e058ca98d\") " pod="ci/ci-hh2sw" machine # [ 164.742213] k3s[887]: I0922 10:47:05.549359 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9j5h\" (UniqueName: \"kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-kube-api-access-m9j5h\") pod \"ci-hh2sw\" (UID: \"83356cb4-6e78-4f68-81d3-5a6e058ca98d\") " pod="ci/ci-hh2sw" machine # [ 164.744299] k3s[887]: I0922 10:47:05.549432 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-nix-grpc-farm\") pod \"ci-hh2sw\" (UID: \"83356cb4-6e78-4f68-81d3-5a6e058ca98d\") " pod="ci/ci-hh2sw" machine # [ 165.189520] cni0: port 2(vethef20fdf9) entered blocking state machine # [ 165.190945] cni0: port 2(vethef20fdf9) entered disabled state machine # [ 165.192700] vethef20fdf9: entered allmulticast mode machine # [ 165.195296] vethef20fdf9: entered promiscuous mode machine # [ 165.209584] cni0: port 2(vethef20fdf9) entered blocking state machine # [ 165.211510] cni0: port 2(vethef20fdf9) entered forwarding state machine # [ 165.138097] (udev-worker)[4478]: Network interface NamePolicy= disabled on kernel command line. machine # [ 165.187844] dhcpcd[683]: vethef20fdf9: IAID 03:74:aa:67 machine # [ 165.189315] dhcpcd[683]: vethef20fdf9: adding address fe80::d8e6:3ff:fe74:aa67 machine # [ 165.201523] systemd[1]: Started libcontainer container 17f2ecaadbbca5456479561f8e54669dbcf59b43a0d0daafa0c938a68174f62c. machine # [ 166.409266] dhcpcd[683]: vethef20fdf9: soliciting an IPv6 router machine # [ 166.731690] dhcpcd[683]: vethef20fdf9: soliciting a DHCP lease machine # [ 167.605509] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount662109429.mount: Deactivated successfully. machine # [ 167.644387] systemd[1]: Started libcontainer container 56884f31b43ec0d8e84be2d8a63ec5364598f2b25453ddb75f9fc7c1d6542e82. machine # [ 169.051610] niks3-server[1194]: 2026/09/22 10:47:09 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 169.098174] niks3-server[1194]: 2026/09/22 10:47:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign machine # [ 169.098993] niks3-server[1194]: 2026/09/22 10:47:09 INFO Registered completed upload object_key=nar/111g6dyibwcf2z7jhpn72rgja0qvjgpdiv9nc06g2dp7ih0a6kyq.nar.zst machine # [ 169.099574] niks3-server[1194]: 2026/09/22 10:47:09 INFO Signed narinfos id=13 count=1 machine # [ 169.105194] niks3-server[1194]: 2026/09/22 10:47:09 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.ls machine # [ 169.111199] niks3-server[1194]: 2026/09/22 10:47:09 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete machine # [ 169.113653] niks3-server[1194]: 2026/09/22 10:47:09 INFO Completed upload id=13 machine # [ 169.116858] niks3-server[1194]: 2026/09/22 10:47:09 INFO Registered completed upload object_key=fb6zgh20gn6ix96sz5fv2gzdaffbjhws.narinfo machine # [ 171.733100] dhcpcd[683]: vethef20fdf9: probing for an IPv4LL address machine # [ 177.039755] dhcpcd[683]: vethef20fdf9: using IPv4LL address 169.254.70.108 machine # [ 177.044130] dhcpcd[683]: vethef20fdf9: adding route to 169.254.0.0/16 machine # [ 178.179837] niks3-server[1194]: 2026/09/22 10:47:18 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 178.326264] niks3-server[1194]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=log/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # [ 178.328761] niks3-server[1194]: 2026/09/22 10:47:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign machine # [ 178.330325] niks3-server[1194]: 2026/09/22 10:47:19 INFO Signed narinfos id=14 count=1 machine # [ 178.334189] niks3-server[1194]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=nar/058kjd2vfl1r27b4d9ixvwf77d8rkr18a4v894kwx8lg0nwpajnr.nar.zst machine # [ 178.339613] niks3-server[1194]: 2026/09/22 10:47:19 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete machine # [ 178.341299] niks3-server[1194]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.ls machine # [ 178.346791] niks3-server[1194]: 2026/09/22 10:47:19 INFO Completed upload id=14 machine # [ 178.353757] niks3-server[1194]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=gpvd12kzis7szd8w51klc50y5fsyav70.narinfo machine # [ 178.412593] dhcpcd[683]: vethef20fdf9: no IPv6 Routers available machine # [ 178.463723] niks3-server[1194]: 2026/09/22 10:47:19 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 178.485673] niks3-server[1194]: 2026/09/22 10:47:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign machine # [ 178.489880] niks3-server[1194]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=nar/138ynhcd5wxzz485x9qcq7xsargaklrf2li31ai69m5r46am35q6.nar.zst machine # [ 178.494264] niks3-server[1194]: 2026/09/22 10:47:19 INFO Signed narinfos id=15 count=1 machine # [ 178.496492] niks3-server[1194]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.ls machine # [ 178.499681] niks3-server[1194]: 2026/09/22 10:47:19 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete machine # [ 178.502888] niks3-server[1194]: 2026/09/22 10:47:19 INFO Completed upload id=15 machine # [ 178.505484] niks3-server[1194]: 2026/09/22 10:47:19 INFO Registered completed upload object_key=1fq6z4j3ry021a66ia281js0yid1pi8j.narinfo machine # [ 187.186869] niks3-server[1194]: 2026/09/22 10:47:27 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 187.203536] niks3-server[1194]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=log/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # [ 187.205345] niks3-server[1194]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=nar/0n4lbdlp8w72fs3qbavl2lwrzbrn55i2b1vyglc89cc3pi8vbb1m.nar.zst machine # [ 187.207464] niks3-server[1194]: 2026/09/22 10:47:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign machine # [ 187.208570] niks3-server[1194]: 2026/09/22 10:47:28 INFO Signed narinfos id=16 count=1 machine # [ 187.212453] niks3-server[1194]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.ls machine # [ 187.214893] niks3-server[1194]: 2026/09/22 10:47:28 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete machine # [ 187.216798] niks3-server[1194]: 2026/09/22 10:47:28 INFO Completed upload id=16 machine # [ 187.226260] niks3-server[1194]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=6d6fywl171qq44fqg0h0gzya2y3sml0p.narinfo machine # [ 187.326559] niks3-server[1194]: 2026/09/22 10:47:28 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 187.340837] niks3-server[1194]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=nar/1f3gvnvqsm2pm3laixkxkg44kvjb251zqhszcfpp0a00h6x66ljs.nar.zst machine # [ 187.342725] niks3-server[1194]: 2026/09/22 10:47:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign machine # [ 187.344052] niks3-server[1194]: 2026/09/22 10:47:28 INFO Signed narinfos id=17 count=1 machine # [ 187.346397] niks3-server[1194]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.ls machine # [ 187.350378] niks3-server[1194]: 2026/09/22 10:47:28 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete machine # [ 187.351982] niks3-server[1194]: 2026/09/22 10:47:28 INFO Completed upload id=17 machine # [ 187.355308] niks3-server[1194]: 2026/09/22 10:47:28 INFO Registered completed upload object_key=rccnai4l0r1y75cnyfrxd9xk26kkd7lg.narinfo machine # [ 196.037617] niks3-server[1194]: 2026/09/22 10:47:36 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 196.058427] niks3-server[1194]: 2026/09/22 10:47:36 INFO Registered completed upload object_key=nar/1zwf0asrdv12q40fmqga5lx5330dvn9y4in4i9ficz9ij5lhvnf5.nar.zst machine # [ 196.059304] niks3-server[1194]: 2026/09/22 10:47:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign machine # [ 196.059898] niks3-server[1194]: 2026/09/22 10:47:36 INFO Registered completed upload object_key=log/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # [ 196.060560] niks3-server[1194]: 2026/09/22 10:47:36 INFO Signed narinfos id=18 count=1 machine # [ 196.066697] niks3-server[1194]: 2026/09/22 10:47:36 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete machine # [ 196.067914] niks3-server[1194]: 2026/09/22 10:47:36 INFO Registered completed upload object_key=a7wc2s1svbimnjgrgl4hkq86pi15mpjn.ls machine # [ 196.069181] niks3-server[1194]: 2026/09/22 10:47:36 INFO Completed upload id=18 machine # [ 197.725060] niks3-server[1194]: 2026/09/22 10:47:38 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 197.738049] niks3-server[1194]: 2026/09/22 10:47:38 INFO Registered completed upload object_key=nar/0xiyqcsl8db7dnrq2gqnx5izavr51ma3dcdswrriaxfgj3qzk7xf.nar.zst machine # [ 197.740259] niks3-server[1194]: 2026/09/22 10:47:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign machine # [ 197.742337] niks3-server[1194]: 2026/09/22 10:47:38 INFO Signed narinfos id=19 count=1 machine # [ 197.743682] niks3-server[1194]: 2026/09/22 10:47:38 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.ls machine # [ 197.745665] niks3-server[1194]: 2026/09/22 10:47:38 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete machine # [ 197.748047] niks3-server[1194]: 2026/09/22 10:47:38 INFO Completed upload id=19 machine # [ 197.749381] niks3-server[1194]: 2026/09/22 10:47:38 INFO Registered completed upload object_key=fm28nk4zj5837pwx4c8iv6ds8919r62h.narinfo machine # [ 206.616338] niks3-server[1194]: 2026/09/22 10:47:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 206.632443] niks3-server[1194]: 2026/09/22 10:47:47 INFO Registered completed upload object_key=nar/0p3l2z3riilylr2rxb1aq2blxdfxg55wbgp4gxkns93srbr4bwyq.nar.zst machine # [ 206.634689] niks3-server[1194]: 2026/09/22 10:47:47 INFO Registered completed upload object_key=log/fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # [ 206.637096] niks3-server[1194]: 2026/09/22 10:47:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign machine # [ 206.639833] niks3-server[1194]: 2026/09/22 10:47:47 INFO Signed narinfos id=20 count=1 machine # [ 206.641247] niks3-server[1194]: 2026/09/22 10:47:47 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.ls machine # [ 206.645421] niks3-server[1194]: 2026/09/22 10:47:47 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete machine # [ 206.648373] niks3-server[1194]: 2026/09/22 10:47:47 INFO Completed upload id=20 machine # [ 206.649680] niks3-server[1194]: 2026/09/22 10:47:47 INFO Registered completed upload object_key=pg3nlwkwpr2na0lv1p4pqqrk1s647g16.narinfo machine # [ 207.812843] systemd[1]: cri-containerd-56884f31b43ec0d8e84be2d8a63ec5364598f2b25453ddb75f9fc7c1d6542e82.scope: Deactivated successfully. machine # [ 207.815056] systemd[1]: cri-containerd-56884f31b43ec0d8e84be2d8a63ec5364598f2b25453ddb75f9fc7c1d6542e82.scope: Consumed 854ms CPU time over 40.168s wall clock time, 125.8M memory peak, 73.1M read from disk, 424K written to disk, 16.5K incoming IP traffic, 44.1K outgoing IP traffic. machine # [ 207.861071] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-56884f31b43ec0d8e84be2d8a63ec5364598f2b25453ddb75f9fc7c1d6542e82-rootfs.mount: Deactivated successfully. machine # [ 209.005094] systemd[1]: cri-containerd-17f2ecaadbbca5456479561f8e54669dbcf59b43a0d0daafa0c938a68174f62c.scope: Deactivated successfully. machine # [ 209.070565] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-17f2ecaadbbca5456479561f8e54669dbcf59b43a0d0daafa0c938a68174f62c-rootfs.mount: Deactivated successfully. machine # [ 209.113630] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-17f2ecaadbbca5456479561f8e54669dbcf59b43a0d0daafa0c938a68174f62c-shm.mount: Deactivated successfully. machine # [ 209.311616] cni0: port 2(vethef20fdf9) entered disabled state machine # [ 209.165465] dhcpcd[683]: vethef20fdf9: carrier lost machine # [ 209.316583] vethef20fdf9 (unregistering): left allmulticast mode machine # [ 209.318055] vethef20fdf9 (unregistering): left promiscuous mode machine # [ 209.319705] cni0: port 2(vethef20fdf9) entered disabled state machine # [ 209.197398] systemd[1]: run-netns-cni\x2daf515247\x2dfb66\x2d7f1b\x2dd2dd\x2d689ceadaf9a4.mount: Deactivated successfully. machine # [ 209.218136] dhcpcd[683]: vethef20fdf9: deleting address fe80::d8e6:3ff:fe74:aa67 machine # [ 209.222268] dhcpcd[683]: vethef20fdf9: deleting route to 169.254.0.0/16 machine # [ 209.297339] k3s[887]: I0922 10:47:50.106912 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-kube-api-access-m9j5h\" (UniqueName: \"kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-kube-api-access-m9j5h\") pod \"83356cb4-6e78-4f68-81d3-5a6e058ca98d\" (UID: \"83356cb4-6e78-4f68-81d3-5a6e058ca98d\") " machine # [ 209.298714] k3s[887]: I0922 10:47:50.106970 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-nix-grpc-farm\") pod \"83356cb4-6e78-4f68-81d3-5a6e058ca98d\" (UID: \"83356cb4-6e78-4f68-81d3-5a6e058ca98d\") " machine # [ 209.299657] k3s[887]: I0922 10:47:50.107005 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83356cb4-6e78-4f68-81d3-5a6e058ca98d-job\" (UniqueName: \"kubernetes.io/configmap/83356cb4-6e78-4f68-81d3-5a6e058ca98d-job\") pod \"83356cb4-6e78-4f68-81d3-5a6e058ca98d\" (UID: \"83356cb4-6e78-4f68-81d3-5a6e058ca98d\") " machine # [ 209.300930] k3s[887]: I0922 10:47:50.107459 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83356cb4-6e78-4f68-81d3-5a6e058ca98d-job" pod "83356cb4-6e78-4f68-81d3-5a6e058ca98d" (UID: "83356cb4-6e78-4f68-81d3-5a6e058ca98d"). InnerVolumeSpecName "job". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 209.309543] systemd[1]: var-lib-kubelet-pods-83356cb4\x2d6e78\x2d4f68\x2d81d3\x2d5a6e058ca98d-volumes-kubernetes.io\x7eprojected-kube\x2dapi\x2daccess\x2dm9j5h.mount: Deactivated successfully. machine # [ 209.320360] k3s[887]: I0922 10:47:50.130134 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-kube-api-access-m9j5h" pod "83356cb4-6e78-4f68-81d3-5a6e058ca98d" (UID: "83356cb4-6e78-4f68-81d3-5a6e058ca98d"). InnerVolumeSpecName "kube-api-access-m9j5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 209.326402] systemd[1]: var-lib-kubelet-pods-83356cb4\x2d6e78\x2d4f68\x2d81d3\x2d5a6e058ca98d-volumes-kubernetes.io\x7eprojected-nix\x2dgrpc\x2dfarm.mount: Deactivated successfully. machine # [ 209.333540] k3s[887]: I0922 10:47:50.143505 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-nix-grpc-farm" pod "83356cb4-6e78-4f68-81d3-5a6e058ca98d" (UID: "83356cb4-6e78-4f68-81d3-5a6e058ca98d"). InnerVolumeSpecName "nix-grpc-farm". PluginName "kubernetes.io/projected", VolumeGIDValue "" machine # [ 209.346297] dhcpcd[683]: vethef20fdf9: removing interface machine # [ 209.397330] k3s[887]: I0922 10:47:50.207279 887 reconciler_common.go:299] "Volume detached for volume \"job\" (UniqueName: \"kubernetes.io/configmap/83356cb4-6e78-4f68-81d3-5a6e058ca98d-job\") on node \"machine\" DevicePath \"\"" machine # [ 209.398119] k3s[887]: I0922 10:47:50.207324 887 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9j5h\" (UniqueName: \"kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-kube-api-access-m9j5h\") on node \"machine\" DevicePath \"\"" machine # [ 209.398770] k3s[887]: I0922 10:47:50.207346 887 reconciler_common.go:299] "Volume detached for volume \"nix-grpc-farm\" (UniqueName: \"kubernetes.io/projected/83356cb4-6e78-4f68-81d3-5a6e058ca98d-nix-grpc-farm\") on node \"machine\" DevicePath \"\"" machine # [ 209.979685] k3s[887]: I0922 10:47:50.789643 887 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17f2ecaadbbca5456479561f8e54669dbcf59b43a0d0daafa0c938a68174f62c" machine # [ 209.986171] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod83356cb4_6e78_4f68_81d3_5a6e058ca98d.slice. machine # [ 209.987197] systemd[1]: kubepods-besteffort-pod83356cb4_6e78_4f68_81d3_5a6e058ca98d.slice: Consumed 888ms CPU time over 45.287s wall clock time, 126.1M memory peak, 73.1M read from disk, 628K written to disk, 16.5K incoming IP traffic, 44.1K outgoing IP traffic. machine: (finished: waiting for success: kubectl -n ci get job ci -o jsonpath='{.status.conditions[*].type}' | grep -qE 'Complete|Failed', in 47.16 seconds) machine: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1 machine: (finished: must succeed: kubectl -n ci get job ci -o jsonpath='{.status.succeeded}' | grep -qx 1, in 0.18 seconds) machine # don't know how to build these paths: machine # /nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-a> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q: building fb6zgh20gn6ix96sz5fv2gzdaffbjhws-k3s-a.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-b> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q: building 1fq6z4j3ry021a66ia281js0yid1pi8j-k3s-b.drv machine # copying 1 paths to 'nix-grpc-farm.farm.svc:50051'... machine # copying path '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' to 'nix-grpc-farm.farm.svc:50051'... machine # building '/nix/store/rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv' on nix-grpc-farm.farm.svc:50051... machine # k3s-top> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q: building rccnai4l0r1y75cnyfrxd9xk26kkd7lg-k3s-top.drv machine # INFO:nix_fast_build.processes:run nix-eval-jobs --gc-roots-dir /tmp/tmpet2px5mu/gcroots --force-recurse --max-memory-size 4096 --workers 4 --flake '.#checks' --check-cache-status machine # INFO:nix_fast_build.workers:builds: 0 machine # warning: Git tree '/tmp' is dirty machine # warning: Git tree '/tmp' is dirty machine # ▶ x86_64-linux.t started machine # INFO:nix_fast_build.workers:builds: 2 machine # ✔ x86_64-linux.t (11s) machine # x86_64-linux.t> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb: building fm28nk4zj5837pwx4c8iv6ds8919r62h-nfb-ci.drv machine # warning: Git tree '/tmp' is dirty machine: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag ci outPath, in 0.19 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/a7wc2s1svbimnjgrgl4hkq86pi15mpjn.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: a Job with the client image builds through the farm with its service account, in 48.58 seconds) subtest: a renewed balancer certificate is served without a rollout machine: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f - machine # Warning: resource secrets/farm-lb-tls is missing the kubectl.kubernetes.io/last-applied-configuration annotation which is required by kubectl apply. kubectl apply should only be used on resources created declaratively by either kubectl create --save-config or kubectl apply. The missing annotation will be patched automatically. machine: (finished: must succeed: kubectl -n farm create secret tls farm-lb-tls --cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.crt --key=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/lb-renewed.key --dry-run=client -o yaml | kubectl -n farm apply -f -, in 0.37 seconds) machine: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}' machine: (finished: must succeed: kubectl -n farm get pods -l app.kubernetes.io/component=lb -o jsonpath='{.items[0].metadata.name}', in 0.66 seconds) machine: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-rvgn2 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine # [ 213.229272] k3s[887]: E0922 10:47:54.038727 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51124: use of closed network connection machine # [ 214.499119] k3s[887]: E0922 10:47:55.308553 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51142: use of closed network connection machine # [ 215.802227] k3s[887]: E0922 10:47:56.611473 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51166: use of closed network connection machine # [ 217.096386] k3s[887]: E0922 10:47:57.905945 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51184: use of closed network connection machine # [ 218.339943] k3s[887]: E0922 10:47:59.149584 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51210: use of closed network connection machine # [ 219.617758] k3s[887]: E0922 10:48:00.427244 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51236: use of closed network connection machine # [ 222.251547] k3s[887]: E0922 10:48:03.060543 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:51292: use of closed network connection machine # [ 223.568744] k3s[887]: E0922 10:48:04.378094 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44928: use of closed network connection machine # [ 224.849680] k3s[887]: E0922 10:48:05.658771 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44954: use of closed network connection machine # [ 224.850745] k3s[887]: E0922 10:48:05.658820 887 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:57882->127.0.0.1:10010: write tcp 127.0.0.1:57882->127.0.0.1:10010: write: broken pipe machine # [ 224.852067] k3s[887]: time="2026-09-22T10:48:05Z" level=warning msg="Proxy error: read failed: read tcp 127.0.0.1:40174->127.0.0.1:10250: read: connection reset by peer" machine # [ 224.852805] k3s[887]: time="2026-09-22T10:48:05Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:40174->127.0.0.1:10250: write: broken pipe" machine # [ 226.167840] k3s[887]: E0922 10:48:06.977498 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:44982: use of closed network connection machine # [ 227.469207] k3s[887]: E0922 10:48:08.275400 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45008: use of closed network connection machine # [ 228.721869] k3s[887]: E0922 10:48:09.531254 887 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:57908->127.0.0.1:10010: write tcp 127.0.0.1:57908->127.0.0.1:10010: write: connection reset by peer machine # [ 228.725377] k3s[887]: E0922 10:48:09.531427 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45042: use of closed network connection machine # [ 230.034833] k3s[887]: E0922 10:48:10.844261 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45072: use of closed network connection machine # [ 231.348826] k3s[887]: E0922 10:48:12.157975 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45106: use of closed network connection machine # [ 232.724070] k3s[887]: E0922 10:48:13.533667 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:45134: use of closed network connection machine # [ 234.083784] k3s[887]: E0922 10:48:14.893445 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60316: use of closed network connection machine # [ 235.454178] k3s[887]: E0922 10:48:16.261475 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60344: use of closed network connection machine # [ 236.813479] k3s[887]: E0922 10:48:17.622753 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60370: use of closed network connection machine # [ 239.428211] k3s[887]: E0922 10:48:20.237563 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60442: use of closed network connection machine # [ 240.768726] k3s[887]: E0922 10:48:21.578304 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60464: use of closed network connection machine # [ 242.102516] k3s[887]: E0922 10:48:22.911876 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:60496: use of closed network connection machine # [ 243.348404] k3s[887]: E0922 10:48:24.157602 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39258: use of closed network connection machine # [ 244.646919] k3s[887]: E0922 10:48:25.456527 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39286: use of closed network connection machine # [ 245.998881] k3s[887]: E0922 10:48:26.808184 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39310: use of closed network connection machine # [ 247.343263] k3s[887]: E0922 10:48:28.152839 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39334: use of closed network connection machine # [ 248.693255] k3s[887]: E0922 10:48:29.502508 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39364: use of closed network connection machine # [ 250.031919] k3s[887]: E0922 10:48:30.841189 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39388: use of closed network connection machine # [ 251.447321] k3s[887]: E0922 10:48:32.256389 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39420: use of closed network connection machine # [ 252.836319] k3s[887]: E0922 10:48:33.645864 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:39450: use of closed network connection machine # [ 254.235972] k3s[887]: E0922 10:48:35.045440 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:42200: use of closed network connection machine: (finished: waiting for success: kubectl -n farm exec nix-grpc-farm-lb-68c8f49bd6-rvgn2 -- cat /etc/envoy/tls/lb/tls.crt | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 41.33 seconds) machine: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example machine: (finished: waiting for success: openssl s_client -connect 127.0.0.1:30051 /dev/null | openssl x509 -noout -ext subjectAltName | grep -q renewed.example, in 0.06 seconds) machine: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1 machine # [ 254.701197] niks3-server[1194]: 2026/09/22 10:48:35 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 254.720097] niks3-server[1194]: 2026/09/22 10:48:35 INFO Registered completed upload object_key=nar/0g42hgwa9jp9abmqxz90dkwxpybsznzbpsy35rm921mlk5sw56jq.nar.zst machine # [ 254.722243] niks3-server[1194]: 2026/09/22 10:48:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign machine # [ 254.724508] niks3-server[1194]: 2026/09/22 10:48:35 INFO Signed narinfos id=21 count=1 machine # [ 254.726502] niks3-server[1194]: 2026/09/22 10:48:35 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.ls machine # [ 254.733523] niks3-server[1194]: 2026/09/22 10:48:35 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete machine # [ 254.737219] niks3-server[1194]: 2026/09/22 10:48:35 INFO Completed upload id=21 machine # [ 254.739720] niks3-server[1194]: 2026/09/22 10:48:35 INFO Registered completed upload object_key=0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31.narinfo machine # [ 263.226745] niks3-server[1194]: 2026/09/22 10:48:44 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 263.251355] niks3-server[1194]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=nar/1vxmmzwi16s4iri6dcmi9v62dpq1ys7wz15b497ncik3sd67nfzg.nar.zst machine # [ 263.253082] niks3-server[1194]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=log/0hkdl0zrqkc6m0v0jc2gzmsjsynmsw31-k3s-a.drv machine # [ 263.258230] niks3-server[1194]: 2026/09/22 10:48:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign machine # [ 263.260514] niks3-server[1194]: 2026/09/22 10:48:44 INFO Signed narinfos id=22 count=1 machine # [ 263.264042] niks3-server[1194]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.ls machine # [ 263.271892] niks3-server[1194]: 2026/09/22 10:48:44 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete machine # [ 263.275344] niks3-server[1194]: 2026/09/22 10:48:44 INFO Completed upload id=22 machine # [ 263.277272] niks3-server[1194]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=x1rn55sjk6z5bdv1lzma81ydfwp93qzx.narinfo machine # [ 263.385668] niks3-server[1194]: 2026/09/22 10:48:44 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 263.399886] niks3-server[1194]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=nar/0cbxkyxz068xc5mivh2h67kw6y01n1x28cbs11v1a03g8m4c71zm.nar.zst machine # [ 263.403836] niks3-server[1194]: 2026/09/22 10:48:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign machine # [ 263.406162] niks3-server[1194]: 2026/09/22 10:48:44 INFO Signed narinfos id=23 count=1 machine # [ 263.407529] niks3-server[1194]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.ls machine # [ 263.411445] niks3-server[1194]: 2026/09/22 10:48:44 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete machine # [ 263.413572] niks3-server[1194]: 2026/09/22 10:48:44 INFO Completed upload id=23 machine # [ 263.415391] niks3-server[1194]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4.narinfo machine # [ 272.292888] niks3-server[1194]: 2026/09/22 10:48:53 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 272.313638] niks3-server[1194]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=log/rymqqkkn6wq4pbxaiigc5qw0cnd1mjw4-k3s-b.drv machine # [ 272.318965] niks3-server[1194]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=nar/0khxywxb2r78vhpc5hsmha3ymgp910z0aka7550jmaqzs333rmzp.nar.zst machine # [ 272.324773] niks3-server[1194]: 2026/09/22 10:48:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign machine # [ 272.330353] niks3-server[1194]: 2026/09/22 10:48:53 INFO Signed narinfos id=24 count=1 machine # [ 272.333407] niks3-server[1194]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.ls machine # [ 272.337126] niks3-server[1194]: 2026/09/22 10:48:53 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete machine # [ 272.340987] niks3-server[1194]: 2026/09/22 10:48:53 INFO Completed upload id=24 machine # [ 272.343537] niks3-server[1194]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=gxh64g2i0y0n37wabfxp5k8jr79mvikp.narinfo machine # [ 272.415439] niks3-server[1194]: 2026/09/22 10:48:53 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 272.428899] niks3-server[1194]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=nar/04bim5f8bvjh25xncf5x40kb529khrlzcbc92qxvapgbc0bdfv2h.nar.zst machine # [ 272.431407] niks3-server[1194]: 2026/09/22 10:48:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign machine # [ 272.433454] niks3-server[1194]: 2026/09/22 10:48:53 INFO Signed narinfos id=25 count=1 machine # [ 272.434621] niks3-server[1194]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.ls machine # [ 272.437505] niks3-server[1194]: 2026/09/22 10:48:53 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete machine # [ 272.439317] niks3-server[1194]: 2026/09/22 10:48:53 INFO Completed upload id=25 machine # [ 272.441192] niks3-server[1194]: 2026/09/22 10:48:53 INFO Registered completed upload object_key=jz7biafi8rj5r3r392blyazw5mdpvy0d.narinfo machine # [ 280.915474] niks3-server[1194]: 2026/09/22 10:49:01 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 280.932176] niks3-server[1194]: 2026/09/22 10:49:01 INFO Registered completed upload object_key=nar/11f7f1hixry25c2yc6np9hs10a2pwwqmymmrxxbswhdjabcyvv0s.nar.zst machine # [ 280.933508] niks3-server[1194]: 2026/09/22 10:49:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign machine # [ 280.936573] niks3-server[1194]: 2026/09/22 10:49:01 INFO Signed narinfos id=26 count=1 machine # [ 280.940542] niks3-server[1194]: 2026/09/22 10:49:01 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete machine # [ 280.946304] niks3-server[1194]: 2026/09/22 10:49:01 INFO Registered completed upload object_key=log/jz7biafi8rj5r3r392blyazw5mdpvy0d-k3s-top.drv machine # [ 280.947264] niks3-server[1194]: 2026/09/22 10:49:01 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.ls machine # [ 280.953604] niks3-server[1194]: 2026/09/22 10:49:01 INFO Completed upload id=26 machine # [ 280.955940] niks3-server[1194]: 2026/09/22 10:49:01 INFO Registered completed upload object_key=a35mdcwbgm2yxm8gj2iqp3ksr0iw0iim.narinfo machine: (finished: must succeed: nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/zl4740k1rgvbgw035vqa4ldp1dfcxzr4-job.nix --argstr tag t-renewed 2>&1, in 26.69 seconds) (finished: subtest: a renewed balancer certificate is served without a rollout, in 69.12 seconds) subtest: metrics carry build_info machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -o jsonpath='{.items[0].status.podIP}{.status.podIP}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -o jsonpath='{.items[0].status.podIP}{.status.podIP}', in 0.22 seconds) machine: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q"' machine: (finished: must succeed: curl -sf http://10.42.0.7:9464/metrics | grep -E 'nix_grpc_build_info\{.*worker="machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q"', in 0.05 seconds) (finished: subtest: metrics carry build_info, in 0.27 seconds) subtest: harmonia-gc frees space and the worker stays Ready machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'' machine # [ 281.541326] k3s[887]: E0922 10:49:02.350863 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38030: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc -- sh -c 'df -B1 /nix/store | awk '"'"'NR==2 {print $4}'"'"'', in 0.28 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done' machine # [ 281.907572] k3s[887]: E0922 10:49:02.717291 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:38066: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c nix-daemon -- sh -c 'for i in 1 2 3; do echo $i > /tmp/g$i; nix-store --add /tmp/g$i; done', in 0.37 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc -- sh -c 'fallocate -l 11466862592 /nix/fill' machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc -- sh -c 'fallocate -l 11466862592 /nix/fill', in 0.30 seconds) machine: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc --since=30s | grep -q 'store paths deleted' machine: (finished: waiting for success: kubectl -n farm logs nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc --since=30s | grep -q 'store paths deleted', in 8.02 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc -- sh -c 'rm /nix/fill' machine # [ 290.532624] k3s[887]: E0922 10:49:11.342000 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:56002: use of closed network connection machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc -- sh -c 'rm /nix/fill', in 0.30 seconds) machine: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}' machine: (finished: must succeed: kubectl -n farm get pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -o jsonpath='{.status.conditions[?(@.type=="Ready")].status}', in 0.20 seconds) machine: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc -- sh -c 'command -v nix-daemon && command -v niks3' machine: (finished: must succeed: kubectl -n farm exec nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q -c gc -- sh -c 'command -v nix-daemon && command -v niks3', in 0.32 seconds) (finished: subtest: harmonia-gc frees space and the worker stays Ready, in 9.80 seconds) subtest: losing the balancer mid-build: the client reconnects and the build succeeds machine: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1 machine # [ 291.110226] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1. machine # Running as unit: vialb.service; invocation ID: a7c793ba525344c8af20b6005ed952a8 machine: (finished: must succeed: systemd-run --unit vialb nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag lb1, in 0.05 seconds) machine: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'" machine # [ 291.320265] nix[8162]: don't know how to build these paths: machine # [ 291.321532] nix[8162]: /nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 291.335881] nix[8162]: copying 1 paths to '127.0.0.1:30051'... machine # [ 291.337538] nix[8162]: copying path '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' to '127.0.0.1:30051'... machine # [ 291.412633] niks3-server[1194]: 2026/09/22 10:49:12 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 291.428952] niks3-server[1194]: 2026/09/22 10:49:12 INFO Registered completed upload object_key=nar/0kkr2vb091wkq0cb0f1q92413dsfskh76wydp8mwysv7rawns0ar.nar.zst machine # [ 291.431086] niks3-server[1194]: 2026/09/22 10:49:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign machine # [ 291.432191] niks3-server[1194]: 2026/09/22 10:49:12 INFO Signed narinfos id=27 count=1 machine # [ 291.436047] niks3-server[1194]: 2026/09/22 10:49:12 INFO Registered completed upload object_key=d3pzijs4zz7gwai9b8n1j50g96lqiii4.ls machine # [ 291.439866] niks3-server[1194]: 2026/09/22 10:49:12 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete machine # [ 291.441488] niks3-server[1194]: 2026/09/22 10:49:12 INFO Completed upload id=27 machine # [ 291.448633] nix[8162]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 291.449552] nix[8162]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine: (finished: waiting for success: journalctl -u vialb | grep -q "building '/nix/store/.*-slow-lb1.drv'", in 1.09 seconds) machine: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod -l app.kubernetes.io/component=lb --wait=false, in 0.32 seconds) machine: waiting for success: ! systemctl is-active vialb machine # [ 292.567480] nix[8162]: scheduler at 127.0.0.1:30051: Stream removed (Socket closed), reconnecting machine # [ 292.569436] nix[8162]: d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv: Stream removed (Socket closed), asking the scheduler again machine # [ 292.591749] systemd[1]: cri-containerd-9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9.scope: Deactivated successfully. machine # [ 292.592883] systemd[1]: cri-containerd-9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9.scope: Consumed 2.726s CPU time over 4min 484ms wall clock time, 44.2M memory peak, 23.2M read from disk, 473.2K incoming IP traffic, 446.1K outgoing IP traffic. machine # [ 292.625808] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9-rootfs.mount: Deactivated successfully. machine # [ 292.656809] systemd[1]: cri-containerd-86b885fba9719af79f6cbd66af7d0e5bef5748f15538c31b543cd43140704fb2.scope: Deactivated successfully. machine # [ 292.689375] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-86b885fba9719af79f6cbd66af7d0e5bef5748f15538c31b543cd43140704fb2-rootfs.mount: Deactivated successfully. machine # [ 292.717837] systemd[1]: run-k3s-containerd-io.containerd.grpc.v1.cri-sandboxes-86b885fba9719af79f6cbd66af7d0e5bef5748f15538c31b543cd43140704fb2-shm.mount: Deactivated successfully. machine # [ 292.915369] cni0: port 3(vethb351ab99) entered disabled state machine # [ 292.768308] dhcpcd[683]: vethb351ab99: carrier lost machine # [ 292.918025] vethb351ab99 (unregistering): left allmulticast mode machine # [ 292.919122] vethb351ab99 (unregistering): left promiscuous mode machine # [ 292.920565] cni0: port 3(vethb351ab99) entered disabled state machine # [ 292.789821] systemd[1]: run-netns-cni\x2d1a82f48f\x2dbd1e\x2dfbcf\x2dc825\x2d01b50bcdd016.mount: Deactivated successfully. machine # [ 292.813429] dhcpcd[683]: vethb351ab99: deleting address fe80::dc4b:4cff:fea8:1bf2 machine # [ 292.817484] dhcpcd[683]: vethb351ab99: deleting route to 169.254.0.0/16 machine # [ 292.832898] systemd[1]: Created slice libcontainer container kubepods-besteffort-pod3fb0c620_6a36_4b14_9cd8_ffd859100909.slice. machine # [ 292.915295] dhcpcd[683]: vethb351ab99: removing interface machine # [ 292.919852] k3s[887]: I0922 10:49:13.729605 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-ca\" (UniqueName: \"kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-ca\") pod \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\" (UID: \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\") " machine # [ 292.921106] k3s[887]: I0922 10:49:13.729660 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64a2a7bc-2078-4ab8-8ada-decc76cc978b-config\" (UniqueName: \"kubernetes.io/configmap/64a2a7bc-2078-4ab8-8ada-decc76cc978b-config\") pod \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\" (UID: \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\") " machine # [ 292.922911] k3s[887]: I0922 10:49:13.729693 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-lb\" (UniqueName: \"kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-lb\") pod \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\" (UID: \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\") " machine # [ 292.923819] k3s[887]: I0922 10:49:13.729725 887 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tmp\" (UniqueName: \"kubernetes.io/empty-dir/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tmp\") pod \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\" (UID: \"64a2a7bc-2078-4ab8-8ada-decc76cc978b\") " machine # [ 292.924638] k3s[887]: I0922 10:49:13.729769 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3fb0c620-6a36-4b14-9cd8-ffd859100909-config\") pod \"nix-grpc-farm-lb-68c8f49bd6-c7t4l\" (UID: \"3fb0c620-6a36-4b14-9cd8-ffd859100909\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-c7t4l" machine # [ 292.925133] k3s[887]: I0922 10:49:13.729796 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/3fb0c620-6a36-4b14-9cd8-ffd859100909-tls-ca\") pod \"nix-grpc-farm-lb-68c8f49bd6-c7t4l\" (UID: \"3fb0c620-6a36-4b14-9cd8-ffd859100909\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-c7t4l" machine # [ 292.925315] k3s[887]: I0922 10:49:13.729820 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fb0c620-6a36-4b14-9cd8-ffd859100909-tmp\") pod \"nix-grpc-farm-lb-68c8f49bd6-c7t4l\" (UID: \"3fb0c620-6a36-4b14-9cd8-ffd859100909\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-c7t4l" machine # [ 292.925860] k3s[887]: I0922 10:49:13.729847 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/3fb0c620-6a36-4b14-9cd8-ffd859100909-tls-lb\") pod \"nix-grpc-farm-lb-68c8f49bd6-c7t4l\" (UID: \"3fb0c620-6a36-4b14-9cd8-ffd859100909\") " pod="farm/nix-grpc-farm-lb-68c8f49bd6-c7t4l" machine # [ 292.926761] systemd[1]: var-lib-kubelet-pods-64a2a7bc\x2d2078\x2d4ab8\x2d8ada\x2ddecc76cc978b-volumes-kubernetes.io\x7esecret-tls\x2dlb.mount: Deactivated successfully. machine # [ 292.956153] k3s[887]: I0922 10:49:13.766131 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-ca" pod "64a2a7bc-2078-4ab8-8ada-decc76cc978b" (UID: "64a2a7bc-2078-4ab8-8ada-decc76cc978b"). InnerVolumeSpecName "tls-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 292.957052] k3s[887]: I0922 10:49:13.767037 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-lb" pod "64a2a7bc-2078-4ab8-8ada-decc76cc978b" (UID: "64a2a7bc-2078-4ab8-8ada-decc76cc978b"). InnerVolumeSpecName "tls-lb". PluginName "kubernetes.io/secret", VolumeGIDValue "" machine # [ 292.970756] k3s[887]: I0922 10:49:13.780755 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tmp" pod "64a2a7bc-2078-4ab8-8ada-decc76cc978b" (UID: "64a2a7bc-2078-4ab8-8ada-decc76cc978b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" machine # [ 292.976890] k3s[887]: I0922 10:49:13.786885 887 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a2a7bc-2078-4ab8-8ada-decc76cc978b-config" pod "64a2a7bc-2078-4ab8-8ada-decc76cc978b" (UID: "64a2a7bc-2078-4ab8-8ada-decc76cc978b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" machine # [ 293.020645] k3s[887]: I0922 10:49:13.830415 887 reconciler_common.go:299] "Volume detached for volume \"tls-ca\" (UniqueName: \"kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-ca\") on node \"machine\" DevicePath \"\"" machine # [ 293.026365] k3s[887]: I0922 10:49:13.830449 887 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64a2a7bc-2078-4ab8-8ada-decc76cc978b-config\") on node \"machine\" DevicePath \"\"" machine # [ 293.027078] k3s[887]: I0922 10:49:13.830462 887 reconciler_common.go:299] "Volume detached for volume \"tls-lb\" (UniqueName: \"kubernetes.io/secret/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tls-lb\") on node \"machine\" DevicePath \"\"" machine # [ 293.027559] k3s[887]: I0922 10:49:13.830475 887 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64a2a7bc-2078-4ab8-8ada-decc76cc978b-tmp\") on node \"machine\" DevicePath \"\"" machine # [ 293.312903] cni0: port 2(veth3f567cf7) entered blocking state machine # [ 293.314079] cni0: port 2(veth3f567cf7) entered disabled state machine # [ 293.315402] veth3f567cf7: entered allmulticast mode machine # [ 293.316626] veth3f567cf7: entered promiscuous mode machine # [ 293.171758] (udev-worker)[8350]: Network interface NamePolicy= disabled on kernel command line. machine # [ 293.325692] cni0: port 2(veth3f567cf7) entered blocking state machine # [ 293.326536] cni0: port 2(veth3f567cf7) entered forwarding state machine # [ 293.205686] dhcpcd[683]: veth3f567cf7: IAID 00:5c:f1:97 machine # [ 293.206536] dhcpcd[683]: veth3f567cf7: adding address fe80::643f:ff:fe5c:f197 machine # [ 293.263329] systemd[1]: Started libcontainer container fc30eb2bba7e09153332b868104692ec22e9374dc24a60d4a659a5ab5199b346. machine # [ 293.290097] k3s[887]: I0922 10:49:14.099996 887 scope.go:122] "RemoveContainer" containerID="9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9" machine # [ 293.297824] systemd[1]: Removed slice libcontainer container kubepods-besteffort-pod64a2a7bc_2078_4ab8_8ada_decc76cc978b.slice. machine # [ 293.298890] systemd[1]: kubepods-besteffort-pod64a2a7bc_2078_4ab8_8ada_decc76cc978b.slice: Consumed 2.762s CPU time over 4min 2.347s wall clock time, 44.5M memory peak, 23.2M read from disk, 473.2K incoming IP traffic, 446.1K outgoing IP traffic. machine # [ 293.304427] k3s[887]: I0922 10:49:14.114438 887 scope.go:122] "RemoveContainer" containerID="9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9" machine # [ 293.305393] k3s[887]: E0922 10:49:14.115012 887 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9\": not found" containerID="9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9" machine # [ 293.306648] k3s[887]: I0922 10:49:14.115051 887 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"containerd","ID":"9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9"} err="failed to get container status \"9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9\": rpc error: code = NotFound desc = an error occurred when try to find container \"9cec0b7d3514590212c4783f32f943647c76b94ef4e56a1c6837cd0e23e901b9\": not found" machine # [ 293.392659] systemd[1]: Started libcontainer container f922cea12b728a0cca2e1c632f0073a75fba47ce19dc3d7994f49be6ea9a639c. machine # [ 293.635593] systemd[1]: var-lib-kubelet-pods-64a2a7bc\x2d2078\x2d4ab8\x2d8ada\x2ddecc76cc978b-volume\x2dsubpaths-config-envoy-2.mount: Deactivated successfully. machine # [ 293.636176] systemd[1]: var-lib-kubelet-pods-64a2a7bc\x2d2078\x2d4ab8\x2d8ada\x2ddecc76cc978b-volume\x2dsubpaths-config-envoy-1.mount: Deactivated successfully. machine # [ 293.636664] systemd[1]: var-lib-kubelet-pods-64a2a7bc\x2d2078\x2d4ab8\x2d8ada\x2ddecc76cc978b-volume\x2dsubpaths-config-envoy-0.mount: Deactivated successfully. machine # [ 293.637154] systemd[1]: var-lib-kubelet-pods-64a2a7bc\x2d2078\x2d4ab8\x2d8ada\x2ddecc76cc978b-volumes-kubernetes.io\x7esecret-tls\x2dca.mount: Deactivated successfully. machine # [ 293.637675] systemd[1]: var-lib-kubelet-pods-64a2a7bc\x2d2078\x2d4ab8\x2d8ada\x2ddecc76cc978b-volumes-kubernetes.io\x7eempty\x2ddir-tmp.mount: Deactivated successfully. machine # [ 293.907740] dhcpcd[683]: veth3f567cf7: soliciting a DHCP lease machine # [ 294.317417] k3s[887]: I0922 10:49:15.126618 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-lb-68c8f49bd6-c7t4l" podStartSLOduration=2.126591615 podStartE2EDuration="2.126591615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:49:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:49:15.125063208 +0000 UTC m=+274.584792171" watchObservedRunningTime="2026-09-22 10:49:15.126591615 +0000 UTC m=+274.586262748" machine # [ 294.332141] k3s[887]: I0922 10:49:15.142029 887 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64a2a7bc-2078-4ab8-8ada-decc76cc978b" path="/var/lib/kubelet/pods/64a2a7bc-2078-4ab8-8ada-decc76cc978b/volumes" machine # [ 294.362428] dhcpcd[683]: veth3f567cf7: soliciting an IPv6 router machine # [ 295.070973] nix[8162]: scheduler at 127.0.0.1:30051: failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:30051: tcp handshaker shutdown, reconnecting machine # [ 296.110742] nix[8162]: building '/nix/store/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv' on 127.0.0.1:30051... machine # [ 296.112054] nix[8162]: slow-lb1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-hb75q: building d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 298.909197] dhcpcd[683]: veth3f567cf7: probing for an IPv4LL address machine # [ 304.217546] dhcpcd[683]: veth3f567cf7: using IPv4LL address 169.254.118.95 machine # [ 304.219791] dhcpcd[683]: veth3f567cf7: adding route to 169.254.0.0/16 machine # [ 306.367153] dhcpcd[683]: veth3f567cf7: no IPv6 Routers available machine # [ 312.492294] postgres[776]: [776] LOG: checkpoint starting: time machine # [ 325.025250] niks3-server[1194]: 2026/09/22 10:49:45 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 325.047942] niks3-server[1194]: 2026/09/22 10:49:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign machine # [ 325.052123] niks3-server[1194]: 2026/09/22 10:49:45 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.ls machine # [ 325.054412] niks3-server[1194]: 2026/09/22 10:49:45 INFO Registered completed upload object_key=log/d3pzijs4zz7gwai9b8n1j50g96lqiii4-slow-lb1.drv machine # [ 325.055436] niks3-server[1194]: 2026/09/22 10:49:45 INFO Signed narinfos id=28 count=1 machine # [ 325.063262] niks3-server[1194]: 2026/09/22 10:49:45 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete machine # [ 325.067732] niks3-server[1194]: 2026/09/22 10:49:45 INFO Registered completed upload object_key=2804s0b4bxfggjycnhf3zz7f1g8jfsvp.narinfo machine # [ 325.071691] niks3-server[1194]: 2026/09/22 10:49:45 INFO Completed upload id=28 machine # [ 325.112484] systemd[1]: vialb.service: Deactivated successfully. machine # [ 325.113411] systemd[1]: vialb.service: Consumed 165ms CPU time over 34.002s wall clock time, 38.3M memory peak, 4K written to disk, 7.8K incoming IP traffic, 17K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active vialb, in 33.64 seconds) machine: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value vialb | grep -qx success || { journalctl -u vialb >&2; false; }, in 0.05 seconds) machine: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s machine: (finished: waiting for success: kubectl -n farm rollout status deployment nix-grpc-farm-lb --timeout=10s, in 0.34 seconds) (finished: subtest: losing the balancer mid-build: the client reconnects and the build succeeds, in 35.50 seconds) subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes machine: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 machine # [ 326.607720] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt" --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1. machine # Running as unit: slow.service; invocation ID: 9d22d0e562374bf5bdde0af91769910e machine: (finished: must succeed: systemd-run --unit slow nix build -L --store 'grpc://127.0.0.1:30051?ca-cert=/nix/store/n84pj2wgk9fv73xaahmrhkh1pnqm2rg6-k3s-farm-certs/ca.crt&token-file=/tmp/builder.jwt' --eval-store auto -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1, in 0.05 seconds) machine # [ 326.835931] nix[8956]: don't know how to build these paths: machine # [ 326.836751] nix[8956]: /nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 326.860552] nix[8956]: copying 1 paths to '127.0.0.1:30051'... machine # [ 326.863562] nix[8956]: copying path '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' to '127.0.0.1:30051'... machine # [ 326.913396] k3s[887]: E0922 10:49:47.722910 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59170: use of closed network connection machine # command terminated with exit code 1 machine # [ 326.930898] niks3-server[1194]: 2026/09/22 10:49:47 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 326.946670] niks3-server[1194]: 2026/09/22 10:49:47 INFO Registered completed upload object_key=nar/0wl2i9xpw0gwrx1xqdgx9ka4n503ky9qhl20pdrdlphn8d6lcx0i.nar.zst machine # [ 326.951096] niks3-server[1194]: 2026/09/22 10:49:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign machine # [ 326.951833] niks3-server[1194]: 2026/09/22 10:49:47 INFO Signed narinfos id=29 count=1 machine # [ 326.955538] niks3-server[1194]: 2026/09/22 10:49:47 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.ls machine # [ 326.958483] niks3-server[1194]: 2026/09/22 10:49:47 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete machine # [ 326.960169] niks3-server[1194]: 2026/09/22 10:49:47 INFO Completed upload id=29 machine # [ 326.963838] niks3-server[1194]: 2026/09/22 10:49:47 INFO Registered completed upload object_key=zlgfhpppbdjjaq7dv6cy36ss086nzwmz.narinfo machine # [ 326.967358] nix[8956]: building '/nix/store/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv' on 127.0.0.1:30051... machine # [ 326.968883] nix[8956]: slow-s1> machine/nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb: building zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 327.220047] k3s[887]: E0922 10:49:48.029911 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59204: use of closed network connection machine # command terminated with exit code 1 machine # [ 328.546571] k3s[887]: E0922 10:49:49.356185 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59220: use of closed network connection machine # command terminated with exit code 1 machine # [ 328.826669] k3s[887]: E0922 10:49:49.636397 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59238: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 330.197490] k3s[887]: E0922 10:49:51.006833 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59268: use of closed network connection machine # [ 330.198599] k3s[887]: time="2026-09-22T10:49:51Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:33132->127.0.0.1:10250: write: broken pipe" machine # [ 330.527208] k3s[887]: E0922 10:49:51.337054 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59298: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 331.961646] k3s[887]: E0922 10:49:52.770785 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59314: use of closed network connection machine # [ 332.346322] k3s[887]: E0922 10:49:53.156248 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:59354: use of closed network connection machine # command terminated with exit code 1 machine # command terminated with exit code 1 machine # [ 333.696211] k3s[887]: time="2026-09-22T10:49:54Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:57164->127.0.0.1:10250: write: connection reset by peer" machine # [ 333.700379] k3s[887]: E0922 10:49:54.505545 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55436: use of closed network connection machine # [ 333.986523] k3s[887]: E0922 10:49:54.796180 887 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:33394->127.0.0.1:10010: write tcp 127.0.0.1:33394->127.0.0.1:10010: write: broken pipe machine # command terminated with exit code 1 machine # [ 333.993509] k3s[887]: E0922 10:49:54.796213 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55458: use of closed network connection machine # [ 333.997695] k3s[887]: time="2026-09-22T10:49:54Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:57172->127.0.0.1:10250: write: connection reset by peer" machine # [ 335.383977] k3s[887]: E0922 10:49:56.193358 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55490: use of closed network connection machine # [ 335.387198] k3s[887]: E0922 10:49:56.194341 887 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:33404->127.0.0.1:10010: write tcp 127.0.0.1:33404->127.0.0.1:10010: write: broken pipe machine # command terminated with exit code 1 machine # [ 335.680546] k3s[887]: E0922 10:49:56.490064 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55506: use of closed network connection machine # [ 335.684370] k3s[887]: E0922 10:49:56.490305 887 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:33410->127.0.0.1:10010: write tcp 127.0.0.1:33410->127.0.0.1:10010: write: connection reset by peer machine # [ 335.689526] k3s[887]: time="2026-09-22T10:49:56Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:6443->127.0.0.1:55516: write: connection reset by peer" machine # [ 335.985717] k3s[887]: E0922 10:49:56.795717 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55536: use of closed network connection machine # command terminated with exit code 1 machine # [ 336.278333] k3s[887]: E0922 10:49:57.088207 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55578: use of closed network connection machine: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb --wait=false machine: (finished: must succeed: kubectl -n farm delete pod nix-grpc-farm-worker-x86-64-linux-7777686f4d-pj4vb --wait=false, in 0.23 seconds) machine: must succeed: sleep 5.0 machine # [ 336.566828] systemd[1]: cri-containerd-84e25a31c91655fd2a24dced7a7aac17cd235b0ca58bf99e26e52df98f2a90cc.scope: Deactivated successfully. machine # [ 336.569657] systemd[1]: cri-containerd-84e25a31c91655fd2a24dced7a7aac17cd235b0ca58bf99e26e52df98f2a90cc.scope: Consumed 268ms CPU time over 4min 27.388s wall clock time, 12.4M memory peak, 5.2M read from disk. machine # [ 336.611317] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-84e25a31c91655fd2a24dced7a7aac17cd235b0ca58bf99e26e52df98f2a90cc-rootfs.mount: Deactivated successfully. machine # [ 336.946157] systemd[1]: Created slice libcontainer container kubepods-besteffort-podcb77a142_3868_486d_bac5_7e27ee1b8f9e.slice. machine # [ 337.067406] k3s[887]: I0922 10:49:57.876025 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc\" (UniqueName: \"kubernetes.io/secret/cb77a142-3868-486d-bac5-7e27ee1b8f9e-oidc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l\" (UID: \"cb77a142-3868-486d-bac5-7e27ee1b8f9e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l" machine # [ 337.068618] k3s[887]: I0922 10:49:57.876108 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nixconf\" (UniqueName: \"kubernetes.io/configmap/cb77a142-3868-486d-bac5-7e27ee1b8f9e-nixconf\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l\" (UID: \"cb77a142-3868-486d-bac5-7e27ee1b8f9e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l" machine # [ 337.071256] k3s[887]: I0922 10:49:57.876144 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nix\" (UniqueName: \"kubernetes.io/empty-dir/cb77a142-3868-486d-bac5-7e27ee1b8f9e-nix\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l\" (UID: \"cb77a142-3868-486d-bac5-7e27ee1b8f9e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l" machine # [ 337.073455] k3s[887]: I0922 10:49:57.876175 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls\" (UniqueName: \"kubernetes.io/secret/cb77a142-3868-486d-bac5-7e27ee1b8f9e-tls\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l\" (UID: \"cb77a142-3868-486d-bac5-7e27ee1b8f9e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l" machine # [ 337.074770] k3s[887]: I0922 10:49:57.876327 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cb77a142-3868-486d-bac5-7e27ee1b8f9e-ca\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l\" (UID: \"cb77a142-3868-486d-bac5-7e27ee1b8f9e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l" machine # [ 337.076638] k3s[887]: I0922 10:49:57.876435 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvcxc\" (UniqueName: \"kubernetes.io/projected/cb77a142-3868-486d-bac5-7e27ee1b8f9e-kube-api-access-gvcxc\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l\" (UID: \"cb77a142-3868-486d-bac5-7e27ee1b8f9e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l" machine # [ 337.077239] k3s[887]: I0922 10:49:57.876489 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"build\" (UniqueName: \"kubernetes.io/empty-dir/cb77a142-3868-486d-bac5-7e27ee1b8f9e-build\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l\" (UID: \"cb77a142-3868-486d-bac5-7e27ee1b8f9e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l" machine # [ 337.079339] k3s[887]: I0922 10:49:57.876527 887 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"niks3-token\" (UniqueName: \"kubernetes.io/projected/cb77a142-3868-486d-bac5-7e27ee1b8f9e-niks3-token\") pod \"nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l\" (UID: \"cb77a142-3868-486d-bac5-7e27ee1b8f9e\") " pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l" machine # [ 337.443691] cni0: port 3(veth20e89d64) entered blocking state machine # [ 337.445354] cni0: port 3(veth20e89d64) entered disabled state machine # [ 337.446505] veth20e89d64: entered allmulticast mode machine # [ 337.447224] veth20e89d64: entered promiscuous mode machine # [ 337.460289] cni0: port 3(veth20e89d64) entered blocking state machine # [ 337.461192] cni0: port 3(veth20e89d64) entered forwarding state machine # [ 337.380611] (udev-worker)[9720]: Network interface NamePolicy= disabled on kernel command line. machine # [ 337.428974] dhcpcd[683]: veth20e89d64: IAID c7:7a:7a:f7 machine # [ 337.429849] dhcpcd[683]: veth20e89d64: adding address fe80::24d6:c7ff:fe7a:7af7 machine # [ 337.431994] systemd[1]: Started libcontainer container a6c0fb4dc1fbc191b1f27c3c42ea6a3a2b969e1154cbc6fc53940718960a331c. machine # [ 337.650124] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped2790345723.mount: Deactivated successfully. machine # [ 337.652875] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount4074780552.mount: Deactivated successfully. machine # [ 337.760449] systemd[1]: Started libcontainer container 4d2007f4fcdf1105180fc0990ee005188f04d41506aacfa3c93fba59c7158235. machine # [ 338.740656] dhcpcd[683]: veth20e89d64: soliciting a DHCP lease machine # [ 339.452842] dhcpcd[683]: veth20e89d64: soliciting an IPv6 router machine # [ 339.490361] systemd[1]: cri-containerd-4d2007f4fcdf1105180fc0990ee005188f04d41506aacfa3c93fba59c7158235.scope: Deactivated successfully. machine # [ 339.494966] systemd[1]: cri-containerd-4d2007f4fcdf1105180fc0990ee005188f04d41506aacfa3c93fba59c7158235.scope: Consumed 801ms CPU time over 1.730s wall clock time, 494.7M memory peak, 187.5M read from disk, 180.6M written to disk. machine # [ 339.570553] systemd[1]: run-k3s-containerd-io.containerd.runtime.v2.task-k8s.io-4d2007f4fcdf1105180fc0990ee005188f04d41506aacfa3c93fba59c7158235-rootfs.mount: Deactivated successfully. machine # [ 340.578263] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped171525415.mount: Deactivated successfully. machine # [ 340.637632] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-ovl\x2didmapped341341241.mount: Deactivated successfully. machine # [ 340.641885] systemd[1]: var-lib-rancher-k3s-agent-containerd-tmpmounts-containerd\x2dmount1154361446.mount: Deactivated successfully. machine # [ 340.766484] systemd[1]: Started libcontainer container 37f9cc1235e29aa87ee939ca784b1e1c6b5c0d28fd4bf802398fa93ac1a82cce. machine # [ 340.951591] systemd[1]: Started libcontainer container 2da663acf132b06bfab2401a4b2d2cfcb394b8f27c6b5c9fed97f37e32464cb3. machine # [ 341.145813] systemd[1]: Started libcontainer container ce07c1657ce031127601c45238072b80b5af814f883fb85d55c46504d7ffc987. machine: (finished: must succeed: sleep 5.0, in 5.05 seconds) machine # command terminated with exit code 1 machine # [ 341.837144] k3s[887]: E0922 10:50:02.646450 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55618: use of closed network connection machine # [ 342.085972] k3s[887]: time="2026-09-22T10:50:02Z" level=warning msg="Proxy error: write failed: write tcp 127.0.0.1:57220->127.0.0.1:10250: write: connection reset by peer" machine # [ 342.086660] k3s[887]: E0922 10:50:02.896134 887 conn.go:339] Error on socket receive: read tcp 127.0.0.1:6443->127.0.0.1:55650: use of closed network connection machine: waiting for success: ! systemctl is-active slow machine # [ 342.279430] k3s[887]: I0922 10:50:03.089298 887 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="farm/nix-grpc-farm-worker-x86-64-linux-7777686f4d-l6p9l" podStartSLOduration=4.395599542 podStartE2EDuration="6.089275973s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.693676431s" isStatefulPod=false podCreationTimestamp="2026-09-22 10:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-22 10:50:02.372491298 +0000 UTC m=+321.832164946" watchObservedRunningTime="2026-09-22 10:50:03.089275973 +0000 UTC m=+322.548944872" machine # [ 343.741689] dhcpcd[683]: veth20e89d64: probing for an IPv4LL address machine # [ 349.011821] dhcpcd[683]: veth20e89d64: using IPv4LL address 169.254.5.39 machine # [ 349.015634] dhcpcd[683]: veth20e89d64: adding route to 169.254.0.0/16 machine # [ 351.456305] dhcpcd[683]: veth20e89d64: no IPv6 Routers available machine # [ 355.663616] niks3-server[1194]: 2026/09/22 10:50:16 INFO Received uploads request method=POST path=/api/pending_closures machine # [ 355.678886] niks3-server[1194]: 2026/09/22 10:50:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign machine # [ 355.680509] niks3-server[1194]: 2026/09/22 10:50:16 INFO Signed narinfos id=30 count=1 machine # [ 355.683677] niks3-server[1194]: 2026/09/22 10:50:16 INFO Registered completed upload object_key=log/zlgfhpppbdjjaq7dv6cy36ss086nzwmz-slow-s1.drv machine # [ 355.685540] niks3-server[1194]: 2026/09/22 10:50:16 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.ls machine # [ 355.690153] niks3-server[1194]: 2026/09/22 10:50:16 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete machine # [ 355.692177] niks3-server[1194]: 2026/09/22 10:50:16 INFO Completed upload id=30 machine # [ 355.694396] niks3-server[1194]: 2026/09/22 10:50:16 INFO Registered completed upload object_key=yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo machine # [ 356.752229] systemd[1]: slow.service: Deactivated successfully. machine # [ 356.755688] systemd[1]: slow.service: Consumed 162ms CPU time over 30.144s wall clock time, 38.2M memory peak, 4K written to disk, 4.6K incoming IP traffic, 11.4K outgoing IP traffic. machine: (finished: waiting for success: ! systemctl is-active slow, in 14.76 seconds) machine: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; } machine: (finished: must succeed: systemctl show -p Result --value slow | grep -qx success || { journalctl -u slow >&2; false; }, in 0.05 seconds) machine: must fail: journalctl -u slow | grep -q 'asking the scheduler again' machine: (finished: must fail: journalctl -u slow | grep -q 'asking the scheduler again', in 0.03 seconds) machine: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath machine: (finished: must succeed: nix eval --raw -f /nix/store/434skfxjp21wrad1nb0qdhhpgrbh812m-slow.nix --argstr tag s1 outPath, in 0.25 seconds) machine: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null machine: (finished: must succeed: curl -sf http://192.168.1.1:5751/yn9npyvhypx0s0v0rp739lvy4yjqph7k.narinfo > /dev/null, in 0.05 seconds) (finished: subtest: deleting a worker pod mid-build drains it: the build finishes there and publishes, in 30.66 seconds) (finished: run the VM test script, in 358.28 seconds) test script finished in 358.34s cleanup kill QemuMachine (pid 45) machine # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.10 seconds) additionally exposed symbols: machine, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh